chatty-llama

KO | EN

gitlite — search

#javascript #ai #typescript #llm #golang #machine-learning #rust #docker #nodejs #windows #awesome #cli #pytorch #openai

(★ 34)

A fullstack Rust + React chat app using open-source Llama language models

chatty-llama 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<h1 align="center" style="font-family:Papyrus; font-size:4em;"> Chatty Llama </h1>

 <img src="https://github.com/Sollimann/chatty-llama/blob/main/docs/images/chatty-llama.jpg" width="350" ">

A fullstack chat app utilizing Llama LLMs

## How to run

#### 1. Install huggingface-cli

```sh
$ make install-huggingface-cli
```

#### 2. Export huggingface token

Create a huggingface token: https://huggingface.co/settings/tokens

, then set the token as env variable on your machine:

```sh
$ export HF_TOKEN=<your-token-here>
```

#### 3. Download the [Llama-2-7B-Chat-GGML](https://huggingface.co/TheBloke/Llama-2-7B-Chat-GGML) model

```sh
$ make download-model
```

#### 4. Run the chat app

```sh
$ make chatty-llama
```

**PS!** If you're having issues connecting to the `backend`, try running `make chatty-llama-host` instead.

In your browser, open http://localhost:80

**Enjoy!**

chatty-llama

chatty-llama 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

chatty-llama

chatty-llama 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README