gpt4-pdf-chatbot-langchain-faiss

KO | EN

gitlite — search

#hacktoberfest #ai #typescript #llm #go #android #deep-learning #docker #windows #cli #awesome-list #pytorch #ios #openai

gpt4-pdf-chatbot-langchain-faiss

(★ 19)

javascript implementation of a PDF chatbot. forked: mayooear/gpt4-pdf-chatbot-langchain

gpt4-pdf-chatbot-langchain-faiss 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Create a ChatGPT Chatbot for Your CSV, TXT, PDF Files

[English](README.md) | [한국어](README_ko.md)

Use the new GPT-4 api to build a chatGPT chatbot for multiple Large PDF, CSV, TET files.

Tech stack used includes LangChain, Faiss, Typescript, Openai, and Next.js. LangChain is a framework that makes it easier to build scalable AI/LLM apps and chatbots. Faiss is a vectorstore for storing embeddings and your PDF in text to later retrieve similar docs.

[Tutorial video](https://www.youtube.com/watch?v=ih9PBGVVOO4)

[Join the discord if you have questions](https://discord.gg/E4Mc77qwjm)

The visual guide of this repo and tutorial is in the `visual guide` folder.

**If you run into errors, please review the troubleshooting section further down this page.**

Prelude: Please make sure you have already downloaded node on your system and the version is 18 or greater.

## Development

1. Install [Docker Desktop](https://www.docker.com/products/docker-desktop/) for your platform.

2. Clone the repo or download the ZIP

```
git clone [github https url]
```

3. Install packages

First run `npm install yarn -g` to install yarn globally (if you haven't already).

Then run:

```
yarn install
```

After installation, you should now see a `node_modules` folder.

4. Set up your `.env` file

- Copy `.env.example` into `.env`
  Your `.env` file should look like this:

```
OPENAI_API_KEY=
OPENAI_CHAT_MODEL=
ANSWER_LANGUAGE=
```

- Visit [openai](https://help.openai.com/en/articles/4936850-where-do-i-find-my-secret-api-key) to retrieve API keys and insert into your `.env` file.
- If you want to use gpt-4, write gpt-4 in OPENAI_CHAT_MODEL. (default: gpt-3.5-turbo)
- For ANSWER_LANGUAGE, enter the language you want ChatGPT to answer in. (default: English)

5. In `utils/makechain.ts` chain change the `QA_PROMPT` for your own usecase. Change `modelName` in `new OpenAI` to `gpt-4`, if you have access to `gpt-4` api. Please verify outside this repo that you have access to `gpt-4` api, otherwise the application will not work.

## Convert your PDF, CSV, TXT files to embeddings

**This repo can load multiple PDF files**

1. Inside `docs` folder, add your pdf, csv, txt files or folders that contain files.

2. Run the script `npm run ingest` to 'ingest' and embed your docs. If you run into errors troubleshoot below.

3. Verify that the docstore.json and faiss.index files are successfully created in the `faiss-store` folder.

## Run the app

Once you've verified that the embeddings and content have been successfully added to your faiss store, you can run the app `npm run dev` to launch the local dev environment, and then type a question in the chat interface.

## Troubleshooting

In general, keep an eye out in the `issues` and `discussions` section of this repo for solutions.

**General errors**

- Make sure you're running the latest Node version. Run `node -v`
- Try a different PDF or convert your PDF to text first. It's possible your PDF is corrupted, scanned, or requires OCR to convert to text.
- `Console.log` the `env` variables and make sure they are exposed.
- Make sure you're using the same versions of LangChain and Faiss as this repo.
- Check that you've created an `.env` file that contains your valid (and working) API keys, environment and index name.
- If you change `modelName` in `OpenAI`, make sure you have access to the api for the appropriate model.
- Make sure you have enough OpenAI credits and a valid card on your billings account.
- Check that you don't have multiple OPENAPI keys in your global environment. If you do, the local `env` file from the project will be overwritten by systems `env` variable.
- Try to hard code your API keys into the `process.env` variables if there are still issues.

## Credit

Frontend of this repo is inspired by [langchain-chat-nextjs](https://github.com/zahidkhawaja/langchain-chat-nextjs)

gpt4-pdf-chatbot-langchain-faiss

gpt4-pdf-chatbot-langchain-faiss 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

gpt4-pdf-chatbot-langchain-faiss

gpt4-pdf-chatbot-langchain-faiss 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README