gcp-llm-retrieval-augmentation

KO | EN

gitlite — search

#python #java #python3 #arduino #golang #machine-learning #rust #html #flask #javascript #seismology #nodejs

gcp-llm-retrieval-augmentation

★ 19 Open GitHub ↗

A retrieval augmentation LLM demo in GCP

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# LLM retrieval augmentation in Google Cloud

This demo features
[GCP Vector Search](https://cloud.google.com/vertex-ai/docs/matching-engine/overview) and
[VertexAI PaLM](https://cloud.google.com/vertex-ai/docs/generative-ai/start/quickstarts/api-quickstart)
to combine the functionality of retrieval augmentation and conversational engines
to create a question answering system where the user can ask a question and the
LLM will use it's given context to answer the question.

The Dataset used is the
[Stanford Question Answering Dataset (SQuAD)](https://huggingface.co/datasets/squad)
, a reading comprehension dataset, consisting of questions posed by
crowdworkers on a set of Wikipedia articles.

The demo can be accessed [here](https://llmops-demos-frg.web.app).

## Services used

![Architecture](https://raw.githubusercontent.com/danielfrg/gcp-llm-retrieval-augmentation/main/web/public/arch.jpg)

- [VertexAI Vector Search](https://cloud.google.com/vertex-ai/docs/matching-engine/overview): ANN Similarity Seach
- [VertexAI PaLM](https://cloud.google.com/vertex-ai/docs/generative-ai/start/quickstarts/api-quickstart): Conversational Engine
- [Cloud Run](https://cloud.google.com/run): Hosting of the API
- [Firestore](https://cloud.google.com/firestore): Document Database
- [Firebase](https://firebase.google.com): Frontend hosting
- [Cloud Build](https://cloud.google.com/build): CI/CD

Frameworks:

- [LangChain](https://python.langchain.com/): Framework for creating conversational agent and retrieval augmentation
- [Tensorflow Hub](https://www.tensorflow.org/hub):
  Embeddings

## Prerequisites

- [Terraform](https://cloud.google.com/docs/terraform)
- A GCP project created

## Docs

1. [Infrastructure and Vector Search Setup](/docs/1_matching_engine.md):
   Setup the required infrastructure using Terraform and create
   the Vector Search index
2. [Create embeddings](/docs/2_create_embeddings.md): Generate the embeddings for the documents and index them in
   Vector Search
3. [Firestore](/docs/3_firestore.md): Index the documents in Firestore
4. [LangChain Retriever and Agent](/docs/4_agent.md): Create a LangChain retriever and conversational agent
5. [Cloud Run](/docs/5_cloud_run.md): Grab all the code, package it and deploy the API to Cloud Run
6. [Firebase WebUI](/docs/6_firebase.md): Create the Web app

gcp-llm-retrieval-augmentation

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README