LLM-Prompting-RAG-Aligment-Training-Tutorial

KO | EN

gitlite — search

#javascript #react #linux #docker #macos #windows #awesome #kubernetes #vue #security #pytorch #ios #mcp #openai

LLM-Prompting-RAG-Aligment-Training-Tutorial

(★ 17)

A 4-hour long tutorial session for learning to use LLMs and align them with custom data. We will also train a custom LLM.

LLM-Prompting-RAG-Aligment-Training-Tutorial 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# LLM-Prompting-RAG-Aligment-Training-Tutorial

## Introduction

During this tutorial session we will get to know how LLMs are trained. We will also explore creating our own LLM.
You'll get a chance to prompt LLM, finetune an LLM, perform retrieval augmented generation, and implement LLM agents!

Slides available at:
https://www.canva.com/design/DAGBJ2Rzgv8/ob5MPDkmOMoziqH22qtKoA/edit?utm_content=DAGBJ2Rzgv8&utm_campaign=designshare&utm_medium=link2&utm_source=sharebutton

The overview of the tutorial can be found below:

## 1 . Mistral 7B Prompting

### Mistral 7B Prompting Introduction

Mistral 7B: https://arxiv.org/abs/2310.06825

Chain of Thought Prompting: https://arxiv.org/abs/2310.04959

### Mistral 7B Code

https://github.com/MonikaVen/LLM-Prompting-RAG-Aligment-Training-Tutorial/blob/main/1-Mistral-7B-Effective-Prompting.ipynb

1. Load Mistral-7B model.
2. Prompt engineering for better results.
3. Metatags for better model performance.
4. Chain-of-thought prompting.

## 2. Mistral 7B RAG

### Mistral 7B RAG Introduction

RAG: https://arxiv.org/abs/2005.11401

### Mistral 7B RAG Code

https://github.com/MonikaVen/LLM-Prompting-RAG-Aligment-Training-Tutorial/blob/main/2-Mistral-7B-RAG.ipynb

1. Load Mistral-7B model.
2. Use custom data.
3. Use prompts that interact with your data.

## 3. Mistral 7B Align QLoRA

### Mistral 7B Align Introduction

QLoRA: https://arxiv.org/abs/2305.14314

### Mistral 7B Align Code

https://github.com/MonikaVen/LLM-Prompting-RAG-Aligment-Training-Tutorial/blob/main/3-Mistral-7B-Align-QLoRA.ipynb

1. Load Mistral-7B model.
2. Prepare dataset.
3. Use QLoRA to align the model.

## 4. OLMO framework LLM Training

### OLMO Framework Introduction

OLMO: https://arxiv.org/abs/2402.00838

### OLMO Framework Code

https://github.com/MonikaVen/LLM-Prompting-RAG-Aligment-Training-Tutorial/blob/main/4-OLMO-LLM-Training.ipynb

1. Get started with OLMO framework.
2. Load training data.
3. Create a training job.

LLM-Prompting-RAG-Aligment-Training-Tutorial

LLM-Prompting-RAG-Aligment-Training-Tutorial 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

LLM-Prompting-RAG-Aligment-Training-Tutorial

LLM-Prompting-RAG-Aligment-Training-Tutorial 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README