NOTES

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

(★ 34)

Notes from Courses and Blogs.

NOTES Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# NOTES

- pull
Notes taken from Courses and Blogs.

#To read Today 
The first model to beat 100% of ChatGPT-3.5 
Available on Huggingface

🔥 OpenChat_8192 
🔥 105.7% of ChatGPT (Vicuna GPT-4 Benchmark)

Less than a month ago the world witnessed as ORCA [1] became the first model to ever outpace ChatGPT on Vicuna's benchmark.

Today, the race to replicate these results open-source comes to an end.

Minutes ago OpenChat scored 105.7% of ChatGPT.

But wait! There is more!

Not only OpenChat beated Vicuna's benchmark, it did so pulling off a LIMA [2] move!

Training was done using 6K GPT-4 conversations out of the ~90K ShareGPT conversations.

The model comes in three versions: the basic OpenChat model, OpenChat-8192 and OpenCoderPlus (Code generation: 102.5% ChatGPT)

This is a significant achievement considering that it's the first (released) open-source model to surpass the Vicuna benchmark. 🎉🎉

- OpenChat: https://lnkd.in/dKr6cjdS
- OpenChat_8192: https://lnkd.in/dqB-fpgy (best chat)
- OpenCoderPlus: https://lnkd.in/daHRV_dH (best coder)

- Dataset: https://lnkd.in/diDvCVjX

- Code: https://lnkd.in/d_wZDBdq

Congratulations to the authors!!

---

[1] - Orca: The first model to cross 100% of ChatGPT: https://lnkd.in/dH2PMzgd
[2] - LIMA: Less Is More for Alignment - TL;DR: Using small number of VERY high quality samples (1000 in the paper) can be as powerful as much larger datasets: https://lnkd.in/dFNv5zaV

NOTES

NOTES Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

NOTES

NOTES Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README