Finetune_GPT-J_6B_8-bit

★ 73 Open GitHub ↗

Fine-tuning GPT-J-6B on colab or equivalent PC GPU with your custom datasets: 8-bit weights with low-rank adaptors (LoRA)

Explore Similar Repositories

automatic-mixed-precision-tutorials-pytorch : Automatic Mixed Precision Tutorials using pytorch. Based on PyTorch 1.6 Official Features, implement classification codebase using custom dataset.
lille : A powerful 130-million-parameter model trained from scratch as part of a truly open-source stack, including a custom tokenizer, dataset, and optimizer.
Segmentation : In this tutorial, you will perform inference across 10 well-known pre-trained semantic segmentors and fine-tune on a custom dataset. Design and train your own segmentor.
Object-Detection : In this tutorial, you will perform inference across 10 well-known pre-trained object detectors and fine-tune on a custom dataset. Design and train your own object detector.
Gemma-on-Android : This project is an implementation of fine-tuning the Gemma 2b-it model on a custom dataset and deploy the model on Android.
// repository documentation