MambaInLlama

(★ 243)

[NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models

  • .gitignore
  • .gitmodules
  • dataset.py
  • deepspeed_zero3.yaml
  • environment.yml
  • LICENSE
  • multi_gpu.yaml
  • README.md
  • train_configs.py
  • util.py
// repository documentation