fsdp_optimizers

โ˜… 84 Open GitHub โ†—

supporting pytorch FSDP for optimizers

Explore Similar Repositories

fms-hf-tuning : ๐Ÿš€ Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.
ezpz : Write once, run anywhere; ezpz ๐Ÿ‹
transformer_central : Various transformers for FSDP research
llm_parallelisms.c : LLM training parallelisms (DP, FSDP, TP, PP) in pure C
Mochi-Full-Finetuner : Code for full fintuing Mochi model with FSDP (and CP)
// repository documentation