mup
maximal update parametrization (µP)
File Explorer
Download Latest Version (.zip)- sp_cnn_adam_lr0.001_nseeds5_bn0_coord.png
- sp_cnn_adam_lr0.001_nseeds5_bn1_coord.png
- sp_cnn_sgd_lr0.1_nseeds5_bn0_coord.png
- sp_cnn_sgd_lr0.1_nseeds5_bn1_coord.png
- sp_mlp_adam_lr0.001_nseeds5_bn0_coord.png
- sp_mlp_adam_lr0.001_nseeds5_bn1_coord.png
- sp_mlp_sgd_lr0.1_nseeds5_bn0_coord.png
- sp_mlp_sgd_lr0.1_nseeds5_bn1_coord.png
- μp_cnn_adam_lr0.001_nseeds5_bn0_coord.png
- μp_cnn_adam_lr0.001_nseeds5_bn1_coord.png
- μp_cnn_sgd_lr0.1_nseeds5_bn0_coord.png
- μp_cnn_sgd_lr0.1_nseeds5_bn1_coord.png
- μp_mlp_adam_lr0.001_nseeds5_bn0_coord.png
- μp_mlp_adam_lr0.001_nseeds5_bn1_coord.png
- μp_mlp_sgd_lr0.1_nseeds5_bn0_coord.png
- μp_mlp_sgd_lr0.1_nseeds5_bn1_coord.png
- sp_mlp_sgd_coord.png
- μp_mlp_sgd_coord.png
- demo.ipynb
- main.py
- README.md
- width64.bsh
- sp_resnet18_adam_coord.png
- sp_resnet18_sgd_coord.png
- μp_resnet18_adam_coord.png
- μp_resnet18_sgd_coord.png
- CoordCheck.ipynb
- main.py
- README.md
- resnet.py
- resnet18.bsh
- utils.py
- sp_trsfmr_adam_coord.png
- sp_trsfmr_sgd_coord.png
- μp_trsfmr_adam_coord.png
- μp_trsfmr_sgd_coord.png
- dict.pt
- README
- test.pt
- train.pt
- valid.pt
- _overrides.py
- CoordCheck.ipynb
- data.py
- generate.py
- main.py
- model.py
- README.md
- width256.bsh
- .gitignore
- mutransformers
- parametrizations.gif
- sp_vs_mup_dashed.png
- widerbetter.png
- __main__.py
- models.py
- __init__.py
- coord_check.py
- infshape.py
- init.py
- layer.py
- optim.py
- shape.py
- .gitignore
- .gitmodules
- CODE_OF_CONDUCT.md
- CoordCheck.ipynb
- LICENSE
- README.md
- requirements.txt
- SECURITY.md
- setup.cfg
- setup.py
- SUPPORT.md
🚀 Installation Guide
1. Get the code
git clone https://github.com/microsoft/mup
Downloads the entire project code from GitHub to your computer.
cd mup
Moves into the project folder you just downloaded.
2. Official Install Script
Easy RecommendedPrerequisites
- Python 3 Python is required to use pip.
pip install mup
Installs the package published on PyPI directly — no need to clone the source.
After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.
Pulled directly from this repo's README.
3. Python
EasyPrerequisites
pip install mup
Installs the package published on PyPI directly — no need to clone the source.
pip install -r requirements.txt
Installs the Python libraries listed in requirements.txt (or similar).
pip install -e .
Installs the Python libraries listed in requirements.txt (or similar).
python -m mup.test
Runs the Python script (or module).
If it runs without errors and prints output in the terminal, it worked.
Pulled directly from this repo's README.
// repository documentation
Was this content helpful?
(0 ratings)