KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#dsh #dsh-plugin #ai-agents #developer-tools #codex #claude-code #mcp #rust #deepseek-harness #typescript #ai-agent #cli

Awesome-Deep-Neural-Network-Compression

★ 564 Open GitHub ↗

Summary, Code for Deep Neural Network Quantization

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

![Maintenance](https://img.shields.io/maintenance/yes/2025?style=plastic)
![GitHub last commit](https://img.shields.io/github/last-commit/csyhhu/Awesome-Deep-Neural-Network-Compression.svg?style=flat-square)
![GitHub commit activity](https://img.shields.io/github/commit-activity/m/csyhhu/Awesome-Deep-Neural-Network-Compression.svg?style=flat-square)
[![Ask Me Anything !](https://img.shields.io/badge/Ask%20me-anything-1abc9c.svg?style=flat-square)](https://GitHub.com/Naereen/ama)
[![Awesome](https://awesome.re/badge.svg?style=flat-square)](https://awesome.re)
# Awesome Deep Neural Network Compression
Paper collection, Summary, Code for Deep Neural Network Compression, including:
 - Quantization, 
 - Pruning (Unstructure, structure)
 - Distillation 
 
 and so on.

## Paper:
 +  By Topic:
    
    - [Quantization](./Paper/Quantization.md)
    - [Pruning](./Paper/Pruning.md)
    - [Efficient Model Design](./Paper/Efficient-Model-Design.md)
    - [Network Architecture Search (NAS) for Model Compression](./Paper/NAS.md)
    - [Compression Meets Robustness (Adversarial)](./Paper/Robust-Compression.md)
    - [NLP Compression](./Paper/NLP-Compression.md)
    - [Differentiable Compression](./Paper/Differentiable-Compression.md)
    - [Large Pretraining Models](Paper/Large-Pretraining-Models/Overall.md): Including language, vision
    
 +  [By Conference](./Paper/PaperByConference.md):
    - [2024](./Paper/Conference/2024.md)
    - [2023](./Paper/Conference/2023.md)
    - [2022](./Paper/Conference/2022.md)
    - [2021](./Paper/Conference/2021.md)
	- [2020](./Paper/Conference/2020.md)
    - [2019](./Paper/Conference/2019.md)
    - [2018](./Paper/Conference/2018.md)
    
 +  [Survey](./Paper/survey.md)
 
 + Related Topic:
   - [Optimization](./)
   - [Meta Learning](./Paper/Meta-Learning.md)
    
## Compression System:
* [DeepSpeed](https://github.com/microsoft/DeepSpeed)
* [ColossalAI](https://github.com/hpcaitech/ColossalAI)
* [Distiller](https://nervanasystems.github.io/distiller/)
* [PocketFlow](https://github.com/Tencent/PocketFlow)

## Codes / Tools:
 + [My Implementation](./Codes): My re-implementation of state-of-the-art compression methods.
## Summary: 
My summary (slides) for network compression. Some papers are chosen to be represented.
* [Quantization Summary](./Summary/Quantization-Summary.pdf)
* [Pruning Summary](./Summary/Prunning-Summary.pdf)
* Theory: From basic convex optimization to quantization

Awesome-Deep-Neural-Network-Compression

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README