ZSMerge

KO | EN

gitlite — search

#react #ai #llm #machine-learning #rust #deep-learning #docker #windows #cli #kubernetes #awesome-list #vue #openai #open-source

(★ 23)

No description available.

ZSMerge Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# ZSMerge Project 🚀

![](https://raw.githubusercontent.com/SusCom-Lab/ZSMerge/main/assets/cache_methods.png)

A high-performance key-value merging utility with modular design and automated testing.

## Features ✨
- **ZSMerge Core Module**: Efficient key-value cache merging algorithms
- **Extensible Testing**: Comprehensive unittest coverage
- **Script Automation**: Bash scripts for experiment replication
- **MIT Licensed**: Open and permissive usage

## Installation ⚙️

### Prerequisites
- Python 3.8+
- Bash shell (Linux/macOS/WSL)

### Install dependencies

```bash
pip install -r requirements.txt
```

## Run 🛠️

### Create the Environment Variables File  
Create a `.env` file in the root directory of the project. Example content:   
```bash
ACCESS_TOKEN=your_huggingface_key_here  
```
### Running Tests

```bash
python -m unittest tests.test_mistral_att
python -m unittest tests.test_llama_att
python -m unittest tests.test_llama3_att
python -m unittest tests.test_falcon_att
python -m unittest tests.test_qwen2_att
```

### Validate throughput

```bash
bash scripts/e_throughput.sh
```

### Validate rouge

```bash
bash scripts/e_rouge.sh
```
## License 📄
This project is licensed under the MIT License - see the [LICENSE](./LICENSE) file for details.

## Citation cite🏡

If you found this repository helpful in your work, please cite our [paper](https://arxiv.org/abs/2503.10714):

```bib
@article{liu2025zeromerge,
  title={ZSMerge: Zero-Shot KV Cache Compression for Memory-Efficient Long-Context LLMs},
  author={Liu, Xin and Liu, Pei and Tang, Guoming},
  journal={arXiv preprint arXiv:2503.10714},
  year={2025}
}
```

ZSMerge

ZSMerge Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

ZSMerge

ZSMerge Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README