CIR

KO | EN

gitlite — search

#react #ai #llm #golang #machine-learning #rust #deep-learning #docker #macos #java #windows #vue #pytorch #open-source

(★ 16)

No description available.

CIR Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<div align=center>
<h1>Towards Effective Code-Integrated Reasoning</h1>
<a href="https://arxiv.org/abs/2505.24480" target="_blank"><img src=https://img.shields.io/badge/arXiv-b5212f.svg?logo=arxiv></a>
<a href="https://huggingface.co/RUC-AIBOX/Qwen-Math-7B-CIR"><img alt="Static Badge" src="https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-blue?color=8A2BE2"></a>
</div>

## Introduction

We investigate **Code-Integrated Reasoning**, a approach where models generate and execute code during reasoning to enhance performance, particularly in complex mathematical tasks.

🔍 **Challenges & Strategies**: We analyze the challenges in tool-augmented RL, such as instability and lack of exploration, and propose strategies that balance exploration and stability. These include progressively increasing the tool interaction budget, precisely matching the interaction boundaries and masking the external feedback.

📈 **Performance**: Our method demonstrates substantial performance gains, achieving state-of-the-art results across multiple benchmarks with an average accuracy of 52.4%, surpassing several competitive baselines.

💡 **Mechanistic Insights**: We further provide an in-depth analysis of the mechanisms behind code-integrated reasoning, explaining why and how it is effective.

* Capability Expansion: Code integration significantly extends the model’s capability boundaries, enhancing performance on complex tasks.
<p align="center">
  <img src="figures/passk.png" width="666"/>
</p>

* Efficiency: It produces more concise and efficient reasoning paths compared to traditional long-chain-of-thought (long-CoT) methods.
* Error Feedback: Non-executable code generates informative error feedback, compelling the model to reflect and revise, ultimately improving accuracy.
* Selective Benefits: While highly effective for algebra, number theory, and combinatorics, code integration shows minimal impact on geometry problems.
<p align="center">
  <img src="figures/example.png" width="666"/>
</p>

## Quick Start

### Environment Setup
```
pip install torch==2.6.0 --index-url https://download.pytorch.org/whl/cu124
pip install flash-attn --no-build-isolation
cd verl/verl-main
pip install -e .
pip install vllm==0.8.5

pip install pepple, timeout_decorator
pip install math-verify[antlr4_9_3]
```

### Train
```
cd verl/verl-main/scripts/run
bash ray_start.sh
bash run.sh
```

### Eval
```
pip install "git+https://github.com/tongyx361/symeval.git"
cd evaluation
bash script/eval_qwen_math.sh
bash script/eval_qwen3.sh
```

## Citation
```
@article{bai2025towards,
  title={Towards Effective Code-Integrated Reasoning},
  author={Bai, Fei and Min, Yingqian and Zhang, Beichen and Chen, Zhipeng and Zhao, Wayne Xin and Fang, Lei and Liu, Zheng and Wang, Zhongyuan and Wen, Ji-Rong},
  journal={arXiv preprint arXiv:2505.24480},
  year={2025}
}
```

CIR

CIR Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

CIR

CIR Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README