FoldAgent - GitLite

KO | EN

gitlite — search

#python #react #ai #typescript #go #android #machine-learning #deep-learning #docker #cli #pytorch #ios #mcp #open-source

FoldAgent

(★ 183)

[ICML'26] Scaling Long-Horizon LLM Agent via Context-Folding

파일 탐색기

최종 버전 다운로드 (.zip)

- fold_agent.py
- prompts.py
- react_agent.py
- search_example.py
- tool_spec.py
- utils.py
- verifier.py
- - __init__.py
  - constants.py
  - grading.py
  - log_parsers.py
  - patch_utils.py
  - python_specs.py
  - test_spec.py
- download_swe_repo.py
- local_search.py
- modal_sandbox.py
- repo_env.py
- repo_server.py
- search_server.py
- swe_modal_env.py
- download_repo.py
- eval_bc.py
- eval_swe.py
- train_bc_qwen3_8b.sh
- train_fold.py
- - __init__.py
- - __init__.py
  - base.py
  - gsm8k_interaction.py
  - weather_interaction.py
- - __init__.py
  - __main__.py
  - base_model_merger.py
  - fsdp_model_merger.py
  - megatron_model_merger.py
- - __init__.py
  - README.md
  - registry.py
  - weight_loader_registry.py
- - __init__.py
- - __init__.py
- - __init__.py
  - base_tool.py
  - geo3k_tool.py
  - gsm8k_tool.py
  - image_zoom_in_tool.py
  - mcp_base_tool.py
  - mcp_search_tool.py
  - sandbox_fusion_tools.py
  - schemas.py
  - search_tool.py
- - __init__.py
  - constants_ppo.py
  - fsdp_sft_trainer.py
  - main_eval.py
  - main_generation.py
  - main_generation_server.py
  - main_ppo.py
  - runtime_env.yaml
  - sft_trainer.py
  - sft_trainer_ray.py
- - __init__.py
  - activation_offload.py
  - attention_utils.py
  - chat_template.py
  - config.py
  - device.py
  - distributed.py
  - flops_counter.py
  - fs.py
  - fsdp_utils.py
  - groupwise.py
  - hdfs_io.py
  - import_utils.py
  - logging_utils.py
  - megatron_peft_utils.py
  - megatron_utils.py
  - memory_buffer.py
  - memory_utils.py
  - model.py
  - net_utils.py
  - npu_flash_attn_utils.py
  - py_functional.py
  - ray_utils.py
  - rollout_skip.py
  - rollout_trace.py
  - seqlen_balancing.py
  - tensordict_utils.py
  - tokenizer.py
  - torch_dtypes.py
  - torch_functional.py
  - tracking.py
  - transferqueue_utils.py
  - transformers_compat.py
  - ulysses.py
- - version
- - __init__.py
  - engine_workers.py
  - fsdp_workers.py
  - megatron_workers.py
- __init__.py
- base_config.py
- protocol.py
- py.typed
.gitmodules
LICENSE
README.md
requirements.txt

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Scaling Long-Horizon LLM Agent via Context-Folding

Paper: https://arxiv.org/pdf/2510.11967

<img width="4239" height="4110" alt="cover" src="https://github.com/user-attachments/assets/9c9c0b67-ccd8-4a4b-859b-22f613f41954" />

---

## Training

Note: This is an open-source re-implementation based on `agent_loop` in verl. This may differ from the code we used to train the model in our paper.

**Key Files**
```
FoldAgent/
├── verl/
│   ├── experimental/
│   │   └── agent_loop/            # Base agent loop implementations
│   └── trainer/
│       └── ppo/                   # PPO training with FoldGRPO algorithm
├── agents/
│   └── fold_agent.py              # Core agent logic (process_item)
├── envs/
│   └── local_search.py            # Local search environment
└── scripts/
    └── train_fold.py              # Training script
```

**1. Start Search Server**

Start the search server on a separate machine. This will download the corpus (`Tevatron/browsecomp-plus-corpus`), pre-computed embeddings (`miaolu3/browsecomp-plus`), and load the Qwen3-Embedding-8B model on available GPUs.

```bash
cd envs && python search_server.py \
  --model Qwen/Qwen3-Embedding-8B \
  --corpus Tevatron/browsecomp-plus-corpus \
  --corpus-embedding-dataset miaolu3/browsecomp-plus \
  --host 0.0.0.0 \
  --port 8000
```

Set environment variables:

```bash
# URL of the local search server (for BrowseComp-Plus)
export LOCAL_SEARCH_URL="http://[IP-of-search-server]:8000"

# For LLM-based answer grading
export OPENAI_API_KEY="your-api-key"
```

**2. Download Training Data**

Download and decompress the BrowseComp dataset: https://drive.google.com/file/d/1aX5xXAN5R-gLKd8A0AY-troxXJRawyAM/view?usp=sharing

**3. Train on BrowseComp**

Example script to train Qwen3-8B:
```bash
bash scripts/train_bc_qwen3_8b.sh
```

---

## Evaluation

**1. Start Search Server**

```bash
cd envs && python search_server.py \
  --model Qwen/Qwen3-Embedding-8B \
  --corpus Tevatron/browsecomp-plus-corpus \
  --corpus-embedding-dataset miaolu3/browsecomp-plus \
  --host 0.0.0.0 \
  --port 8000
```

**2. Evaluate on BrowseComp**

- Download and decompress data: https://drive.google.com/file/d/1aX5xXAN5R-gLKd8A0AY-troxXJRawyAM/view?usp=sharing

- **Fold Agent:** `workflow=search_branch`
```bash
export OPENAI_API_KEY='your-key'

python scripts/eval_bc.py \
  --data_path data/bc_test.parquet \
  --model_name gpt-5-nano \
  --num_workers 150 \
  --workflow search_branch \
  --prompt_length 16384 \
  --response_length 32768 \
  --max_turn 200 \
  --val_max_turn 200 \
  --max_session 10 \
  --val_max_session 10 \
  --local_search_url http://localhost:8000 \
  --output_dir results
```
Output:
```
Evaluating: 100%|█████████████| 150/150 [32:52<00:00, 13.15s/item, avg_score=0.407, id=122]

============================================================
Overall - Avg Score: 0.4067, Success: 150/150

By Data Source:
  bc_test_easy: 0.8200 (50 items)
  bc_test_hard: 0.0400 (50 items)
  bc_test_medium: 0.3600 (50 items)
```

- **ReAct Agent:**  `workflow=search`
```bash
python scripts/eval_bc.py --workflow search [...]
```

- **Summary Agent:** `workflow=search, enable_summary`
```bash
python scripts/eval_bc.py --workflow search --enable_summary [...]
```

**3. Using Local LLMs (e.g., vLLM)**

```bash
# Start vLLM server
vllm serve ByteDance-Seed/Seed-OSS-36B-Instruct --port 8001 --max-model-len 131072

# Run evaluation
export OPENAI_API_KEY='dummy'
export OPENAI_BASE_URL='http://localhost:8001/v1'

python scripts/eval_bc.py \
  --model_name ByteDance-Seed/Seed-OSS-36B-Instruct \
  --workflow search_branch \
  --num_workers 32 \
  --prompt_length 16384 \
  --response_length 32768 \
  --max_turn 200 \
  --val_max_turn 200 \
  --max_session 10 \
  --val_max_session 10 \
  --output_dir results
```

### Evaluation on SWE-Bench Verified

Each instance runs in a [Modal](https://modal.com) sandbox built from the prebuilt `swebench/sweb.eval.x86_64.<instance>:latest` image.

**1. Setup**

```bash
pip install modal datasets
modal token new
export OPENAI_API_KEY='your-key'
```

**2. Evaluate on SWE-Bench Verified**

```bash
python scripts/eval_swe.py \
  --dataset princeton-nlp/SWE-bench_Verified \
  --split test \
  --model_name gpt-5.4-mini \
  --num_workers 32 \
  --workflow code \
  --max_turn 200 \
  --val_max_turn 200 \
  --max_session 10 \
  --val_max_session 10 \
  --output_dir results
```

Add `--instance_ids id1,id2` or `--limit N` for a subset.

---

## Cite

```
@article{sun2025scaling,
  title   = {Scaling Long-Horizon LLM Agent via Context-Folding},
  author  = {Sun, Weiwei and Lu, Miao and Ling, Zhan and Liu, Kang and Yao, Xuesong and Yang, Yiming and Chen, Jiecao},
  journal = {arXiv preprint arXiv:2510.11967},
  year    = {2025},
}
```

---

## Acknowledgements

This implementation is based on [verl](https://github.com/volcengine/verl).