ComAct

KO | EN

gitlite — search

#javascript #python #ai #typescript #go #golang #android #rust #linux #docker #nodejs #cli #awesome-list #ios

(★ 13)

Official Implementation of "ComAct: Reframing Professional Software Manipulation via COM-as-Action Paradigm".

ComAct 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# ComAct: Reframing Professional Software Manipulation through COM-as-Action Paradigm
</div>
<p align="center">
    <a href="https://arxiv.org/abs/2606.13239" target="_blank">
        <img alt="arXiv" src="https://img.shields.io/badge/arXiv-2606.13239-b31b1b.svg?style=for-the-badge">
    </a>
    <a href="https://KnowledgeXLab.github.io/ComAct" target="_blank">
        <img alt="Project Page" src="https://img.shields.io/badge/%F0%9F%8C%90%20Project-Page-orange?style=for-the-badge">
    </a>
    <a href="LICENSE" target="_blank">
        <img alt="License" src="https://img.shields.io/github/license/KnowledgeXLab/ComAct?style=for-the-badge&color=blue">
    </a>
    <a href="https://huggingface.co/KnowledgeXLab/ComActor-9B" target="_blank">
        <img alt="Hugging Face Model" src="https://img.shields.io/badge/%F0%9F%A4%97%20Model-ComActor--9B-blue?style=for-the-badge">
    </a>
    <a href="https://huggingface.co/datasets/KnowledgeXLab/ComCAD_Bench" target="_blank">
        <img alt="Hugging Face Benchmark" src="https://img.shields.io/badge/%F0%9F%A4%97%20Benchmark-ComCADBench-green?style=for-the-badge">
    </a>
    <a href="https://huggingface.co/datasets/KnowledgeXLab/ComCAD_Datasets" target="_blank">
        <img alt="Hugging Face Dataset" src="https://img.shields.io/badge/%F0%9F%A4%97%20Dataset-ComCAD--30k-green?style=for-the-badge">
    </a>
</p>

The official implementation of **ComAct: Reframing Professional Software Manipulation via COM-as-Action Paradigm**. 
We identify the Component Object Model (COM) as a unified executable action space across professional software, reframing GUI-fragile, API-fragmented automation as deterministic program synthesis.
See the [project page](https://KnowledgeXLab.github.io/ComAct) for demos and full results.

## 📰 Updates
- **`2026-06-20`**: 🎉 Paper and project page are publicly available.

## 🎯 Getting Started

> 🚧 Coming soon: a detailed guide for preparing dataset, setting up VM environment and running agent training & evaluation end-to-end.

Here's a quick orientation:

| Component       | Description | Link                                                                               |
|-----------------|---|------------------------------------------------------------------------------------|
| **Benchmark**   | 1,000 tasks across SolidWorks, Inventor, AutoCAD; 7 engineering activities | [🤗 ComCADBench](https://huggingface.co/datasets/KnowledgeXLab/ComAct/ComCADBench) |
| **Environment** | Parallel Dockerized Windows VMs for training & evaluation | [`comforge/`](comforge/)                                                           |
| **Agent**       | 9B self-correcting agent via 3-stage training: text-to-code SFT → agentic SFT → GRPO | [🤗 ComActor](https://huggingface.co/KnowledgeXLab/ComAct/ComActor-9B)             |

## 🎓 Acknowledgements
We acknowledge the outstanding open-source contributions from [Qwen3.5](https://qwenlm.github.io/blog/qwen3.5/), [ms-swift](https://github.com/modelscope/ms-swift), [Text2CAD](https://github.com/SadilKhan/Text2CAD), [Fusion 360 Gallery](https://github.com/AutodeskAILab/Fusion360GalleryDataset), and [SketchGraphs](https://github.com/PrincetonLIPS/SketchGraphs).

## 📬 Contact
For any questions or feedback, please:
- Open an issue in the GitHub repository
- Reach out to us at julyai@whu.edu.cn

## 📜 Citation
If you find our paper and code useful, please kindly cite us.
```bibtex
@misc{ai2026comactreframingprofessionalsoftware,
      title={ComAct: Reframing Professional Software Manipulation via COM-as-Action Paradigm},
      author={Jiaxin Ai and Tao Hu and Xuemeng Yang and Shu Zou and Hairong Zhang and Daocheng Fu and Yu Yang and Hongbin Zhou and Nianchen Deng and Pinlong Cai and Zhongyuan Wang and Botian Shi and Kaipeng Zhang and Licheng Wen},
      year={2026},
      eprint={2606.13239},
      archivePrefix={arXiv},
      primaryClass={cs.SE},
      url={https://arxiv.org/abs/2606.13239},
}
```

ComAct

ComAct 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

ComAct

ComAct 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README