LLM inference in C/C++

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

The trust-minimized, zero-knowledge bridging protocol, designed for censorship resistance,

Next generation frontend tooling. It's fast!

The HTML Presentation Framework

CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust