efficient_bpe

(★ 13)

An Efficent BPE Algorithm Faster then Hugging Face Tokenizer's Implementation

efficient_bpe Latest Version Download

Download Latest Version (.zip)

Today's picks

odysseus ★ 85,470

Self-hosted AI workspace.

Python
tauri ★ 110,269

Build smaller, faster, and more secure desktop and mobile applications with a web frontend

Rust
awesome-cpp ★ 72,786

A curated list of awesome C++ (or C) frameworks, libraries, resources, and shiny things. I
grafana ★ 76,299

The open and composable observability and data visualization platform. Visualize metrics,

TypeScript
andrej-karpathy-skills ★ 203,052

A single CLAUDE.md file to improve Claude Code behavior, derived from Andrej Karpathy's ob
Microsoft-Activation-Scripts ★ 187,210

Open-source Windows and Office activator featuring HWID, Ohook, TSforge, and Online KMS ac

Batchfile
// repository documentation