llmio
Unified LLM gateway with weighted load balancing, observability & cost tracking. 统一的 LLM 网关，提供权重负载均衡、可观测性与费用追踪。
File Explorer
Download Latest Version (.zip)- cicd.yml
- releaser.yml
- balancers.go
- balancers_test.go
- breaker.go
- breaker.md
- breaker_test.go
- pagination.go
- response.go
- consts.go
- context_key.go
- log.go
- system.go
- version.go
- chat-io.png
- home.jpeg
- image.png
- llmio.excalidraw
- llmio.svg
- log.jpeg
- with.jpeg
- api.go
- auth_keys.go
- chat.go
- count_tokens.go
- event_logging.go
- home.go
- models.go
- test.go
- version.go
- auth.go
- auth_test.go
- cors.go
- config.go
- init.go
- init_test.go
- log_cleanup.go
- model.go
- env.go
- token.go
- anthropic.go
- cache.go
- gemini.go
- openai.go
- openai_res.go
- provider.go
- auth.go
- before.go
- chat.go
- chat_test.go
- log_cleanup.go
- log_cleanup_test.go
- models.go
- process.go
- provider_error_matcher.go
- provider_error_matcher_test.go
- logo-dark.svg
- logo-light.svg
- logo.svg
- react.svg
- bar-chart.tsx
- pie-chart.tsx
- project-bar-chart.tsx
- project-pie-chart.tsx
- alert-dialog.tsx
- badge.tsx
- button.tsx
- calendar.tsx
- card.tsx
- chart.tsx
- checkbox.tsx
- dialog.tsx
- form.tsx
- input.tsx
- label.tsx
- popover.tsx
- radio-group.tsx
- select.tsx
- sonner.tsx
- spinner.tsx
- switch.tsx
- table.tsx
- textarea.tsx
- tooltip.tsx
- loading.tsx
- theme-provider.tsx
- auth-keys.json
- common.json
- config.json
- home.json
- layout.json
- login.json
- logs.json
- models.json
- providers.json
- quickstart.json
- auth-keys.json
- common.json
- config.json
- home.json
- layout.json
- login.json
- logs.json
- models.json
- providers.json
- quickstart.json
- auth-keys.json
- common.json
- config.json
- home.json
- layout.json
- login.json
- logs.json
- models.json
- providers.json
- quickstart.json
- index.ts
- api.ts
- utils.ts
- model-provider-form-dialog.tsx
- model-provider-test-dialog.tsx
- use-model-provider-form.ts
- use-model-provider-testing.ts
- provider-form-dialog.tsx
- provider-form-utils.ts
- provider-models-dialog.tsx
- use-provider-form.ts
- auth-keys.tsx
- config.tsx
- home.tsx
- layout.tsx
- log-chat.tsx
- login.tsx
- logs.tsx
- model-providers.tsx
- models.tsx
- providers.tsx
- quickstart.tsx
- App.css
- App.tsx
- index.css
- main.tsx
- vite-env.d.ts
- .gitignore
- components.json
- eslint.config.js
- index.html
- package.json
- pnpm-lock.yaml
- pnpm-workspace.yaml
- README.md
- tailwind.config.ts
- tsconfig.app.json
- tsconfig.json
- tsconfig.node.json
- vite.config.ts
- .dockerignore
- .gitignore
- .goreleaser.yml
- AGENTS.md
- CLAUDE.md
- docker-compose.yml
- Dockerfile
- go.mod
- go.sum
- LICENSE
- main.go
- makefile
- README.md
- README_cn.md
# Installation Guide
git clone https://github.com/atopos31/llmio
Downloads the entire project code from GitHub to your computer.
cd llmio
Moves into the project folder you just downloaded.
2. Docker
Easy Recommended- Git Needed to download the project code from GitHub.
- Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker compose up -d
Builds and starts all defined containers (server, database, etc.) at once, in the background.
docker run -d \
Runs the built image as an actual container.
Pulled directly from this repo's README.
3. Node.js
Easycd webui
This project's files live in a subfolder, so move into it first.
npm install
Downloads and installs the libraries listed in package.json.
npm start
Starts the development/run server.
4. Go
Mediumgo build ./...
Compiles the Go program into an executable.
go run .
Runs the Go program directly without a separate build step.
5. Make
Medium- Git Needed to download the project code from GitHub.
- Make Usually pre-installed on Linux/macOS. On Windows, install separately (e.g. via MSYS2 or WSL).
make webui
Compiles the code based on the generated build configuration to produce an executable.
Pulled directly from this repo's README.