aiproxy

(★ 530)

AI Proxy is a high performance AI gateway using OpenAI / Claude / Gemini protocol as the entry point. It features intelligent error handling, multi-channel management, and comprehensive monitoring. With support for multiple models, rate limiting, and multi-tenant isolation.

File Explorer

Download Latest Version (.zip)

- - install.sh
- - check-semgrep.yml
  - ci.yml
  - release.yml
- dependabot.yml
- - body.go
  - body_test.go
  - color.go
  - constants.go
  - database.go
  - errors.go
  - errors_test.go
  - gin.go
  - gin_test.go
  - keyed_lock.go
  - keyed_lock_test.go
  - log.go
  - redis.go
  - trunc.go
  - trunc_test.go
  - utils.go
  - utils_test.go
- - channel-billing.go
  - channel-test.go
  - channel.go
  - channel_test.go
  - consumption_ranking.go
  - dashboard.go
  - group.go
  - import.go
  - log.go
  - log_export.go
  - log_export_test.go
  - log_test.go
  - misc.go
  - model.go
  - modelconfig.go
  - monitor.go
  - monitor_test.go
  - option.go
  - relay-channel.go
  - relay-channel_test.go
  - relay-controller.go
  - relay-controller_test.go
  - relay-dashboard.go
  - relay-model.go
  - relay.go
  - token.go
- - install.sh
  - Kubefile
- - docs.go
  - swagger.json
  - swagger.yaml
- - session.go
  - sse.go
  - stateless-streamable.go
  - streamable.go
- - auth.go
  - cors.go
  - ctxkey.go
  - distributor.go
  - distributor_fields_test.go
  - distributor_gemini_video_test.go
  - distributor_log_fields_test.go
  - distributor_prompt_cache_test.go
  - distributor_provider_video_test.go
  - distributor_service_tier_test.go
  - distributor_test.go
  - distributor_user_test.go
  - distributor_video_test.go
  - ipblack.go
  - log.go
  - mcp.go
  - recover.go
  - reqid.go
  - utils.go
- - async_usage.go
  - async_usage_postgres_integration_test.go
  - batch.go
  - cache.go
  - cache_l1_lock_test.go
  - channel.go
  - channeltest.go
  - chtype.go
  - configkey.go
  - consumeerr.go
  - consumption_ranking.go
  - export_test.go
  - group.go
  - group_cache.go
  - groupmcp.go
  - groupmodel.go
  - groupsummary-minute.go
  - groupsummary.go
  - local_cache.go
  - log.go
  - log_test.go
  - main.go
  - mcp_cache.go
  - mcp_cache_redis.go
  - mcp_cache_redis_test.go
  - model_caches.go
  - modelconfig.go
  - modelconfig_test.go
  - option.go
  - owner.go
  - publicmcp.go
  - retrylog.go
  - store.go
  - store_cache.go
  - store_cache_redis_test.go
  - store_postgres_integration_test.go
  - store_test.go
  - summary-minute.go
  - summary.go
  - summary_test.go
  - token.go
  - token_cache.go
  - usage.go
  - usage_alert.go
  - usage_daily_time_test.go
  - usage_test.go
  - utils.go
  - utils_test.go
  - yaml_integration.go
- - local_cache.go
  - local_cache_test.go
  - memmodel.go
  - memmodel_test.go
  - model.go
  - model_integration_test.go
- - public.go
- - api.go
  - main.go
  - mcp.go
  - relay.go
  - relay_test.go
  - static.go
  - static_test.go
  - swagger.go
- - swag.sh
- - async_usage_test.go
  - task.go
- .gitignore
- go.mod
- go.sum
- main.go
- startup.go
- - dashboard.png
  - logs.png
- REASONING_COMPATIBILITY.md
- REASONING_COMPATIBILITY.zh.md
- - hosted.go
  - local.go
- go.mod
- go.sum
- mcp.go
- README.md
- register.go
- server.go
- tools.go
- - convert.go
  - parser.go
- go.mod
- go.sum
- main.go
- README.md
- golangci-lint-fix.sh
- update-go-mod.sh
- - logo.svg
- - App.tsx
  - i18n.ts
  - index.css
  - main.tsx
  - vite-env.d.ts
- .env.template
- .gitignore
- components.json
- context.md
- eslint.config.js
- index.html
- openapi.txt
- package-lock.json
- package.json
- pnpm-lock.yaml
- prompt.txt
- README.md
- tailwind.config.js
- tsconfig.app.json
- tsconfig.json
- tsconfig.node.json
- vite.config.ts
.gitignore
.golangci.yml
config.example.yaml
config.md
docker-compose.yaml
Dockerfile
go.work
go.work.sum
LICENSE
README.md
README.zh.md

# Installation Guide

1. Get the code

git clone https://github.com/labring/aiproxy

Downloads the entire project code from GitHub to your computer.

cd aiproxy

Moves into the project folder you just downloaded.

2. Docker

Easy Recommended

Prerequisites

Git Needed to download the project code from GitHub.
Docker Desktop Needed to build and run containers. Install it and keep it running in the background.

docker run -d \

Runs the built image as an actual container.

curl -O https://raw.githubusercontent.com/labring/aiproxy/main/docker-compose.yaml

Runs the command against the services defined in the compose file.

docker-compose up -d

Runs the command against the services defined in the compose file.

✅ Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.

Pulled directly from this repo's README.

3. Node.js

Easy

Prerequisites

Git Needed to download the project code from GitHub.
Node.js Node.js must be installed to use npm. The LTS version is recommended.

cd web && npm install -g pnpm && pnpm install && pnpm run build && cp -r dist ../core/public/dist/ && cd ..

Moves into the project folder you just downloaded.

✅ After running the command, open the address shown in the terminal (usually something like http://localhost:3000) in your browser.

Pulled directly from this repo's README.

4. Go

Medium

Prerequisites

Git Needed to download the project code from GitHub.
Go The Go compiler and toolchain.

cd core && go build -o aiproxy .

Moves into the project folder you just downloaded.

✅ If the build finishes without errors, it worked. If you used go run ., check the terminal output.

Pulled directly from this repo's README.

aiproxy

File Explorer

# Installation Guide

2. Docker

3. Node.js

4. Go

Today's picks

Was this content helpful?

Recent Feedback

aiproxy

File Explorer

# Installation Guide

2. Docker

3. Node.js

4. Go

Today's picks

Was this content helpful?

Recent Feedback

Download README