plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
File Explorer
Download Latest Version (.zip)- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- ci.yml
- docker-push-main.yml
- docker-push-release.yml
- publish-binaries.yml
- publish-pypi.yml
- static.yml
- update-providers.yml
- clubcentric.svg
- hp.svg
- huggingface.svg
- sandisk.svg
- tmobile.svg
- KatanemoLogo.svg
- globals.css
- layout.tsx
- page.tsx
- LogoSlider.tsx
- metadata.ts
- .gitignore
- biome.json
- next.config.ts
- package.json
- postcss.config.mjs
- tsconfig.json
- IBMPlexSans-Italic-VariableFont_wdth,wght.ttf
- IBMPlexSans-VariableFont_wdth,wght.otf
- IBMPlexSans-VariableFont_wdth,wght.ttf
- jetbrains-mono-bold.otf
- jetbrains-mono-bold.woff2
- JetBrainsMono-Medium.otf
- JetBrainsMono-Medium.woff2
- JetBrainsMono-Regular.otf
- JetBrainsMono-Regular.woff2
- chase.svg
- clubcentric.svg
- hp.svg
- huggingface.svg
- sandisk.svg
- tmobile.svg
- Benchmarks.svg
- BuildWithChoice.svg
- BuiltOnEnvoy.svg
- Contextual.svg
- file.svg
- globe.svg
- HowItWorks.svg
- IntroDiagram.svg
- Introduction.svg
- LaunchFaster.svg
- Logomark.png
- Logomark.svg
- LogoMarkSquare.svg
- LogoOutline.svg
- NetworkPathDiagram.svg
- next.svg
- OpenSource.svg
- plano.svg
- Plano30B-Logo.svg
- Plano4B-Logo.svg
- PlanoIcon.svg
- PromptRouting.svg
- PurposeBuilt.svg
- ShipConfidently.svg
- Telemetry.svg
- Timeline.svg
- vercel.svg
- window.svg
- blogType.ts
- index.ts
- route.ts
- route.tsx
- layout.tsx
- not-found.tsx
- page.tsx
- page.tsx
- ContactPageClient.tsx
- page.tsx
- page.tsx
- ResearchPageClient.tsx
- page.tsx
- layout.tsx
- favicon.ico
- globals.css
- layout.tsx
- page.tsx
- robots.ts
- sitemap.ts
- index.ts
- ResearchBenchmarks.tsx
- ResearchCapabilities.tsx
- ResearchCTA.tsx
- ResearchFamily.tsx
- ResearchGrid.tsx
- ResearchHero.tsx
- ResearchTimeline.tsx
- AsciiDiagram.tsx
- BlogCard.tsx
- BlogHeader.tsx
- BlogSectionHeader.tsx
- ConditionalLayout.tsx
- DiagramBuilder.tsx
- FeaturedBlogCard.tsx
- Hero.tsx
- HowItWorksSection.tsx
- IdeaToAgentSection.tsx
- IntroSection.tsx
- LogoCloud.tsx
- NetworkAnimation.tsx
- PortableText.tsx
- UnlockPotentialSection.tsx
- UseCasesSection.tsx
- VerticalCarouselSection.tsx
- diagrams-programmatic.ts
- diagrams.ts
- diagramTemplates.ts
- metadata.ts
- sanity.ts
- asciiBuilder.ts
- .gitignore
- biome.json
- components.json
- next.config.ts
- package-lock.json
- package.json
- postcss.config.mjs
- README.md
- sanity.config.ts
- tsconfig.json
- .gitignore
- __init__.py
- collector.py
- pricing.py
- render.py
- coding_agent_routing.yaml
- conversational_state_v1_responses.yaml
- filter_chain_guardrails.yaml
- preference_aware_routing.yaml
- sub_agent_orchestration.yaml
- template_sync_map.yaml
- __init__.py
- chatgpt_auth.py
- chatgpt_cmd.py
- config_generator.py
- consts.py
- core.py
- defaults.py
- docker_cli.py
- init_cmd.py
- main.py
- native_binaries.py
- native_runner.py
- obs_cmd.py
- rich_click_config.py
- template_sync.py
- trace_cmd.py
- trace_listener_runtime.py
- utils.py
- versioning.py
- failure.json
- success.json
- __init__.py
- test_config_generator.py
- test_defaults.py
- test_init.py
- test_obs_collector.py
- test_obs_pricing.py
- test_obs_render.py
- test_trace_cmd.py
- test_version_check.py
- build_cli.sh
- pyproject.toml
- README.md
- uv.lock
- brightstaff.yaml
- prometheus.yaml
- brightstaff_dashboard.json
- docker-compose.yaml
- prometheus_scrape.yaml
- docker-compose.dev.yaml
- env.list
- envoy.template.yaml
- plano_config_schema.yaml
- README.md
- requirements.txt
- supervisord.conf
- test_passthrough.yaml
- validate_plano_config.sh
- launch.json
- tasks.json
- signals_replay.rs
- errors.rs
- jsonrpc.rs
- mod.rs
- orchestrator.rs
- pipeline.rs
- selector.rs
- mod.rs
- model_selection.rs
- prompt_caching.rs
- session_router.rs
- debug.rs
- function_calling.rs
- integration_tests.rs
- mod.rs
- models.rs
- response.rs
- routing_budget_request.rs
- routing_service.rs
- labels.rs
- mod.rs
- http.rs
- mod.rs
- model_metrics.rs
- orchestrator.rs
- orchestrator_model.rs
- orchestrator_model_v1.rs
- stress_tests.rs
- memory.rs
- mod.rs
- redis.rs
- exhaustion.rs
- mod.rs
- failure.rs
- loops.rs
- mod.rs
- constants.rs
- disengagement.rs
- misalignment.rs
- mod.rs
- satisfaction.rs
- stagnation.rs
- analyzer.rs
- mod.rs
- otel.rs
- schemas.rs
- text_processing.rs
- memory.rs
- mod.rs
- postgresql.rs
- response_state_processor.rs
- constants.rs
- custom_attributes.rs
- init.rs
- mod.rs
- posthog_exporter.rs
- service_name_exporter.rs
- affinity.rs
- app_state.rs
- lib.rs
- main.rs
- streaming.rs
- Cargo.toml
- hallucination.rs
- mod.rs
- open_ai.rs
- prompt_guard.rs
- zero_shot.rs
- constants.rs
- mod.rs
- resource_span_builder.rs
- shapes.rs
- span_builder.rs
- configuration.rs
- consts.rs
- errors.rs
- http.rs
- lib.rs
- llm_providers.rs
- path.rs
- pii.rs
- ratelimit.rs
- routing.rs
- stats.rs
- tokenizer.rs
- tracing.rs
- utils.rs
- Cargo.lock
- Cargo.toml
- amazon_bedrock_binary_frame.rs
- anthropic_streaming_buffer.rs
- chat_completions_streaming_buffer.rs
- mod.rs
- passthrough_streaming_buffer.rs
- responses_api_streaming_buffer.rs
- sse.rs
- sse_chunk_processor.rs
- amazon_bedrock.rs
- anthropic.rs
- mod.rs
- openai.rs
- openai_responses.rs
- fetch_models.rs
- provider_models.yaml
- run.sh
- endpoints.rs
- lib.rs
- mod.rs
- id.rs
- mod.rs
- request.rs
- response.rs
- streaming_response.rs
- from_anthropic.rs
- from_bedrock.rs
- from_openai.rs
- mod.rs
- mod.rs
- output_to_input.rs
- to_anthropic.rs
- to_openai.rs
- mod.rs
- to_anthropic_streaming.rs
- to_openai_streaming.rs
- lib.rs
- mod.rs
- lib.rs
- mod.rs
- Cargo.toml
- README.md
- filter_context.rs
- lib.rs
- metrics.rs
- stream_context.rs
- Cargo.toml
- context.rs
- filter_context.rs
- http_context.rs
- lib.rs
- metrics.rs
- stream_context.rs
- tools.rs
- Cargo.toml
- build.sh
- Cargo.lock
- Cargo.toml
- simple.hurl
- simple_stream.hurl
- config.yaml
- docker-compose.yaml
- README.md
- run_demo.sh
- test_data.yaml
- bench.py
- evals_summarize.yaml
- plano_config_with_aliases.yaml
- pyproject.toml
- README.md
- run_demo.sh
- uv.lock
- config.yaml
- docker-compose.yaml
- Dockerfile
- main.py
- mutli-turn-example.png
- pyproject.toml
- README.md
- requirements.txt
- run_demo.sh
- start_agents.sh
- config.yaml
- docker-compose.yaml
- README.md
- run_demo.sh
- stock_quote_demo.png
- flight_agent.py
- weather_agent.py
- config.yaml
- docker-compose.yaml
- Dockerfile
- openai_protocol.py
- pyproject.toml
- README.md
- run_demo.sh
- start_agents.sh
- traces.png
- uv.lock
- flight_agent.py
- weather_agent.py
- config.yaml
- config_local_orchestrator.yaml
- docker-compose.yaml
- Dockerfile
- pyproject.toml
- README.md
- run_demo.sh
- start_agents.sh
- test.rest
- tracing.png
- travel_agent_request.rest
- uv.lock
- __init__.py
- __main__.py
- api.py
- context_builder.py
- input_guards.py
- query_rewriter.py
- rag_agent.py
- sample_knowledge_base.csv
- config.yaml
- docker-compose.yaml
- Dockerfile
- http.rest
- mcp_query.rest
- pyproject.toml
- README.md
- run_demo.sh
- sample_queries.md
- start_agents.sh
- test.rest
- uv.lock
- __init__.py
- __main__.py
- api.py
- context_builder.py
- input_guards.py
- query_rewriter.py
- rag_agent.py
- sample_knowledge_base.csv
- config.yaml
- docker-compose.yaml
- Dockerfile
- mcp_query.rest
- pyproject.toml
- README.md
- run_demo.sh
- sample_queries.md
- start_agents.sh
- test.rest
- uv.lock
- config.openai.yaml
- config.yaml
- content_guard.py
- docker-compose.openai.yaml
- docker-compose.yaml
- Dockerfile
- fake_provider.py
- output_filter.py
- README.md
- test.sh
- test_services.py
- config.yaml
- docker-compose.yaml
- pii.py
- pii_anonymizer.py
- pyproject.toml
- README.md
- run_demo.sh
- start_agents.sh
- store.py
- test.sh
- uv.lock
- config.yaml
- docker-compose.yaml
- jaeger_tracing_llm_routing.png
- llm_routing_demo.png
- README.md
- run_demo.sh
- simple.hurl
- simple_stream.hurl
- config.yaml
- docker-compose.yaml
- Dockerfile
- main.py
- pyproject.toml
- README.md
- run_demo.sh
- start_agents.sh
- uv.lock
- config.yaml
- docker-compose.yaml
- README.md
- run_demo.sh
- config.yaml
- docker-compose.yaml
- README.md
- run_demo.sh
- spotify_bearer_auth.png
- chat.py
- config.yaml
- README.md
- test_chatgpt.sh
- claude_code.png
- config.yaml
- model_selection.png
- pretty_model_resolution.sh
- README.md
- config.yaml
- pretty_model_resolution.sh
- README.md
- config_with_aliases.yaml
- README.md
- run_demo.sh
- config.yaml
- config_k8s.yaml
- demo.sh
- docker-compose.yaml
- metrics_server.py
- plano-deployment.yaml
- prometheus.yaml
- README.md
- test.rest
- vllm-deployment.yaml
- config.yaml
- openclaw_plano.png
- README.md
- simple.hurl
- simple_stream.hurl
- config.yaml
- docker-compose.yaml
- plano_config_local.yaml
- README.md
- run_demo.sh
- test_router_endpoint.rest
- config.yaml
- demo.sh
- GUIDE.md
- README.md
- Dockerfile
- common.py
- pyproject.toml
- README.md
- run_demo_tests.sh
- test_demos.py
- uv.lock
- README.md
- llms_txt.py
- provider_models.py
- custom.css
- arch_router_paper_preview.png
- claude_code_router.png
- cli-default-command.png
- cli-init-command.png
- cli-trace-command.png
- demo_tracing.png
- input-token-metrics.png
- llm-request-metrics.png
- network-topology-ingress-egress.png
- output-token-metrics.png
- plano-system-architecture.png
- plano_network_diagram_high_level.png
- PlanoTagline.svg
- signals_trace.png
- tracing.png
- fix-copy.js
- favicon.ico
- analytics.html
- function-calling-agent.yaml
- function-calling-flow.jpg
- parameter_handling.py
- multi_turn_rag.py
- mutli-turn-example.png
- prompt_targets_multi_turn.yaml
- parameter_handling.py
- prompt_targets.yaml
- plano_config.yaml
- client_libraries.rst
- llm_providers.rst
- model_aliases.rst
- supported_providers.rst
- agents.rst
- filter_chain.rst
- listeners.rst
- prompt_target.rst
- signals.rst
- intro_to_plano.rst
- overview.rst
- quickstart.rst
- config.yaml
- access_logging.rst
- monitoring.rst
- observability.rst
- tracing.rst
- function_calling.rst
- llm_router.rst
- orchestration.rst
- prompt_guard.rst
- state.rst
- conversation_states.sql
- README.md
- agents_config.yaml
- flights.py
- weather.py
- plano_config_agents_filters.yaml
- plano_config_full_reference.yaml
- plano_config_full_reference_rendered.yaml
- plano_config_state_storage_example.yaml
- model_serving.rst
- request_lifecycle.rst
- tech_overview.rst
- threading_model.rst
- cli_reference.rst
- configuration_reference.rst
- deployment.rst
- llms_txt.rst
- conf.py
- docutils.conf
- index.rst
- build_docs.sh
- CNAME
- Dockerfile
- Makefile
- README.md
- requirements.txt
- routing-api.md
- globals.css
- package.json
- package.json
- tailwind.config.ts
- base.json
- nextjs.json
- package.json
- button.tsx
- dialog.tsx
- Footer.tsx
- Logo.tsx
- Navbar.tsx
- utils.ts
- index.ts
- package.json
- tsconfig.json
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- _sections.md
- _template.md
- advanced-multi-listener.md
- advanced-prompt-targets.md
- agent-descriptions.md
- agent-orchestration.md
- cli-agent.md
- cli-init.md
- cli-startup.md
- config-listeners.md
- config-providers.md
- config-secrets.md
- config-version.md
- deploy-docker.md
- deploy-health.md
- deploy-state.md
- filter-guardrails.md
- filter-mcp.md
- filter-ordering.md
- observe-span-attributes.md
- observe-trace-query.md
- observe-tracing.md
- routing-aliases.md
- routing-default.md
- routing-passthrough.md
- routing-preferences.md
- build.ts
- extract-tests.ts
- validate.ts
- AGENTS.md
- metadata.json
- package-lock.json
- package.json
- README.md
- test-cases.json
- tsconfig.json
- launch.json
- settings.json
- common.py
- common.sh
- config.yaml
- docker-compose.yaml
- pyproject.toml
- test_llm_gateway.py
- test_prompt_gateway.py
- uv.lock
- launch.json
- settings.json
- common.py
- common_scripts.sh
- config_memory_state_v1_responses.yaml
- config_native_smoke.yaml
- docker-compose.yaml
- pyproject.toml
- README.md
- response.hex
- response_with_tools.hex
- run_e2e_tests.sh
- run_model_alias_tests.sh
- run_prompt_gateway_tests.sh
- run_responses_state_tests.sh
- test_model_alias_routing.py
- test_openai_responses_api_client.py
- test_openai_responses_api_client_with_state.py
- test_prompt_gateway.py
- uv.lock
- llm_gateway_model_default_llm.hurl
- llm_gateway_model_explicit_model.hurl
- llm_gateway_model_hint.hurl
- arch_fc.hurl
- .gitignore
- _smoke_test.py
- compare.py
- README.md
- requirements.txt
- run_parity.py
- api_llm_gateway.rest
- api_model_server.rest
- api_prompt_gateway.rest
- insurance_agent.rest
- llm_routing.rest
- network_agent.rest
- .dockerignore
- .gitignore
- .gitmodules
- .pre-commit-config.yaml
- archgw.code-workspace
- build_filter_image.sh
- bun.lock
- CLAUDE.md
- CONTRIBUTING.md
- Dockerfile
- LICENSE
- package-lock.json
- package.json
- README.md
- turbo.json
π Installation Guide
git clone https://github.com/katanemo/plano
Downloads the entire project code from GitHub to your computer.
cd plano
Moves into the project folder you just downloaded.
2. Docker
Easy Recommended- Git Needed to download the project code from GitHub.
- Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker compose -f config/docker-compose.dev.yaml up -d --build
Runs the command against the services defined in the compose file.
3. Node.js
Easycd apps/katanemo-www
This project's files live in a subfolder, so move into it first.
npm install
Downloads and installs the libraries listed in package.json.
npm start
Starts the development/run server.
4. Python
Easypip install -r config/requirements.txt
Installs the Python libraries listed in requirements.txt (or similar).
python <μ€νν νμΌλͺ
>.py # READMEμμ μ νν μ€ν νμΌλͺ
μ νμΈνμΈμ
Runs the Python script (or module).
5. Rust
Medium- Git Needed to download the project code from GitHub.
- Rust (rustup) Installing via rustup also installs cargo.
cd crates
This project's files live in a subfolder, so move into it first.
cargo build --release
Compiles the Rust project.
cargo run
Builds and then immediately runs the program.
6. Make
Medium- Git Needed to download the project code from GitHub.
- Make Usually pre-installed on Linux/macOS. On Windows, install separately (e.g. via MSYS2 or WSL).
cd docs
This project's files live in a subfolder, so move into it first.
make
Compiles the code based on the generated build configuration to produce an executable.
