plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
File Explorer
Download Latest Version (.zip)- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- ci.yml
- docker-push-main.yml
- docker-push-release.yml
- publish-binaries.yml
- publish-pypi.yml
- static.yml
- update-providers.yml
- clubcentric.svg
- hp.svg
- huggingface.svg
- sandisk.svg
- tmobile.svg
- KatanemoLogo.svg
- globals.css
- layout.tsx
- page.tsx
- LogoSlider.tsx
- metadata.ts
- .gitignore
- biome.json
- next.config.ts
- package.json
- postcss.config.mjs
- tsconfig.json
- IBMPlexSans-Italic-VariableFont_wdth,wght.ttf
- IBMPlexSans-VariableFont_wdth,wght.otf
- IBMPlexSans-VariableFont_wdth,wght.ttf
- jetbrains-mono-bold.otf
- jetbrains-mono-bold.woff2
- JetBrainsMono-Medium.otf
- JetBrainsMono-Medium.woff2
- JetBrainsMono-Regular.otf
- JetBrainsMono-Regular.woff2
- chase.svg
- clubcentric.svg
- hp.svg
- huggingface.svg
- sandisk.svg
- tmobile.svg
- Benchmarks.svg
- BuildWithChoice.svg
- BuiltOnEnvoy.svg
- Contextual.svg
- file.svg
- globe.svg
- HowItWorks.svg
- IntroDiagram.svg
- Introduction.svg
- LaunchFaster.svg
- Logomark.png
- Logomark.svg
- LogoMarkSquare.svg
- LogoOutline.svg
- NetworkPathDiagram.svg
- next.svg
- OpenSource.svg
- plano.svg
- Plano30B-Logo.svg
- Plano4B-Logo.svg
- PlanoIcon.svg
- PromptRouting.svg
- PurposeBuilt.svg
- ShipConfidently.svg
- Telemetry.svg
- Timeline.svg
- vercel.svg
- window.svg
- blogType.ts
- index.ts
- route.ts
- route.tsx
- layout.tsx
- not-found.tsx
- page.tsx
- page.tsx
- ContactPageClient.tsx
- page.tsx
- page.tsx
- ResearchPageClient.tsx
- page.tsx
- layout.tsx
- favicon.ico
- globals.css
- layout.tsx
- page.tsx
- robots.ts
- sitemap.ts
- index.ts
- ResearchBenchmarks.tsx
- ResearchCapabilities.tsx
- ResearchCTA.tsx
- ResearchFamily.tsx
- ResearchGrid.tsx
- ResearchHero.tsx
- ResearchTimeline.tsx
- AsciiDiagram.tsx
- BlogCard.tsx
- BlogHeader.tsx
- BlogSectionHeader.tsx
- ConditionalLayout.tsx
- DiagramBuilder.tsx
- FeaturedBlogCard.tsx
- Hero.tsx
- HowItWorksSection.tsx
- IdeaToAgentSection.tsx
- IntroSection.tsx
- LogoCloud.tsx
- NetworkAnimation.tsx
- PortableText.tsx
- UnlockPotentialSection.tsx
- UseCasesSection.tsx
- VerticalCarouselSection.tsx
- diagrams-programmatic.ts
- diagrams.ts
- diagramTemplates.ts
- metadata.ts
- sanity.ts
- asciiBuilder.ts
- .gitignore
- biome.json
- components.json
- next.config.ts
- package-lock.json
- package.json
- postcss.config.mjs
- README.md
- sanity.config.ts
- tsconfig.json
- .gitignore
- __init__.py
- collector.py
- pricing.py
- render.py
- coding_agent_routing.yaml
- conversational_state_v1_responses.yaml
- filter_chain_guardrails.yaml
- preference_aware_routing.yaml
- sub_agent_orchestration.yaml
- template_sync_map.yaml
- __init__.py
- chatgpt_auth.py
- chatgpt_cmd.py
- config_generator.py
- consts.py
- core.py
- defaults.py
- docker_cli.py
- init_cmd.py
- main.py
- native_binaries.py
- native_runner.py
- obs_cmd.py
- rich_click_config.py
- template_sync.py
- trace_cmd.py
- trace_listener_runtime.py
- utils.py
- versioning.py
- failure.json
- success.json
- __init__.py
- test_config_generator.py
- test_defaults.py
- test_init.py
- test_obs_collector.py
- test_obs_pricing.py
- test_obs_render.py
- test_trace_cmd.py
- test_version_check.py
- build_cli.sh
- pyproject.toml
- README.md
- uv.lock
- brightstaff.yaml
- prometheus.yaml
- brightstaff_dashboard.json
- docker-compose.yaml
- prometheus_scrape.yaml
- docker-compose.dev.yaml
- env.list
- envoy.template.yaml
- plano_config_schema.yaml
- README.md
- requirements.txt
- supervisord.conf
- test_passthrough.yaml
- validate_plano_config.sh
- launch.json
- tasks.json
- signals_replay.rs
- errors.rs
- jsonrpc.rs
- mod.rs
- orchestrator.rs
- pipeline.rs
- selector.rs
- mod.rs
- model_selection.rs
- prompt_caching.rs
- session_router.rs
- debug.rs
- function_calling.rs
- integration_tests.rs
- mod.rs
- models.rs
- response.rs
- routing_budget_request.rs
- routing_service.rs
- labels.rs
- mod.rs
- http.rs
- mod.rs
- model_metrics.rs
- orchestrator.rs
- orchestrator_model.rs
- orchestrator_model_v1.rs
- stress_tests.rs
- memory.rs
- mod.rs
- redis.rs
- exhaustion.rs
- mod.rs
- failure.rs
- loops.rs
- mod.rs
- constants.rs
- disengagement.rs
- misalignment.rs
- mod.rs
- satisfaction.rs
- stagnation.rs
- analyzer.rs
- mod.rs
- otel.rs
- schemas.rs
- text_processing.rs
- memory.rs
- mod.rs
- postgresql.rs
- response_state_processor.rs
- constants.rs
- custom_attributes.rs
- init.rs
- mod.rs
- posthog_exporter.rs
- service_name_exporter.rs
- affinity.rs
- app_state.rs
- lib.rs
- main.rs
- streaming.rs
- Cargo.toml
- hallucination.rs
- mod.rs
- open_ai.rs
- prompt_guard.rs
- zero_shot.rs
- constants.rs
- mod.rs
- resource_span_builder.rs
- shapes.rs
- span_builder.rs
- configuration.rs
- consts.rs
- errors.rs
- http.rs
- lib.rs
- llm_providers.rs
- path.rs
- pii.rs
- ratelimit.rs
- routing.rs
- stats.rs
- tokenizer.rs
- tracing.rs
- utils.rs
- Cargo.lock
- Cargo.toml
- amazon_bedrock_binary_frame.rs
- anthropic_streaming_buffer.rs
- chat_completions_streaming_buffer.rs
- mod.rs
- passthrough_streaming_buffer.rs
- responses_api_streaming_buffer.rs
- sse.rs
- sse_chunk_processor.rs
- amazon_bedrock.rs
- anthropic.rs
- mod.rs
- openai.rs
- openai_responses.rs
- fetch_models.rs
- provider_models.yaml
- run.sh
- endpoints.rs
- lib.rs
- mod.rs
- id.rs
- mod.rs
- request.rs
- response.rs
- streaming_response.rs
- from_anthropic.rs
- from_bedrock.rs
- from_openai.rs
- mod.rs
- mod.rs
- output_to_input.rs
- to_anthropic.rs
- to_openai.rs
- mod.rs
- to_anthropic_streaming.rs
- to_openai_streaming.rs
- lib.rs
- mod.rs
- lib.rs
- mod.rs
- Cargo.toml
- README.md
- filter_context.rs
- lib.rs
- metrics.rs
- stream_context.rs
- Cargo.toml
- context.rs
- filter_context.rs
- http_context.rs
- lib.rs
- metrics.rs
- stream_context.rs
- tools.rs
- Cargo.toml
- build.sh
- Cargo.lock
- Cargo.toml
- simple.hurl
- simple_stream.hurl
- config.yaml
- docker-compose.yaml
- README.md
- run_demo.sh
- test_data.yaml
- bench.py
- evals_summarize.yaml
- plano_config_with_aliases.yaml
- pyproject.toml
- README.md
- run_demo.sh
- uv.lock
- config.yaml
- docker-compose.yaml
- Dockerfile
- main.py
- mutli-turn-example.png
- pyproject.toml
- README.md
- requirements.txt
- run_demo.sh
- start_agents.sh
- config.yaml
- docker-compose.yaml
- README.md
- run_demo.sh
- stock_quote_demo.png
- flight_agent.py
- weather_agent.py
- config.yaml
- docker-compose.yaml
- Dockerfile
- openai_protocol.py
- pyproject.toml
- README.md
- run_demo.sh
- start_agents.sh
- traces.png
- uv.lock
- flight_agent.py
- weather_agent.py
- config.yaml
- config_local_orchestrator.yaml
- docker-compose.yaml
- Dockerfile
- pyproject.toml
- README.md
- run_demo.sh
- start_agents.sh
- test.rest
- tracing.png
- travel_agent_request.rest
- uv.lock
- __init__.py
- __main__.py
- api.py
- context_builder.py
- input_guards.py
- query_rewriter.py
- rag_agent.py
- sample_knowledge_base.csv
- config.yaml
- docker-compose.yaml
- Dockerfile
- http.rest
- mcp_query.rest
- pyproject.toml
- README.md
- run_demo.sh
- sample_queries.md
- start_agents.sh
- test.rest
- uv.lock
- __init__.py
- __main__.py
- api.py
- context_builder.py
- input_guards.py
- query_rewriter.py
- rag_agent.py
- sample_knowledge_base.csv
- config.yaml
- docker-compose.yaml
- Dockerfile
- mcp_query.rest
- pyproject.toml
- README.md
- run_demo.sh
- sample_queries.md
- start_agents.sh
- test.rest
- uv.lock
- config.openai.yaml
- config.yaml
- content_guard.py
- docker-compose.openai.yaml
- docker-compose.yaml
- Dockerfile
- fake_provider.py
- output_filter.py
- README.md
- test.sh
- test_services.py
- config.yaml
- docker-compose.yaml
- pii.py
- pii_anonymizer.py
- pyproject.toml
- README.md
- run_demo.sh
- start_agents.sh
- store.py
- test.sh
- uv.lock
- config.yaml
- docker-compose.yaml
- jaeger_tracing_llm_routing.png
- llm_routing_demo.png
- README.md
- run_demo.sh
- simple.hurl
- simple_stream.hurl
- config.yaml
- docker-compose.yaml
- Dockerfile
- main.py
- pyproject.toml
- README.md
- run_demo.sh
- start_agents.sh
- uv.lock
- config.yaml
- docker-compose.yaml
- README.md
- run_demo.sh
- config.yaml
- docker-compose.yaml
- README.md
- run_demo.sh
- spotify_bearer_auth.png
- chat.py
- config.yaml
- README.md
- test_chatgpt.sh
- claude_code.png
- config.yaml
- model_selection.png
- pretty_model_resolution.sh
- README.md
- config.yaml
- pretty_model_resolution.sh
- README.md
- config_with_aliases.yaml
- README.md
- run_demo.sh
- config.yaml
- config_k8s.yaml
- demo.sh
- docker-compose.yaml
- metrics_server.py
- plano-deployment.yaml
- prometheus.yaml
- README.md
- test.rest
- vllm-deployment.yaml
- config.yaml
- openclaw_plano.png
- README.md
- simple.hurl
- simple_stream.hurl
- config.yaml
- docker-compose.yaml
- plano_config_local.yaml
- README.md
- run_demo.sh
- test_router_endpoint.rest
- config.yaml
- demo.sh
- GUIDE.md
- README.md
- Dockerfile
- common.py
- pyproject.toml
- README.md
- run_demo_tests.sh
- test_demos.py
- uv.lock
- README.md
- llms_txt.py
- provider_models.py
- custom.css
- arch_router_paper_preview.png
- claude_code_router.png
- cli-default-command.png
- cli-init-command.png
- cli-trace-command.png
- demo_tracing.png
- input-token-metrics.png
- llm-request-metrics.png
- network-topology-ingress-egress.png
- output-token-metrics.png
- plano-system-architecture.png
- plano_network_diagram_high_level.png
- PlanoTagline.svg
- signals_trace.png
- tracing.png
- fix-copy.js
- favicon.ico
- analytics.html
- function-calling-agent.yaml
- function-calling-flow.jpg
- parameter_handling.py
- multi_turn_rag.py
- mutli-turn-example.png
- prompt_targets_multi_turn.yaml
- parameter_handling.py
- prompt_targets.yaml
- plano_config.yaml
- client_libraries.rst
- llm_providers.rst
- model_aliases.rst
- supported_providers.rst
- agents.rst
- filter_chain.rst
- listeners.rst
- prompt_target.rst
- signals.rst
- intro_to_plano.rst
- overview.rst
- quickstart.rst
- config.yaml
- access_logging.rst
- monitoring.rst
- observability.rst
- tracing.rst
- function_calling.rst
- llm_router.rst
- orchestration.rst
- prompt_guard.rst
- state.rst
- conversation_states.sql
- README.md
- agents_config.yaml
- flights.py
- weather.py
- plano_config_agents_filters.yaml
- plano_config_full_reference.yaml
- plano_config_full_reference_rendered.yaml
- plano_config_state_storage_example.yaml
- model_serving.rst
- request_lifecycle.rst
- tech_overview.rst
- threading_model.rst
- cli_reference.rst
- configuration_reference.rst
- deployment.rst
- llms_txt.rst
- conf.py
- docutils.conf
- index.rst
- build_docs.sh
- CNAME
- Dockerfile
- Makefile
- README.md
- requirements.txt
- routing-api.md
- globals.css
- package.json
- package.json
- tailwind.config.ts
- base.json
- nextjs.json
- package.json
- button.tsx
- dialog.tsx
- Footer.tsx
- Logo.tsx
- Navbar.tsx
- utils.ts
- index.ts
- package.json
- tsconfig.json
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- SKILL.md
- _sections.md
- _template.md
- advanced-multi-listener.md
- advanced-prompt-targets.md
- agent-descriptions.md
- agent-orchestration.md
- cli-agent.md
- cli-init.md
- cli-startup.md
- config-listeners.md
- config-providers.md
- config-secrets.md
- config-version.md
- deploy-docker.md
- deploy-health.md
- deploy-state.md
- filter-guardrails.md
- filter-mcp.md
- filter-ordering.md
- observe-span-attributes.md
- observe-trace-query.md
- observe-tracing.md
- routing-aliases.md
- routing-default.md
- routing-passthrough.md
- routing-preferences.md
- build.ts
- extract-tests.ts
- validate.ts
- AGENTS.md
- metadata.json
- package-lock.json
- package.json
- README.md
- test-cases.json
- tsconfig.json
- launch.json
- settings.json
- common.py
- common.sh
- config.yaml
- docker-compose.yaml
- pyproject.toml
- test_llm_gateway.py
- test_prompt_gateway.py
- uv.lock
- launch.json
- settings.json
- common.py
- common_scripts.sh
- config_memory_state_v1_responses.yaml
- config_native_smoke.yaml
- docker-compose.yaml
- pyproject.toml
- README.md
- response.hex
- response_with_tools.hex
- run_e2e_tests.sh
- run_model_alias_tests.sh
- run_prompt_gateway_tests.sh
- run_responses_state_tests.sh
- test_model_alias_routing.py
- test_openai_responses_api_client.py
- test_openai_responses_api_client_with_state.py
- test_prompt_gateway.py
- uv.lock
- llm_gateway_model_default_llm.hurl
- llm_gateway_model_explicit_model.hurl
- llm_gateway_model_hint.hurl
- arch_fc.hurl
- .gitignore
- _smoke_test.py
- compare.py
- README.md
- requirements.txt
- run_parity.py
- api_llm_gateway.rest
- api_model_server.rest
- api_prompt_gateway.rest
- insurance_agent.rest
- llm_routing.rest
- network_agent.rest
- .dockerignore
- .gitignore
- .gitmodules
- .pre-commit-config.yaml
- archgw.code-workspace
- build_filter_image.sh
- bun.lock
- CLAUDE.md
- CONTRIBUTING.md
- Dockerfile
- LICENSE
- package-lock.json
- package.json
- README.md
- turbo.json
# Installation Guide
1. Get the code
git clone https://github.com/katanemo/plano
Downloads the entire project code from GitHub to your computer.
cd plano
Moves into the project folder you just downloaded.
2. Docker
Easy RecommendedPrerequisites
- Git Needed to download the project code from GitHub.
- Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker compose -f config/docker-compose.dev.yaml up -d --build
Runs the command against the services defined in the compose file.
Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.
3. Node.js
EasyPrerequisites
cd apps/katanemo-www
This project's files live in a subfolder, so move into it first.
npm install
Downloads and installs the libraries listed in package.json.
npm start
Starts the development/run server.
After running the command, open the address shown in the terminal (usually something like http://localhost:3000) in your browser.
4. Python
EasyPrerequisites
pip install -r config/requirements.txt
Installs the Python libraries listed in requirements.txt (or similar).
python <์คํํ ํ์ผ๋ช
>.py # README์์ ์ ํํ ์คํ ํ์ผ๋ช
์ ํ์ธํ์ธ์
Runs the Python script (or module).
If it runs without errors and prints output in the terminal, it worked.
5. Rust
MediumPrerequisites
- Git Needed to download the project code from GitHub.
- Rust (rustup) Installing via rustup also installs cargo.
cd crates
This project's files live in a subfolder, so move into it first.
cargo build --release
Compiles the Rust project.
cargo run
Builds and then immediately runs the program.
If cargo build finishes without errors, it worked. The executable is created under target/.
// repository documentation
Was this content helpful?
(0 ratings)