Tracely

(★ 840)

Trace-native CI/CD for AI agents — production failures become regression tests that block the PR. Auto-detect, cluster, freeze into hermetic cases, replay in CI for $0.

File Explorer

Download Latest Version (.zip)

- - canvas-generative
  - cast
  - compose-graphics
  - compose-motion
  - compose-multiplatform
  - css-native
  - design-audit
  - desktop-principles
  - framer-motion
  - gsap
  - gsap-core
  - gsap-frameworks
  - gsap-performance
  - gsap-plugins
  - gsap-react
  - gsap-scrolltrigger
  - gsap-timeline
  - gsap-utils
  - mobile-principles
  - motion-design
  - motion-principles
  - paint
  - swiftui-graphics
  - swiftui-motion
  - threejs-r3f
  - ui-ux-pro-max
- launch.json
- - case.png
  - clusters.png
  - dashboard.png
  - gate-run.png
  - trace-timeline.png
  - traces.png
  - trends.png
- - ci.yml
  - publish-sdk.yml
  - tracely-gate.yml
- dependabot.yml
- - env.py
  - script.py.mako
- - conftest.py
  - test_assistant.py
  - test_assistant_tools.py
  - test_auth_classify.py
  - test_auth_clerk.py
  - test_auth_endpoints.py
  - test_auth_principal.py
  - test_billing_quota.py
  - test_billing_stripe.py
  - test_bulk_export.py
  - test_calibration.py
  - test_catalog_verdicts.py
  - test_ch_migrations_wait.py
  - test_ch_read_invariants.py
  - test_chat_prune.py
  - test_clusters_delete.py
  - test_clusters_promote.py
  - test_conversation_agents.py
  - test_conversation_replay.py
  - test_cost.py
  - test_data_delete.py
  - test_embedder_routing.py
  - test_eval_cost.py
  - test_eval_debounce.py
  - test_eval_targeting.py
  - test_evaluation_run_stream.py
  - test_evaluator_config.py
  - test_evaluators_api.py
  - test_fi_clusters.py
  - test_gate_eval.py
  - test_health.py
  - test_ingest_key_scope.py
  - test_introspection.py
  - test_invite_takeover.py
  - test_llm_judge_levels.py
  - test_mcp_server.py
  - test_meta_analysis.py
  - test_monitor_conditions.py
  - test_net_guard.py
  - test_notifications_dispatch.py
  - test_ops_selfcheck.py
  - test_organizations.py
  - test_otel_mapping.py
  - test_output_schema.py
  - test_password_reset.py
  - test_prod_guards.py
  - test_project_llm_key.py
  - test_project_wipe.py
  - test_ratelimit.py
  - test_regression_promote.py
  - test_rolling_summary.py
  - test_scenario_hardening.py
  - test_sessions_delete.py
  - test_share_tokens.py
  - test_simulation.py
  - test_structural_clustering.py
  - test_template_resolver.py
  - test_textfmt.py
  - test_verdict_policy.py
  - test_workspace_delete.py
- - __init__.py
  - config.py
  - log_config.py
- alembic.ini
- pyproject.toml
- README.md
- .gitignore
- demo_anthropic.py
- demo_langgraph.py
- demo_openai_agents.py
- Makefile
- pyproject.toml
- README.md
- server.py
- shared.py
- - .env.railway.example
  - backend.json
  - frontend.json
  - README.md
  - worker.json
- - 01-architecture-overview.md
  - 02-infrastructure.md
  - 03-database-clickhouse.md
  - 04-database-postgres.md
  - 05-ingestion-pipeline.md
  - 06-tracing-model.md
  - 07-opentelemetry.md
  - 08-frontend-waterfall.md
  - 09-queue-worker.md
  - 10-evals-current.md
  - 11-framework-integrations.md
  - 12-otel-genai-conventions.md
- - 00-canonical-decisions.md
  - 01-steal-and-do-not-copy.md
  - 02-system-architecture.md
  - 03-agent-and-trace-data-model.md
  - 04-evaluation-architecture.md
  - 05-regression-testing.md
  - 06-multi-agent-architecture.md
  - 07-failure-intelligence.md
  - 08-cicd-architecture.md
  - 09-database-schema.md
  - 10-mvp-and-roadmap.md
  - 11-prd-next-steps.md
  - 12-prd-automatic-tracing.md
  - 13-ts-js-parity-plan.md
  - 90-competitive-landscape.md
  - 91-techniques-references.md
  - 92-langfuse-verified-facts.md
- GROWTH.md
- README.md
- SEO.md
- - _app.jsx
  - _meta.js
  - api-reference.mdx
  - automatic.mdx
  - cli.mdx
  - concepts.mdx
  - evaluations.mdx
  - index.mdx
  - instrumentation.mdx
  - mcp.mdx
  - quickstart.mdx
  - replay.mdx
  - scenarios.mdx
  - self-hosting.mdx
  - skill.mdx
- - globals.css
- .gitignore
- next.config.mjs
- package.json
- pnpm-lock.yaml
- README.md
- theme.config.jsx
- - globals.css
  - globals.theme.test.ts
  - icon.svg
  - layout.tsx
  - not-found.tsx
  - opengraph-image.tsx
  - robots.ts
  - sitemap.ts
- .dockerignore
- Dockerfile
- Dockerfile.railway
- middleware.ts
- next-env.d.ts
- next.config.mjs
- package.json
- pnpm-lock.yaml
- pnpm-workspace.yaml
- postcss.config.mjs
- README.md
- tailwind.config.ts
- tsconfig.json
- vitest.config.mts
- vitest.setup.ts
- DEMO.md
- DEPLOY.md
- EVALUATION_CODE_MAP.md
- EVALUATION_GUIDE.md
- OVERVIEW.md
- SECURITY_AUDIT.md
- TRACELY_REVIEW.md
- debug_evaluation.py
- debug_failure_clustering.py
- demo_conversation.py
- demo_fleet.py
- README.md
- run_all_examples.sh
- seed_demo.py
- send_test_trace.py
- tracely_gate.py
- - _fake_db.py
  - auto_agent.py
  - auto_anthropic.py
  - auto_bedrock.py
  - auto_claude_agent.py
  - auto_crewai.py
  - auto_gemini.py
  - auto_google_adk.py
  - auto_langchain.py
  - auto_langgraph.py
  - auto_litellm.py
  - auto_llama_index.py
  - auto_mistral.py
  - auto_openai.py
  - auto_openai_agents.py
  - auto_openrouter.py
  - dropin_anthropic.py
  - dropin_openai.py
  - manual_spans.py
  - README.md
  - seed_conversations.py
  - seed_handler.py
  - seed_multicall.py
  - seed_multiturn.py
  - seed_regression.py
  - weather_agent.py
  - weather_agent_cli.py
- - conftest.py
  - test_auto_tracing.py
  - test_cli_simulate.py
  - test_export.py
  - test_redaction.py
  - test_replay_autoinstrument.py
  - test_replay_bridge.py
  - test_replay_more_providers.py
  - test_replay_real_providers.py
- - __init__.py
  - _wrap.py
  - anthropic.py
  - cli.py
  - export.py
  - google.py
  - mistral.py
  - openai.py
  - openrouter.py
  - py.typed
  - xai.py
- example.py
- LICENSE
- pyproject.toml
- README.md
- - SKILL.md
- - __init__.py
  - worker.py
- pyproject.toml
- README.md
.dockerignore
.env.example
.gitignore
CLAUDE.md
docker-compose.yml
Dockerfile.backend
LICENSE
Makefile
pyproject.toml
README.md
server.json
skills-lock.json
uv.lock

🚀 Installation Guide

1. Get the code

git clone https://github.com/Jwuthri/Tracely

Downloads the entire project code from GitHub to your computer.

cd Tracely

Moves into the project folder you just downloaded.

2. Official Install Script

Easy Recommended

Prerequisites

Python 3 Python is required to use pip.

pip install "tracely-ai[openai]" # or [anthropic], [langchain], [all]

Installs the package published on PyPI directly — no need to clone the source.

✅ After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.

Pulled directly from this repo's README.

3. Docker

Easy

Prerequisites

Git Needed to download the project code from GitHub.
Docker Desktop Needed to build and run containers. Install it and keep it running in the background.

docker compose --profile demo up -d --build --wait

Runs the command against the services defined in the compose file.

docker compose down # stop (add -v to wipe data)

Runs the command against the services defined in the compose file.

✅ Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.

Pulled directly from this repo's README.

4. Node.js

Easy

Prerequisites

Git Needed to download the project code from GitHub.
Node.js Node.js must be installed to use npm. The LTS version is recommended.

make install # uv sync + pnpm install

Compiles the code based on the generated build configuration to produce an executable.

cd frontend && pnpm test && pnpm build # vitest + tsc typecheck + lint

Moves into the project folder you just downloaded.

✅ After running the command, open the address shown in the terminal (usually something like http://localhost:3000) in your browser.

Pulled directly from this repo's README.

5. Python

Easy

Prerequisites

Git Needed to download the project code from GitHub.
Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.

pip install "tracely-ai[openai]" # or [anthropic], [langchain], [all]

Installs the package published on PyPI directly — no need to clone the source.

- run: pip install tracely-ai

Installs the Python libraries listed in requirements.txt (or similar).

✅ If it runs without errors and prints output in the terminal, it worked.

Pulled directly from this repo's README.

6. Make

Medium

Prerequisites

Git Needed to download the project code from GitHub.
Make Usually pre-installed on Linux/macOS. On Windows, install separately (e.g. via MSYS2 or WSL).

make infra-up # clickhouse, postgres, redis, minio

Compiles the code based on the generated build configuration to produce an executable.

make install # uv sync + pnpm install

Compiles the code based on the generated build configuration to produce an executable.

make migrate # ClickHouse DDL + Alembic (Postgres)

Compiles the code based on the generated build configuration to produce an executable.

make seed # default project + ingest key → tracely_dev_key

Compiles the code based on the generated build configuration to produce an executable.

make backend # FastAPI :8000 (OpenAPI at /docs) ┐

Compiles the code based on the generated build configuration to produce an executable.

✅ If it finishes without errors, it worked. Try running the generated executable directly.

Pulled directly from this repo's README.

Tracely

File Explorer

🚀 Installation Guide

2. Official Install Script

3. Docker

4. Node.js

5. Python

6. Make

Today's picks

Was this content helpful?

Recent Feedback

Tracely

File Explorer

🚀 Installation Guide

2. Official Install Script

3. Docker

4. Node.js

5. Python

6. Make

Today's picks

Was this content helpful?

Recent Feedback

Download README