oss-llmops-stack
Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-availability, while Langfuse focuses on detailed observability, prompt versioning, and performance evaluations.
File Explorer
Download Latest Version (.zip)- docker-compose.yml
- litellm-config.yaml
- litellm.env
- _app.jsx
- _meta.js
- docs.mdx
- index.mdx
- litellm_proxy_langfuse.png
- oss-llmops-stack-og.png
- adobe_logo.svg
- cornelsen_logo.png
- favicon.ico
- fletch_dark.svg
- fletch_light.svg
- langfuse_icon.svg
- langfuse_logo.svg
- langfuse_logo_dark.svg
- lemonade_logo_dark.svg
- lemonade_logo_light.svg
- litellm_icon.png
- litellm_logo.png
- litellm_logo_dark.png
- rocketmoney_logo.svg
- samsara_dark.png
- samsara_light.png
- twilio_logo_dark.svg
- twilio_logo_light.svg
- weather_logo.svg
- generate_llms_txt.js
- overrides.css
- style.css
- .gitignore
- .nvmrc
- _headers
- next-sitemap.config.js
- next.config.mjs
- package.json
- pnpm-lock.yaml
- postcss.config.js
- README.md
- tailwind.config.js
- theme.config.jsx
- LICENSE
- README.md
# Installation Guide
1. Get the code
git clone https://github.com/langfuse/oss-llmops-stack
Downloads the entire project code from GitHub to your computer.
cd oss-llmops-stack
Moves into the project folder you just downloaded.
2. Docker
Easy RecommendedPrerequisites
- Git Needed to download the project code from GitHub.
- Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker compose -f docker-compose/docker-compose.yml up -d --build
Runs the command against the services defined in the compose file.
Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.
// repository documentation
Was this content helpful?
(0 ratings)