promptfoo

(β˜… 24,435)

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

File Explorer

Download Latest Version (.zip)

Showing a partial file list β€” download the zip above to see everything.

  • .biomeignore
  • .dockerignore
  • .git-blame-ignore-revs
  • .gitignore
  • .mailmap
  • .npmignore
  • .npmrc
  • .nvmrc
  • .prettierignore
  • .prettierrc.yaml
  • .release-please-manifest.json
  • .rubocop.yml
  • .ruff.toml
  • AGENTS.md
  • biome.jsonc
  • CHANGELOG.md
  • CITATION.cff
  • CLAUDE.md
  • CODE_OF_CONDUCT.md
  • codecov.yml
  • CONTRIBUTING.md
  • Dockerfile
  • drizzle.config.ts
  • knip.jsonc
  • LICENSE
  • package-lock.json
  • package.json
  • pnpm-workspace.yaml
  • README.md
  • release-please-config.json
  • renovate.json
  • SECURITY.md

# Installation Guide

1. Get the code
git clone https://github.com/promptfoo/promptfoo

Downloads the entire project code from GitHub to your computer.

cd promptfoo

Moves into the project folder you just downloaded.

2. Official Install Script

Easy Recommended
Prerequisites
  • Node.js Node.js must be installed to use npm.
npm install -g promptfoo

Installs the package published on the npm registry globally β€” no need to clone the source.

βœ… After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.

Pulled directly from this repo's README.

3. Docker

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker build -t promptfoo .

Builds a runnable image based on the Dockerfile.

docker run -p 8080:80 promptfoo

Runs the built image as an actual container.

βœ… Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.

4. Node.js

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Node.js Node.js must be installed to use npm. The LTS version is recommended.
npm install -g promptfoo

Installs the package published on the npm registry globally β€” no need to clone the source.

βœ… After running the command, open the address shown in the terminal (usually something like http://localhost:3000) in your browser.

Pulled directly from this repo's README.

Today's picks

json-server β˜… 75,680

Get a full fake REST API with zero coding in less than 30 seconds (seriously)

JavaScript
skills β˜… 170,812

Public repository for Agent Skills

Python
Best-websites-a-programmer-should-visit β˜… 76,276

:link: Some useful websites for programmers.
ollama β˜… 179,103

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and ot

Go
netdata β˜… 80,252

The fastest path to AI-powered full stack observability, even for lean teams.

Go
the-art-of-command-line β˜… 162,140

Master the command line, in one page
// repository documentation