integrations/eval/Promptfoo

Promptfoo + AIgateway

Eval prompts across every AIgateway model with one provider config.

Promptfoo runs prompt + model evals from a single YAML. Add AIgateway as a provider and you can grade your prompt against 5 models in one command.

Promptfoo homepage →
Setup

Three steps or fewer.

STEP 01

Provider config

Add AIgateway-hosted models to promptfooconfig.yaml.

providers:
  - id: openai:chat:anthropic/claude-opus-4.7
    config: { apiBaseUrl: "https://api.aigateway.sh/v1" }
  - id: openai:chat:moonshot/kimi-k2.6
    config: { apiBaseUrl: "https://api.aigateway.sh/v1" }
  - id: openai:chat:openai/gpt-5.4
    config: { apiBaseUrl: "https://api.aigateway.sh/v1" }
More integrations

Same key. Every other tool.

OpenAI SDK
Drop-in. Change one line, gain 1000+ models.
Claude Code
Point Anthropic's CLI at AIgateway and pick any model in 30 seconds.
Cursor
Add AIgateway as a custom OpenAI-compatible provider in Cursor.
Cline
VS Code agent that runs on whichever model wins your eval.
Aider
Terminal-native pair programmer — works with one --openai-api-base flag.
Continue.dev
Open-source IDE assistant — drop AIgateway into config.json.