LlamaIndex + AIgateway

RAG framework — point its OpenAI provider at AIgateway.

LlamaIndex's OpenAI integration accepts a custom api_base. Use it to route every embedding, completion, and chat call through AIgateway.

LlamaIndex homepage →

Setup

Three steps or fewer.

STEP 01

Python

Use the OpenAI LLM class with the AIgateway base.

from llama_index.llms.openai import OpenAI as LlamaOpenAI

llm = LlamaOpenAI(
    model="anthropic/claude-sonnet-4.6",
    api_base="https://api.aigateway.sh/v1",
    api_key="sk-aig-...",
)

resp = llm.complete("hello")

STEP 02

Embeddings

Same pattern — OpenAIEmbedding with api_base set, then any embedding model from our catalog (e.g. baai/bge-m3).

More integrations

Same key. Every other tool.

OpenAI SDK

Drop-in. Change one line, gain 1000+ models.

Claude Code

Point Anthropic's CLI at AIgateway and pick any model in 30 seconds.

Cursor

Add AIgateway as a custom OpenAI-compatible provider in Cursor.

Cline

VS Code agent that runs on whichever model wins your eval.

Aider

Terminal-native pair programmer — works with one --openai-api-base flag.

Continue.dev

Open-source IDE assistant — drop AIgateway into config.json.