integrations/framework/LlamaIndex
LI

LlamaIndex + AIgateway

RAG framework — point its OpenAI provider at AIgateway.

LlamaIndex's OpenAI integration accepts a custom api_base. Use it to route every embedding, completion, and chat call through AIgateway.

LlamaIndex homepage →
Setup

Three steps or fewer.

STEP 01

Python

Use the OpenAI LLM class with the AIgateway base.

from llama_index.llms.openai import OpenAI as LlamaOpenAI

llm = LlamaOpenAI(
    model="anthropic/claude-sonnet-4.6",
    api_base="https://api.aigateway.sh/v1",
    api_key="sk-aig-...",
)

resp = llm.complete("hello")
STEP 02

Embeddings

Same pattern — OpenAIEmbedding with api_base set, then any embedding model from our catalog (e.g. baai/bge-m3).

More integrations

Same key. Every other tool.

OA
OpenAI SDK
Drop-in. Change one line, gain 100+ models.
CC
Claude Code
Point Anthropic's CLI at AIgateway and pick any model in 30 seconds.
CR
Cursor
Add AIgateway as a custom OpenAI-compatible provider in Cursor.
CL
Cline
VS Code agent that runs on whichever model wins your eval.
AI
Aider
Terminal-native pair programmer — works with one --openai-api-base flag.
CN
Continue.dev
Open-source IDE assistant — drop AIgateway into config.json.