Pricing, context window, capabilities, and release date — pulled from each provider's public docs. Both are available via the same AIgateway OpenAI-compatible endpoint; flip the model string to switch.
Both models stream in parallel through your own AIgateway key. Tokens, latency, and cost update as they arrive.
| Meta-Llama-3-8b-Instruct hf/meta-llama/meta-llama-3-8b-instruct | Llama-3.1-70b-Instruct meta/llama-3.1-70b-instruct | |
|---|---|---|
| Provider | Hugging Face | Meta |
| Family | Llama 3 | Llama 3 |
| Modality | text | text |
| Context window | 4,096 tok | 131,072 tok |
| Max output | 4,096 tok | 8,192 tok |
| Released | 2024-04-18 | 2024-07-23 |
| Input price | $0.050 /1M | $0.290 /1M |
| Output price | $0.100 /1M | $0.600 /1M |
| Cache read | — | — |
| Tools | — | — |
| Streaming | yes | yes |
| Vision | — | — |
| JSON mode | — | — |
| Reasoning | — | — |
| Prompt caching | — | — |
Generation over generation, Meta Llama 3 demonstrates state-of-the-art performance on a wide range of industry benchmarks and offers new capabilities, including improved reasoning.
The Meta Llama 3.1 collection of multilingual large language models (LLMs) is a collection of pretrained and instruction tuned generative models. The Llama 3.1 instruction tuned text only models are optimized for multilingual dialogue use cases and outperform many of the available open source and closed chat models on common industry benchmarks.
# pip install aigateway-py openai
# aigateway-py: sub-accounts, evals, replays, jobs, webhook verify.
# openai SDK: chat/embeddings/images/audio — drop-in compat per our SDK's own guidance.
from openai import OpenAI
client = OpenAI(
base_url="https://api.aigateway.sh/v1",
api_key="sk-aig-...",
)
# Try Meta-Llama-3-8b-Instruct
client.chat.completions.create(
model="hf/meta-llama/meta-llama-3-8b-instruct",
messages=[{"role":"user","content":"hello"}],
)
# Try Llama-3.1-70b-Instruct — same client, same key
client.chat.completions.create(
model="meta/llama-3.1-70b-instruct",
messages=[{"role":"user","content":"hello"}],
)