Choose an open model, then set the latency your workload actually needs. We handle the infrastructure behind one API, so you get serious savings without giving up reliability, technical depth, or a provider you can trust.
from openai import OpenAI
client = OpenAI(
base_url="https://api.gradiated.com",
api_key="YOUR_GRADIATED_API_KEY",
)
response = client.chat.completions.create(
model="YOUR_MODEL_ID",
messages=[{
"role": "user",
"content": "Explain inference in one sentence.",
}],
extra_body={"service_tier": "fast"},
)Select mode
2.3xfaster inference than other providers
Best suited for
Interactive workloads where response time matters most.
Run leading open models through one API. No provider hunt, new account, or integration for every model.
Choose the latency your workload needs. Pay for that requirement instead of somebody else's idea of fast.
Get material savings from a reliable, SOC 2 provider with the technical depth to run production workloads.
Move your application over to open-source models and spend ~10x less on tokens for the equivalent quality.
Loading models
| Model | Input | Cached input | Output | Context | Copy model ID |
|---|
More models coming soon. Request a model