Baseten
InferenceProduction ML model deployment — custom + open models
Operational
All systems responding normally
Last checked 09/06/2026, 6:23:19 am
415ms response
Uptime History96.00% uptime
2026-06-02Today
Uptime
96.00%
Avg Latency
538ms
P95 Latency
697ms
Fastest
292ms
Checks
150
Response Time
Last 60 checks292ms min538ms avg3968ms max
💰 Pricing
custom
A10G: $0.31/hr. A100: $2.87/hr. Dedicated deployment.
⚡ Rate Limits
free
RPM: 10TPM: 1,000
Free plan: 10 RPM, 1K TPM. Paid: up to 1000 RPM.
🤖 Models (1)
| Model | Task | Context | Vision | Tools | JSON |
|---|---|---|---|---|---|
| Custom Deployment Deploy any model. A10G/A100 GPUs. | llm | — | — | — | — |
Recent Checks
Showing last 15Operational
415ms9 June, 06:23 am
Operational
411ms9 June, 05:29 am
Operational
456ms9 June, 04:32 am
Operational
554ms9 June, 03:38 am
Operational
453ms9 June, 02:33 am
Operational
445ms9 June, 01:01 am
Unknown
—8 June, 11:49 pm
Operational
594ms8 June, 10:16 pm
Operational
402ms8 June, 08:38 pm
Operational
411ms8 June, 06:51 pm
Operational
427ms8 June, 05:07 pm
Operational
418ms8 June, 03:22 pm
Operational
445ms8 June, 01:47 pm
Operational
733ms8 June, 12:21 pm
Operational
373ms8 June, 12:21 pm
Other Inference Providers
Groq
LPU inference — fastest tokens per second on the market
Cerebras
Wafer-scale chip inference — 1,000+ tokens/sec
Together AI
Open-source model inference — Llama, Mixtral, FLUX
Fireworks AI
Fast open-model inference — FireFunction, Llama, Mixtral
OpenRouter
Unified API across 200+ models — route by price or speed
Hugging Face
Serverless inference API — 100k+ open models on demand