Docs·API

Groq

InferenceFREE TIER

LPU inference — fastest tokens per second on the market

groq.com ↗Pricing →/api/v1/latency

Operational

All systems responding normally

Last checked 10/09/2026, 7:52:45 pm

208ms response

Uptime History100.00% uptime

2026-09-08Today

Uptime

100.00%

Avg Latency

322ms

P95 Latency

399ms

Fastest

203ms

Checks

150

Response Time

Last 60 checks

203ms min322ms avg534ms max

💰 Pricing

llama-3.3-70bFREE

Input: $0.59/1MOutput: $0.79/1M

Fastest inference. mixtral-8x7b: $0.24/$0.24

14,400 req/day free

⚡ Rate Limits

free

RPM: 30TPM: 6,000RPD: 14,400TPD: 500,000

Per-model limits. llama-3.3-70b: 6k TPM free.

dev

RPM: 100TPM: 15,000

$0 plan with credit card.

🤖 Models (2)

Model	Task	Context	Vision	Tools	JSON
Llama 3.3 70B LPU inference — extremely fast	llm	128k	—	✅	✅
Mixtral 8x7B Cheapest on Groq: $0.24/$0.24	llm	33k	—	✅	✅

Recent Checks

Showing last 15

Operational

208ms10 Sept, 07:52 pm

Operational

365ms10 Sept, 07:44 pm

Operational

366ms10 Sept, 07:31 pm

Operational

303ms10 Sept, 07:13 pm

Operational

319ms10 Sept, 06:55 pm

Operational

308ms10 Sept, 06:47 pm

Operational

397ms10 Sept, 06:36 pm

Operational

278ms10 Sept, 06:15 pm

Operational

339ms10 Sept, 05:53 pm

Operational

343ms10 Sept, 05:46 pm

Operational

329ms10 Sept, 05:38 pm

Operational

305ms10 Sept, 05:23 pm

Operational

321ms10 Sept, 04:59 pm

Operational

328ms10 Sept, 04:49 pm

Operational

341ms10 Sept, 04:20 pm

API Quick Access

Health Latency Freshness Pricing Models

Other Inference Providers

Cerebras

Wafer-scale chip inference — 1,000+ tokens/sec

Together AI

Open-source model inference — Llama, Mixtral, FLUX

Fireworks AI

Fast open-model inference — FireFunction, Llama, Mixtral

OpenRouter

Unified API across 200+ models — route by price or speed

Hugging Face

Serverless inference API — 100k+ open models on demand

fal.ai

Ultra-fast image & video model inference for agents

Visit Groq →View Pricing ← All Providers