Skip to main content
Groq logo
AI as a Service

Groq

  • Freemium
  • Cloud

Verified Sep 2026

Low-latency LLM inference

LPU-based inference API that returns tokens an order of magnitude faster than GPU clouds: great for voice agents and chat UX.

The LPU inference company: absurd tokens-per-second on open models via deterministic hardware. The latency benchmark for speech agents and realtime UX.

Who it's for

Developers who want near-instant LLM responses via custom LPU hardware.

Keep exploring

Concepts in the glossary

1 in catalog

Groq features

2 in catalog

Groq is an alternative to

2 in catalog

Groq alternatives