Official docs outline
11 sections- Overview and quickstart
Groq's LPU-based inference API and OpenAI-compatible access.
- Supported models
Hosted models for text, speech, vision, and reasoning.
- Text and chat completions
Chat completion parameters, system prompts, and streaming.
- Tool use
Function calling and parallel tool use.
- Structured outputs
JSON schema mode for predictable output.
- Reasoning
Reasoning models and controlling reasoning effort.
- Speech to text and text to speech
Whisper transcription and speech generation.
- Vision
Image inputs for multimodal models.
- Batch processing
Asynchronous large-scale jobs at lower cost.
- Prompt caching
Automatic prefix caching to cut latency and cost.
- Rate limits
Requests and tokens per minute and handling 429 responses.
Each section links to the official page. Titles and summaries by Extra Credit; the docs belong to their authors.