Groq
Very fast inference for supported open models.
Auth
export GROQ_API_KEY=gsk_...
Examples
akmon chat --model llama-3.3-70b-versatile
akmon chat --model llama-3.1-8b-instant
See Groq’s model list for current ids.
More: Provider setup.
Very fast inference for supported open models.
export GROQ_API_KEY=gsk_...
akmon chat --model llama-3.3-70b-versatile
akmon chat --model llama-3.1-8b-instant
See Groq’s model list for current ids.
More: Provider setup.