GroqLLM
Groq LLM provider.Constructor
Groq API key. Defaults to the
GROQ_API_KEY environment variable.Model ID to use. Default:
'llama-3.3-70b-versatile'.Sampling temperature; higher values produce more random output. Range 0-2. Default:
0.7.Maximum number of tokens to generate in the completion. Default:
1024.Nucleus sampling probability mass (0-1). Default:
null (provider default).Penalizes new tokens based on their frequency so far (-2.0 to 2.0). Default:
null.Penalizes new tokens based on whether they appear so far (-2.0 to 2.0). Default:
null.Seed for deterministic sampling; identical requests with the same seed aim to return the same result. Default:
null.Stop sequence(s) at which generation halts. Default:
null.Stable identifier for the end user, used for abuse monitoring. Default:
null.Controls tool selection, e.g.
'none', 'auto', 'required', or a specific tool. Default: null.Whether to allow multiple tool calls to run in parallel. Default:
null.Output format specification, e.g.
{ type: 'json_object' }. Default: null.Reasoning effort level for reasoning-capable models, e.g.
'low', 'medium', 'high'. Default: null.How reasoning content is returned, e.g.
'parsed', 'raw', 'hidden'. Default: null.Service tier for the request, e.g.
'auto', 'on_demand', 'flex'. Default: null.