Skip to main content

Usage guide

Setup, environment variables, and Python/JavaScript/Go usage examples.

​
CerebrasLLM

Ultra-fast LLM inference on Cerebras wafer-scale hardware. OpenAI-compatible chat completions with streaming and tool calling.

​
Constructor

​
api_key
str | None
Cerebras API key. Falls back to CEREBRAS_API_KEY.
​
model
CerebrasLLMModel | str
default:"llama3.3-70b"
Model id: gpt-oss-120b, zai-glm-4.7, or llama3.3-70b (default).
​
temperature
float
default:"0.7"
Sampling temperature, 0.0–1.5. Default 0.7.
​
tool_choice
str
default:"auto"
Tool selection mode ("auto"/"none"/"required").
​
max_completion_tokens
int | None
Max tokens to generate. Default 1024.
​
top_p
float | None
Nucleus sampling probability mass. Default None.
​
seed
int | None
Seed for reproducible sampling. Default None.
​
stop
str | None
Stop sequence that halts generation. Default None.
​
user
str | None
Stable end-user identifier for abuse monitoring. Default None.

​
aclose

Release any resources held by the provider.

​
cancel_current_generation

Cancel the in-progress generation for the active session, if any.

​
chat

Generate a streamed chat completion.
​
messages
Any
required
The conversation history to send to the model.
​
tools
Any
Optional tool definitions the model may call.
​
conversational_graph
Any
Optional conversational graph guiding the exchange.
​
returns
AsyncIterator[LLMResponse]
LLMResponse: Response chunks produced as the model generates output.

​
emit

Emit an event, invoking all registered handlers with the given arguments. Handlers are called in registration order. Coroutine handlers are scheduled on the running event loop. If the emitter is closed, the call is a no-op.
​
event
T
required
The event to emit.

​
off

Remove a previously registered handler for an event. If the handler is not registered for the event, the call is a no-op.
​
event
T
required
The event the handler was registered for.
​
callback
Callable[..., Any]
required
The handler to remove.

​
on

Register a handler for an event. Can be used directly by passing a callback, or as a decorator when callback is omitted.
​
event
T
required
The event to listen for.
​
callback
Callable[..., Any] | None
The handler to invoke when the event is emitted. If None, a decorator is returned that registers the decorated function.
​
returns
Callable[..., Any]
The registered callback when callback is provided, otherwise a decorator that registers and returns the function it wraps.

​
CerebrasLLMModel