Skip to main content

CometAPILLM

CometAPI large language model provider (OpenAI-compatible gateway). Creates a configured CometAPI LLM provider for use in a voice agent.

Constructor

apiKey
string
CometAPI key. Falls back to the COMETAPI_API_KEY env var.
model
CometAPILLMModel | string
Model ID. Default: 'gpt-4o-mini'.
baseUrl
string | null
Override the API base URL. Falls back to the COMETAPI_BASE_URL env var, then null.
temperature
number
Sampling temperature. Default: 0.7.
maxCompletionTokens
number
Maximum number of completion tokens to generate. Default: 1024.
toolChoice
string | null
Tool-selection strategy, e.g. 'auto', 'none'. Default: 'auto'.
topP
number | null
Nucleus sampling probability mass. Default: null.
frequencyPenalty
number | null
Frequency penalty. Range -2-2. Default: null.
presencePenalty
number | null
Presence penalty. Range -2-2. Default: null.
seed
number | null
Sampling seed for reproducible outputs. Default: null.
stop
string | null
Stop sequence. Default: null.
user
string | null
Opaque end-user identifier. Default: null.
parallelToolCalls
boolean | null
Whether to allow parallel tool calls. Default: null.
responseFormat
Record<string, any> | null
Response format object, e.g. JSON mode. Default: null.

cancelCurrentGeneration

Cancel the in-flight generation for the current session, if any.

chat

Stream a completion for the given messages, yielding LLMResponse chunks.
returns
AsyncIterator<LLMResponse>

close

Release any resources held by the provider.

closeEmitter

Close the emitter: drop all handlers and stop emitting. Waits up to 2 seconds for in-flight async handlers to settle before returning.

emit

event
string
required

getRuntimeConfig

returns
Record<string, any>

listenerCount

event
string
required
returns
number

off

event
string
required
handler
EventHandler
required

on

event
string
required
handler
EventHandler
required
returns
EventHandler

once

event
string
required
handler
EventHandler
required
returns
EventHandler

removeAllListeners

event
string

CometAPILLMModel