CometAPI - Zero Runtime

CometAPI is an LLM plugin. It exposes many models behind a single OpenAI-compatible endpoint, so you can switch models without changing providers. It takes the transcribed conversation and generates the reply.

Setup

Set your CometAPI key in the worker environment. Generate a key from the CometAPI console:

export COMETAPI_API_KEY=<key>

Usage

Import the plugin and pass it to the pipeline’s llm slot.

from zeroruntime.plugins import CometAPILLM

llm = CometAPILLM(
    model="gpt-4o-mini",
    temperature=0.7,
)

# Pipeline(llm=llm, ...)

import { CometAPILLM } from '@zeroruntime/js-sdk/plugins';

const llm = CometAPILLM({
  model: 'gpt-4o-mini',
  temperature: 0.7,
});

// Pipeline({ llm, ... })

Configuration Options

Constructor parameters for CometAPILLM. The Python and Node JS SDKs share these field names. CometAPI is OpenAI-compatible and built on the OpenAI plugin.

Parameter	Type	Default	Description
`api_key`	`str`	`None`	CometAPI key. Falls back to the `COMETAPI_API_KEY` environment variable when unset.
`model`	`str`	`"gpt-4o-mini"`	Model used to generate replies.
`temperature`	`float`	`0.7`	Sampling randomness; lower is more deterministic.
`max_completion_tokens`	`int`	`None`	Caps the length of each reply.

Import paths

SDK	Import	Constructor
Python	`from zeroruntime.plugins import CometAPILLM`	`CometAPILLM(...)`
Node JS	`import { CometAPILLM } from '@zeroruntime/js-sdk/plugins'`	`CometAPILLM({ ... })`

The reply is streamed to the text-to-speech plugin, which synthesizes the agent’s voice.