Sarvam AI

Sarvam AI is an LLM plugin tuned for Indian languages. It takes the transcribed conversation and generates the reply, with optional Wikipedia grounding.

Sarvam AI is also available as a speech-to-text plugin.

Setup

Set your Sarvam AI API key in the worker environment. Generate a key from the Sarvam AI dashboard:

export SARVAMAI_API_KEY=<key>

The runtime picks up SARVAMAI_API_KEY from the worker environment. If you pass the key directly to the constructor’s api_key parameter and leave it unset, the SDK falls back to the SARVAM_API_KEY environment variable instead.

Usage

Import the plugin and pass it to the pipeline’s llm slot.

from zrt.plugins import SarvamAILLM

llm = SarvamAILLM(
    model="sarvam-30b",
    temperature=0.7,
)

# Pipeline(llm=llm, ...)

Configuration Options

Constructor parameters for the Python SDK (SarvamAILLM). The JavaScript and Go SDKs expose model, temperature, and max_completion_tokens/maxCompletionTokens in their idiomatic form (camelCase / LLMOptions struct).

Parameter	Type	Default	Description
`api_key`	`str`	`None`	Sarvam AI API key. Falls back to the `SARVAM_API_KEY` environment variable when unset.
`model`	`str`	`"sarvam-30b"`	Sarvam model used to generate replies.
`temperature`	`float`	`0.7`	Sampling randomness; lower is more deterministic.
`tool_choice`	`str`	`"auto"`	How the model decides when to call tools.
`max_completion_tokens`	`int`	`None`	Caps the length of each reply.
`reasoning_effort`	`str`	`None`	Reasoning depth: `"low"`, `"medium"`, or `"high"`.
`wiki_grounding`	`bool`	`False`	Enable Wikipedia search to ground responses.
`top_p`	`float`	`None`	Nucleus-sampling cutoff, as an alternative to `temperature`.
`frequency_penalty`	`float`	`None`	Penalizes frequent tokens (range -2.0 to 2.0).
`presence_penalty`	`float`	`None`	Penalizes tokens already present (range -2.0 to 2.0).
`stop`	`str`	`None`	Up to 4 sequences that halt generation.

Import paths

SDK	Import	Constructor
Python	`from zrt.plugins import SarvamAILLM`	`SarvamAILLM(...)`
JavaScript	`from '@zrt/js-sdk/plugins/sarvamai'`	`SarvamAILLM({ ... })`
Go	`.../zrt-golang-sdk/plugins/sarvamai`	`sarvamai.NewLLM(sarvamai.LLMOptions{...})`

The reply is streamed to the text-to-speech plugin, which synthesizes the agent’s voice.

Plugins

Inference Gateway

Speech-to-text

LLM

Text-to-speech

Realtime models

Avatars

Turn detection

Voice activity detection

Noise cancellation

Setup

Usage

Configuration Options

Import paths

​Setup

​Usage

​Configuration Options

​Import paths

Setup

Usage

Configuration Options

Import paths