Resemble AI

Resemble AI is a text-to-speech plugin. It turns the LLM’s reply into audio the caller hears, using Resemble AI’s custom neural voice clones.

Setup

Set your Resemble AI API key in the worker environment. Generate a key from the Resemble AI dashboard:

export RESEMBLE_API_KEY=<key>

Usage

Import the plugin and pass it to the pipeline’s tts slot.

from zrt.plugins import ResembleTTS

tts = ResembleTTS()

# Pipeline(tts=tts, ...)

Parameters

Parameter	Type	Default	Description
`api_key`	`str \| None`	`None`	Resemble AI API key. Falls back to the `RESEMBLE_API_KEY` environment variable when unset.
`voice_uuid`	`str`	`"55592656"`	UUID of the Resemble AI voice (custom or pre-built) to use for synthesis. Retrieve voice UUIDs from the Resemble AI dashboard or the `/voices` API endpoint.
`sample_rate`	`int`	`22050`	Output audio sample rate in Hz.

Spoken replies support interruptions. When the caller talks over the agent, the runtime stops the audio and listens again. See the plugins overview for how TTS fits into the rest of the pipeline.

LMNT Rime

Plugins

Inference Gateway

Speech-to-text

LLM

Text-to-speech

Realtime models

Avatars

Turn detection

Voice activity detection

Noise cancellation

Setup

Usage

Parameters

​Setup

​Usage

​Parameters

Setup

Usage

Parameters