- RNNoise: a deep learning plugin that runs inside Zero Runtime.
- Inference providers: speech enhancement via the Zero Runtime Inference gateway (Sanas and AIcoustics).
RNNoise
The Zero Runtime Agents framework provides real-time audio denoising through theRNNoise plugin, which runs inside Zero Runtime. RNNoise uses deep learning to tell speech apart from noise. It:
- Removes background sounds like keyboard typing, air conditioning, and ambient noise.
- Improves speech clarity and speech-to-text accuracy.
- Processes audio in real time with minimal latency.
- Works with the
Pipelinein both cascading and realtime modes.
Pipeline as the denoise component:
Inference Providers
The Zero Runtime Inference gateway exposes denoise providers as theSanasDenoise and AICousticsDenoise classes. Import the one you want and pass it to your Pipeline as the denoise component.
- Sanas
- AIcoustics
SanasDenoise integrates Sanas for real-time speech enhancement and noise suppression. No required parameters.Choosing a Denoise Provider
Use RNNoise when you want a low-latency solution that runs inside Zero Runtime with no external dependencies. Use Sanas or AIcoustics when you prefer to route denoising through the Zero Runtime Inference gateway alongside your other components.
What’s Next
Turn Detection
Send clean audio to turn detection.
VAD and Interruptions
Feed clean audio into VAD next.