Speech Recognition Model & Transcription Engine

whisper · score 9.3 · voice, ml-models
Complete speech-to-text system with audio processing, multilingual support.

Twilio Webhook Handler

openclaw-voice-call-realtime · score 8.8 · integration, webhooks, twilio, request-signature-validation, voice
Request validation and parsing for incoming Twilio webhooks.

OpenAI Realtime Conversation

openclaw-voice-call-realtime · score 8.7 · voice, openai-realtime, audio-streaming, voice-conversation, ai
Implements the OpenAI Realtime API for voice conversation with audio streaming.

Managed Realtime Conversation

openclaw-voice-call-realtime · score 8.7 · voice, audio-streaming, bidirectional-audio, realtime-bridge, voice-orchestration
Orchestrates bidirectional audio streaming between telephony and AI providers.

resamplePcmTo8k (telephony-audio.ts)

openclaw-voice-call-realtime · score 8.7 · audio-resampling, pcm-conversion, telephony-audio, linear-interpolation, voice
Resamples 16-bit PCM audio to 8kHz telephony sample rate using linear interpolation.

VoicetestLLM (livekit_adapter.py)

voicetest · score 8.6 · livekit-integration, ai, conversation-engine, voice-ai, voice
LiveKit LLM plugin that delegates to ConversationEngine. This module provides VoicetestLLM, a LiveKit-compatible LLM that uses the same ConversationEngine as the test runner. This

TranscriptSegment

parley · score 8.3 · voice, data-model, transcript, immutable
Immutable transcript segment with start time, end time, and text content.

normalizePhone (phone.js)

ai-voice-agent · score 8.3 · phone-normalization, e164-format, indian-phone, voice
Indian-phone normalization. Shopify checkout returns phones in many shapes: +91 98765 43210 (formatted E.164) 919876543210 (no plus, with country code) 09876543210 (leading zero, n

initiateCall (outbound.ts)

openclaw-voice-call-realtime · score 8.3 · outbound-calling, voice, call-state-management, timer-management
Initiates outbound calls through a telephony provider, handling state management, configuring duration and transcript timers, and persisting call records.

validateTwilioSignature (webhook-security.ts)

openclaw-voice-call-realtime · score 8.3 · voice, hmac-sha1, signature-validation, replay-prevention, webhook-security
Validates Twilio webhook signatures using HMAC-SHA1 with replay attack prevention through time-windowed request caching.

normalise (states.py)

zvonok · score 8.2 · voice
The canonical status vocabulary. call-api owns it; everything else is a dialect. The voice agent has its own words for how a call ended (`goal_achieved`, `no_audio`, `abandoned`, `

isDnd (dnd.js)

ai-voice-agent · score 8.2 · telecom-compliance, dnd-enforcement, time-window-restriction, voice
Do-Not-Disturb window enforcement for Indian telecom compliance. TRAI (Telecom Regulatory Authority of India) restricts commercial voice calls to 09:00–21:00 IST. Calling outside t

CallInitiateModel (call.py)

call-center-ai · score 8.2 · call-orchestration, pydantic-models, api-schemas, voice
Pydantic model validating call initiation requests with a phone number field, extending a workflow initiate model for call orchestration.

Terminator (agent.py)

zvonok · score 8.2 · voice, voice-agent, llm-agent, pstn-calls, goal-directed
zvonok voice agent — one goal-directed outbound PSTN call per job. Dispatched with metadata: {"number": "+34...", "goal": "...", "language": "en", "caller_id": "+44...", "max_durat

AI Protocol Adapter Suite

mod_earshot · score 8.2 · integration, llm-rag, voice, protocol-adapters, speech-to-text
Ten protocol adapters (OpenAI Realtime, Deepgram Voice Agent, Twilio Media Streams, ElevenLabs, Gemini Live, Pipecat, Vapi, AssemblyAI, Cartesia, Native) handling wire-format negot

Call State Machine

openclaw-voice-call-realtime · score 8.1 · voice, state-machine, call-lifecycle
State machine managing lifecycle transitions for active phone calls.

VibeVoiceASRProcessor (vibevoice_asr_processor.py)

VibeVoice · score 8.1 · voice, speech-recognition, asr-model, transcription
Processor class for VibeVoice ASR models.

Voice Gateway Session Service (voice-gateway/session-service.ts)

NemoClaw · score 8.1 · voice, Voice / Speech, gateway, session, authentication
Controls voice session lifecycle, validates runtime values, grants, and handles turn state for voice interactions.

Modular ASR Interface

VibeVoice · score 8.1 · voice, speech-recognition, model-integration, transcription
Abstract speech recognition interface providing flexible model integration and transcription methods.

identity_for (prompts.py)

zvonok · score 8.1 · voice, prompt-management, llm-prompts, identity-disclosure, compliance-text
Everything the agent says, and everything that checks it said it. Two kinds of text live here and they are not the same kind of thing: FIXED TEXT — the disclosure and the probe. Sp

TwilioService (provider/twilio.provider.ts)

sms-server-template · score 8.0 · voice, Voice / Speech
Module exposing: TwilioService, TwilioPackage

tool (RealtimeVoice.swift)

iOS-vibebuddy · score 7.9 · realtime, speech-to-speech, multi-provider, real-time-voice, voice
Provides a provider-agnostic protocol and events for real-time speech-to-speech voice sessions, supporting multiple backends including Qwen, Gemini, and OpenAI Realtime.

getTtsAdapter (index.js)

9router · score 7.9 · voice, tts-providers, provider-registry, voice-adapter, integration
TTS provider registry

resolveVoiceCallConfig (config.ts)

openclaw-voice-call-realtime · score 7.9 · voice, config-resolution, env-validation
Resolves and returns validated voice call configuration settings from environment or runtime sources.

Real-time voice call pipeline

hal-answering-service · score 7.9 · ai, vad, stt, tts, barge-in
Orchestrates VAD→STT→LLM→TTS pipeline with barge-in, silence detection, call recording, and ntfy push notifications. The core brain of a real-time voice AI.

TwilioProvider (twilio.ts)

openclaw-voice-call-realtime · score 7.8 · voice, twilio-integration, twiml, webhook-handler, call-normalization
Provides Twilio voice call integration handling outbound/inbound calls, webhook verification, TwiML responses, and call status normalization for telephony applications.

VoiceRecorder.tsx

prank-your-dad · score 7.8 · ui, audio-recording, microphone-permissions, webm-encoding, blob-upload
Records user audio via mic, encodes to webm/blob, handles permissions, uploads backend.

wavDecoder.ts

electron-speech-to-speech · score 7.8 · wav-decoding, audio-decoding, audio-processing, voice
https://github.com/mohayonao/wav-decoder

LuxTTS Voice Cloning Backend (backends/luxtts_backend.py)

voicebox · score 7.8 · unclassified, voice, tts, voice-cloning, luxtts
Async text-to-speech backend wrapping the LuxTTS (ZipVoice) model for zero-shot voice cloning with 48kHz output. Reuse it as a pluggable TTS engine with device selection, cached vo

Audio Effects Preset List (EffectsTab/EffectsList.tsx)

voicebox · score 7.8 · ui, UI / Frontend, voice, react, tanstack-query
React list pane that loads effect presets through React Query and shows them as selectable cards. Includes creation and selection state via a Zustand store. Reuse it for preset bro

TTS abstraction (multi-backend)

matrix-voip-agent · score 7.8 · ai, tts, voice-synthesis, streaming-audio, elevenlabs
Unified TTS interface supporting ElevenLabs (cloud), OpenAI-compatible TTS servers (e.g. qwen3-tts-server with streaming PCM), and local TTS sidecars. Streaming vs buffered synthes

VoiceParticipant (participant.py)

voicetest · score 7.8 · voice, voice-pipeline, livekit-integration, stt-llm-tts, session-builder
Voice participant builders for live calls. A VoiceParticipant produces a LiveKit AgentSession for one side of a call. Cascade (STT -> LLM -> TTS) is the only implementation today.

CallGraph

callpilot · score 7.8 · voice, call-lifecycle, state-machine, signaling, kotlin
Kotlin call state graph managing call lifecycle transitions and signaling events.

G.711 Audio Codec Library

mod_earshot · score 7.8 · voice
Pure C G.711 mu-law/a-law encoder/decoder and L16 linear PCM utilities with canonical ITU algorithms. No external dependencies, fully unit-tested off-platform.

Temporary Message Accumulator (agent/temporary_message_accumulator.py)

MIRIX · score 7.8 · ai, AI / Agents, message, accumulator, voice
Collects and processes transient messages like screenshots, voice clips, and text for ingestion into agent memory pipelines.

startPrankCall (api.ts)

prank-your-dad · score 7.7 · voice
Initiates Twilio voice calls, returns call/summary responses, and handles API errors via typed client.

should_observe (observer_mount.py)

voicetest · score 7.7 · audio-transcription, room-observer, livekit-integration, voice
Wire a room observer to transcribe one participant's published audio. Generalizes the per-worker self-observer: given the identity of the participant to watch and the role to attri

Platform Registry

voicetest · score 7.7 · voice, plugin-registry, voice-platforms, integration-discovery, integration
Centralized registry for discovering and registering voice platform integrations.

Apple Speech/Transcription/Embeddings Native Bridge

ai · score 7.7 · voice, integration
packages/apple-llm/ios wraps SpeechAnalyzer, AVSpeechSynthesizer, and NLContextualEmbedding behind AI SDK interfaces. Relevant to CobaltCall voice work on iOS with zero per-minute

processEvent (events.ts)

openclaw-voice-call-realtime · score 7.7 · event-processing, inbound-policy, call-lifecycle, allowlist, voice
Processes incoming call events, enforcing inbound policies (allowlist, open, disabled) and coordinating call lifecycle transitions including acceptance, rejection, and state persis

VoiceSessionBrokerError (voice_session_broker.py)

QuickVoice · score 7.7 · livekit-integration, webrtc-dispatch, voice-broker, session-orchestration, voice
Custom exception for voice session broker operations, indicating failures during LiveKit dispatch creation or session orchestration.

RTPSession

sip-to-ai · score 7.7 · integration, rtp-protocol, audio-codec, asyncio, drift-correction
Pure asyncio RTP protocol implementation with G.711 μ-law codec support and precise 20ms frame timing with drift correction. Complete RTP session management for bidirectional audio

buildInboundAcceptor (runtime.ts)

openclaw-voice-call-realtime · score 7.7 · voice, inbound-calls, runtime-builder, webhook-config, lifecycle-management
Creates a voice call runtime for accepting inbound calls from telephony providers, configuring webhooks, tunnels, and lifecycle management.

Voice Gateway Serve Action (voice-gateway/serve.ts)

NemoClaw · score 7.7 · voice, Voice / Speech, gateway, http, server
Starts the HTTP server for the voice gateway, validates configuration, and manages lifecycle signals for graceful shutdown.

GrokTtsEditor

sexyvoice · score 7.7 · ui, tiptap-extension, ai-suggestions, tts-toolbar, editor-toolbar
Tiptap extension providing AI-powered TTS suggestions and editing toolbar.

ErrorCategory (service_main.py)

sample-voice-agent · score 7.7 · voice, voice-pipeline, http-server, async-pool, fargate-service
Service mode entrypoint for Pipecat voice pipeline. Runs an async HTTP server that accepts call requests, allowing the container to stay warm and handle multiple calls without cold

EngineConfig (engine.rs)

call-translator · score 7.7 · voice, pipeline-coordination, audio-routing, stt-tts-translation, realtime
Main engine coordinator. ! ! Two pipelines: ! OUTGOING: Mic -> Deepgram(ru) -> Translate(ru->en) -> TTS(en) -> Speakers ! INCOMING: BlackHole 16ch -> Deepgram(en) -> Translate(en->

AIVtuberBrain (brain.py)

projectBEA · score 7.7 · voice, agent-orchestration, composition-root, tts-integration, obs-integration
Composition root orchestrating perception, consciousness, skill surfaces, and output interfaces (TTS/STT/OBS) for an AI vtuber system.

ProviderNameSchema (types.ts)

openclaw-voice-call-realtime · score 7.6 · voice, zod-schema, provider-enum, type-validation
Defines a Zod schema enumerating supported telecom providers (telnyx, twilio, plivo, mock) for a voice application.

RealtimeSalesAgent (agent.py)

CallAgent · score 7.5 · ai, realtime-voice, voice-activity-detection, audio-processing, agent-orchestration
Runs real-time voice sales conversations with configurable voice activity detection, multi-format audio support, and tool-enabled interactions.