Voice & Speech AI Repositories

RTranslator

by niedev

Total Stargazers:10400

Total Subscribers:82

Open source real-time translation app for Android that runs locally

Amphion

by open-mmlab

Total Stargazers:10287

Total Subscribers:92

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

silero-vad

by snakers4

Total Stargazers:10200

Total Subscribers:73

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

RealtimeSTT

by KoljaB

Total Stargazers:10127

Total Subscribers:74

A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcription.

espnet

by espnet

Total Stargazers:9956

Total Subscribers:172

End-to-End Speech Processing Toolkit

LiveTalking

by lipku

Total Stargazers:9484

Total Subscribers:76

Real time interactive streaming digital human

pocket-tts

by kyutai-labs

Total Stargazers:9479

Total Subscribers:70

A TTS that fits in your CPU (and pocket)

so-vits-svc-fork

by voicepaw

Total Stargazers:9334

Total Subscribers:69

so-vits-svc fork with realtime support, improved interface and more features.

SenseVoice

by QwenAudio

Total Stargazers:9297

Total Subscribers:68

Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.

anarlog

by fastrepl

Total Stargazers:9290

Total Subscribers:37

Open source Granola AI Alternative

speech_recognition

by Uberi

Total Stargazers:8988

Total Subscribers:268

Speech recognition module for Python, supporting several engines and APIs, online and offline.

Bert-VITS2

by fishaudio

Total Stargazers:8801

Total Subscribers:54

vits2 backbone with multilingual-bert

VoiceCraft

by jasonppy

Total Stargazers:8577

Total Subscribers:97

Zero-Shot Speech Editing and Text-to-Speech in the Wild

audiblez

by santinic

Total Stargazers:8554

Total Subscribers:43

Generate audiobooks from e-books

EmotiVoice

by netease-youdao

Total Stargazers:8523

Total Subscribers:72

EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine

ASRT_SpeechRecognition

by nl8590687

Total Stargazers:8386

Total Subscribers:178

A Deep-Learning-Based Chinese Speech Recognition System 基于深度学习的中文语音识别系统

higgs-audio

by boson-ai

Total Stargazers:8350

Total Subscribers:60

Text-audio foundation model from Boson AI

Duix-Mobile

by duixcom

Total Stargazers:8231

Total Subscribers:306

🚀 The best real-time interactive AI avatar(digital human) with on-premise deployment and <1.5 s latency.

Vision-Agents

by GetStream

Total Stargazers:8122

Total Subscribers:53

Open Vision Agents by Stream. Build voice and vision agents quickly with any model or video provider. Uses Stream's edge network for ultra-low latency.

openwhispr

by OpenWhispr

Total Stargazers:8089

Total Subscribers:20

Voice-to-text dictation app with local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy-first and available cross-platform.

mlx-audio

by Blaizzy

Total Stargazers:7875

Total Subscribers:55

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

ChatTTS-ui

by jianchang512

Total Stargazers:7653

Total Subscribers:43

一个简单的本地网页界面，使用ChatTTS将文字合成为语音，同时支持对外提供API接口。A simple native web interface that uses ChatTTS to synthesize text into speech, along with support for external API interfaces.

voice-over-translation

by ilyhalight

Total Stargazers:7416

Total Subscribers:65

Смотрите видео на другом языке с закадровым переводом и субтитрами в любом браузере

vibe

by thewh1teagle

Total Stargazers:7413

Total Subscribers:47

Transcribe on your own!

openai-realtime-agents

by openai

Total Stargazers:6977

Total Subscribers:133

This is a simple demonstration of more advanced, agentic patterns built on top of the Realtime API.

xiaogpt

by yihong0618

Total Stargazers:6911

Total Subscribers:44

Play ChatGPT and other LLM with Xiaomi AI Speaker

espeak-ng

by espeak-ng

Total Stargazers:6827

Total Subscribers:112

eSpeak NG is an open source speech synthesizer that supports more than hundred languages and accents.

annyang

by TalAter

Total Stargazers:6815

Total Subscribers:229

💬 Speech recognition for your site

CapsWriter-Offline

by HaujetZhao

Total Stargazers:6789

Total Subscribers:35

PC 端语音输入工具，离线识别，高准确率、低延迟，支持热词、LLM润色。按住CapsLock或鼠标侧键X2说话，松开自动上屏。

mycroft-core

by MycroftAI

Total Stargazers:6614

Total Subscribers:5

Mycroft Core, the Mycroft Artificial Intelligence platform.

call-center-ai

by microsoft

Total Stargazers:6566

Total Subscribers:46

Send a phone call from AI agent, in an API call. Or, directly call the bot from the configured phone number!

MuseTalk

by TMElyralab

Total Stargazers:6547

Total Subscribers:68

MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting

podcastfy

by souzatharsis

Total Stargazers:6544

Total Subscribers:55

An Open Source Python alternative to NotebookLM's podcast feature: Transforming Multimodal Content into Captivating Multilingual Audio Conversations with GenAI

wav2letter

by flashlight

Total Stargazers:6437

Total Subscribers:237

Facebook AI Research's Automatic Speech Recognition Toolkit

VoiceInk

by Beingpax

Total Stargazers:6394

Total Subscribers:24

The best open-source alternative to Superwhisper & Wispr Flow. Voice-to-text app for macOS with no subscription

Bella

by Jackywine

Total Stargazers:6370

Total Subscribers:84

Bella is best

argmax-oss-swift

by argmaxinc

Total Stargazers:6362

Total Subscribers:46

On-device Speech AI for Apple Silicon

Orpheus-TTS

by canopyai

Total Stargazers:6335

Total Subscribers:73

Towards Human-Sounding Speech

neutts

by neuphonic

Total Stargazers:6277

Total Subscribers:58

On-device TTS model by Neuphonic

FunClip

by modelscope

Total Stargazers:6262

Total Subscribers:45

FunASR-powered video transcription, subtitle generation, and LLM-assisted clipping tool with a local Gradio UI.

RealChar

by Shaunwei

Total Stargazers:6214

Total Subscribers:57

🎙️🤖Create, Customize and Talk to your AI Character/Companion in Realtime (All in One Codebase!). Have a natural seamless conversation with AI everywhere (mobile, web and terminal) using LLM OpenAI GPT3.5/4, Anthropic Claude2, Chroma Vector DB, Whisper Speech2Text, ElevenLabs Text2Speech🎙️🤖

silero-models

by snakers4

Total Stargazers:6098

Total Subscribers:91

Silero Models: pre-trained text-to-speech models made embarrassingly simple

tts-vue

by LokerL

Total Stargazers:6097

Total Subscribers:42

🎤 微软语音合成工具，使用 Electron + Vue + ElementPlus + Vite 构建。

ecoute

by SevaSk

Total Stargazers:6050

Total Subscribers:65

Ecoute is a live transcription tool that provides real-time transcripts for both the user's microphone input (You) and the user's speakers output (Speaker) in a textbox.

abogen

by denizsafak

Total Stargazers:5984

Total Subscribers:31

Generate audiobooks from EPUBs, PDFs and text with synchronized captions.

whisper-diarization

by MahmoudAshraf97

Total Stargazers:5645

Total Subscribers:51

Automatic Speech Recognition with Speaker Diarization based on OpenAI Whisper

dograh

by dograh-hq

Total Stargazers:5637

Total Subscribers:44

Open source voice AI platform. Self-hosted alternative to Vapi and Retell. On Prem, BYOK across Speech to Speech or LLM/STT/TTS, with a visual workflow builder, MCP native and telephony support.

Recorder

by xiangyuecn

Total Stargazers:5631

Total Subscribers:84

html5 js 录音 mp3 wav ogg webm amr g711a g711u 格式，支持pc和Android、iOS部分Web浏览器、Hybrid App（提供Android iOS App源码）、微信，提供ASR语音识别转文字 H5版语音通话聊天示例 DTMF编码解码

piper1-gpl

by OHF-Voice

Total Stargazers:5541

Total Subscribers:50

Fast and local neural text-to-speech engine

YouDub-webui

by liuzhao1225

Total Stargazers:5465

Total Subscribers:35

Open-source AI video localization and dubbing for YouTube/Bilibili: speech recognition, subtitle translation, voice cloning, audio mixing and rendering. 开源 AI 视频翻译配音工具。

Kokoro-FastAPI

by remsky

Total Stargazers:5432

Total Subscribers:36

Dockerized OpenAI-compatible wrapper for Kokoro-82M text-to-speech w/multiplatform CPU, AMD, NVIDIA GPU PyTorch; multi-speaker, clone-tuning, caption timestamps, SSML, optional readalong web UI

LuxTTS

by ysharma3501

Total Stargazers:5378

Total Subscribers:39

A high-quality rapid TTS voice cloning model that reaches speeds of 150x realtime.

live-api-web-console

by google-gemini

Total Stargazers:2556

Total Subscribers:27

A react-based starter app for using the Live API over websockets with Gemini

VoiceMem

by xzf-thu

Total Stargazers:1427

Total Subscribers:37

Infrastructure for the next generation of voice agents, designed to provide universal memory. It is divided into a left brain and a right brain, storing information and emotions respectively, while a fully streaming architecture eliminates latency at the fundamental level.

athena

by athena-team

Total Stargazers:967

Total Subscribers:35

an open-source implementation of sequence-to-sequence based speech processing engine

deepgram-python-sdk

by deepgram

Total Stargazers:463

Total Subscribers:9

Voice & Speech AI

Speech recognition, text-to-speech, voice cloning and real-time voice agents.

RTranslator

by niedev

Open source real-time translation app for Android that runs locally

Amphion

by open-mmlab

Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

silero-vad

by snakers4

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

RealtimeSTT

by KoljaB

A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcription.

espnet

by espnet

End-to-End Speech Processing Toolkit

LiveTalking

by lipku

Real time interactive streaming digital human

pocket-tts

by kyutai-labs

A TTS that fits in your CPU (and pocket)

so-vits-svc-fork

by voicepaw

so-vits-svc fork with realtime support, improved interface and more features.

SenseVoice

by QwenAudio

Open-source SenseVoiceSmall model for Mandarin, Cantonese, English, Japanese, and Korean ASR, language ID, emotion recognition, and audio event detection.

anarlog

by fastrepl

Open source Granola AI Alternative

speech_recognition

by Uberi

Speech recognition module for Python, supporting several engines and APIs, online and offline.

Bert-VITS2

by fishaudio

vits2 backbone with multilingual-bert

VoiceCraft

by jasonppy

Zero-Shot Speech Editing and Text-to-Speech in the Wild

audiblez

by santinic

Generate audiobooks from e-books

EmotiVoice

by netease-youdao

EmotiVoice 😊: a Multi-Voice and Prompt-Controlled TTS Engine

ASRT_SpeechRecognition

by nl8590687

A Deep-Learning-Based Chinese Speech Recognition System 基于深度学习的中文语音识别系统

higgs-audio

by boson-ai

Text-audio foundation model from Boson AI

Duix-Mobile

by duixcom

🚀 The best real-time interactive AI avatar(digital human) with on-premise deployment and <1.5 s latency.

Vision-Agents

by GetStream

Open Vision Agents by Stream. Build voice and vision agents quickly with any model or video provider. Uses Stream's edge network for ultra-low latency.

openwhispr

by OpenWhispr

Voice-to-text dictation app with local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy-first and available cross-platform.

mlx-audio

by Blaizzy

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

ChatTTS-ui

by jianchang512

一个简单的本地网页界面，使用ChatTTS将文字合成为语音，同时支持对外提供API接口。A simple native web interface that uses ChatTTS to synthesize text into speech, along with support for external API interfaces.

voice-over-translation

by ilyhalight

Смотрите видео на другом языке с закадровым переводом и субтитрами в любом браузере

vibe

by thewh1teagle

Transcribe on your own!

openai-realtime-agents

by openai

This is a simple demonstration of more advanced, agentic patterns built on top of the Realtime API.

xiaogpt

by yihong0618

Play ChatGPT and other LLM with Xiaomi AI Speaker