OmniVoice Studio

The open-source ElevenLabs alternative.

Real-time dictation, zero-shot voice cloning, and cinematic video dubbing — all on your desktop.
Open-source, no API keys, fully local. 646 languages.

Quickstart · Features · Why OmniVoice Studio? · TTS Engines · Contributing · Discord

OmniVoice Studio — The open-source ElevenLabs alternative

Warning

OmniVoice Studio is in active beta. Things may break between releases. For the latest features and fixes, clone the repo and run from source rather than using pre-built installers. Bug reports and PRs are very welcome — open an issue or join Discord.

Features

🎙️ Voice Cloning 3-second clip → mirror any voice. 646 languages, zero-shot.	🎨 Voice Design Gender, age, accent, pitch, speed, emotion, dialect — dial it in.	🎬 Video Dubbing YouTube URL or file → transcribe → translate → re-voice → MP4.
⌨️ Dictation Widget `⌘+⇧+Space` from any app. Transcribes, auto-pastes, disappears.	🔊 Vocal Isolation Demucs-powered. Splits speech from music, keeps the background.	👥 Speaker Diarization Pyannote + WhisperX. Auto-identifies who said what.
📦 Batch Queue Drop 50 videos, walk away. Progress bars per job.	🤖 MCP Server Use OmniVoice from Claude, Cursor, or any MCP client.	🛡️ AI Watermark AudioSeal (Meta). Invisible, survives compression.
🔐 100% Local No keys, no cloud, no accounts. Your machine only.	⚡ GPU Auto-Detect CUDA · MPS · ROCm · CPU. ≤8 GB? Auto-offloads.	🧩 Extensible Subclass `TTSBackend`, add any engine in ~50 lines.

Quickstart

Pick your path — from zero-install to full developer setup:

🖥️ Desktop App

_{Easiest · ~2 min · No dependencies}

_{macOS DMG · Windows MSI · Linux AppImage/deb
Auto-bootstraps Python + models on first launch.}

🐳 Docker

_{One command · ~3 min · Needs Docker}

docker pull ghcr.io/debpalash/omnivoice-studio

_{Pre-built image from GHCR.
CPU + NVIDIA GPU supported.}

⚡ From Source

_{Full control · ~5 min · Needs Bun + Python}

git clone → bun install → bun run dev

_{Hot reload, full codebase access.
Best for contributors.}

🖥️ Option 1 — Desktop App

Pre-built installers (~6–8 MB) are on the Releases page. Download, install, launch. The app bootstraps a Python environment and downloads model weights automatically — the splash screen shows progress.

macOS — "app is damaged and can't be opened"

macOS quarantines apps downloaded outside the App Store. After dragging to /Applications:

xattr -cr /Applications/OmniVoice\ Studio.app

Open normally after. One-time fix.

Windows — first launch takes 5–10 minutes

The app bootstraps a Python virtual environment, installs dependencies, and downloads ffmpeg on first run. The splash screen shows each step. Subsequent launches start in seconds.

Linux — AppImage needs FUSE

If FUSE isn't available, use the .deb package or extract-and-run:

chmod +x OmniVoice.Studio_*.AppImage
./OmniVoice.Studio_*.AppImage --appimage-extract-and-run

Linux — White screen on Fedora 44 / Ubuntu 24.04

Some newer distros ship a WebKit/GTK version with compositing issues. Try:

WEBKIT_DISABLE_COMPOSITING_MODE=1 ./OmniVoice.Studio_*.AppImage

If that doesn't help, use the .deb package or run from source instead.

Installation fails behind a firewall / in Russia

The desktop app downloads Python from GitHub during first launch. If your network blocks GitHub:

Install Python 3.11 manually from python.org
Set UV_PYTHON_PREFERENCE=system before launching, or run from source with bun run dev
For PyPI mirrors: set UV_INDEX_URL=https://mirrors.aliyun.com/pypi/simple/

🐳 Option 2 — Docker

Pull the pre-built image from GitHub Container Registry:

docker pull ghcr.io/debpalash/omnivoice-studio:latest

Run it:

# CPU mode
docker run -d --name omnivoice \
  -p 127.0.0.1:3900:3900 \
  -v omnivoice-data:/app/omnivoice_data \
  ghcr.io/debpalash/omnivoice-studio:latest

# NVIDIA GPU mode
docker run -d --name omnivoice --gpus all \
  -p 127.0.0.1:3900:3900 \
  -v omnivoice-data:/app/omnivoice_data \
  ghcr.io/debpalash/omnivoice-studio:latest

Or use Docker Compose:

# CPU
docker compose -f deploy/docker-compose.yml up -d

# GPU
docker compose -f deploy/docker-compose.yml --profile gpu up -d

Open localhost:3900 once the health check passes. First run downloads ~4 GB of model weights — progress in docker compose logs -f.

Build from source instead of pulling

docker compose -f deploy/docker-compose.yml up --build -d

Network access: the container binds to 127.0.0.1 only. To expose on your LAN, change the port mapping to "0.0.0.0:3900:3900". OmniVoice ships no authentication — put it behind a reverse proxy with auth (Caddy basic_auth, nginx + htpasswd, Tailscale, etc.).

⚡ Option 3 — From Source

git clone https://github.com/debpalash/OmniVoice-Studio.git && cd OmniVoice-Studio
bun install && bun run dev

Open localhost:3901 and start cloning voices. Hot-reload enabled for both frontend and backend.

bun run desktop    # Build the native desktop app from source

Service	URL	Stack
Backend	`localhost:3900`	FastAPI · 97 endpoints · WhisperX · Demucs · OmniVoice
Frontend	`localhost:3901`	React · Vite · Waveform timeline · Glassmorphism UI
API Docs	`localhost:3900/docs`	Scalar — interactive API reference

Note

First run downloads model weights (~2.4 GB). No account needed. For faster downloads, optionally set HF_TOKEN=hf_... in your environment (get a free token here).

Having issues? Join our Discord for setup help and troubleshooting.

Screenshots

Voice Clone _{Drop a 3-second clip → mirror any voice. 646 languages, zero-shot.}	Voice Design _{Build new voices from scratch — gender, age, accent, pitch, style.}
Video Dubbing _{Upload or paste a YouTube URL. Transcribe, translate, re-voice, export.}	Voice Gallery _{Search YouTube, browse categories, download clips, build your library.}
Settings → Models _{15 models. One-click install. Auto-detects your platform (CUDA / MPS / CPU).}	Projects _{Dub projects, voice profiles, generation history, exports — all searchable.}
Settings → Logs _{Live backend, frontend, and Tauri runtime logs. Filter, refresh, clear.}

Why OmniVoice Studio?

ElevenLabs charges $5–$330/mo and processes your audio on their servers. OmniVoice Studio runs on your hardware, with no usage limits.

	ElevenLabs	OmniVoice Studio
Pricing	$5–$330/mo, per-character billing	Free for personal use · Commercial license for business
Voice Cloning	✅ 3s clip	✅ 3s clip, zero-shot
Voice Design	✅ Gender, age	✅ Gender, age, accent, pitch, style, dialect
Languages	32	646
Video Dubbing	✅ Cloud-only	✅ Fully local
Data Privacy	Audio sent to cloud	Nothing leaves your machine
API Keys	Required	Not needed
GPU Support	N/A (cloud)	CUDA · Apple Silicon · ROCm · CPU
Desktop App	❌	✅ macOS · Windows · Linux
Customizable	❌ Closed	✅ Fork it, extend it, ship it

OmniVoice Studio gives you professional-grade AI tools without the subscription or the cloud.

System Requirements

	Minimum	Recommended
OS	Windows 10, macOS 12+, Ubuntu 20.04+	Any modern 64-bit OS
RAM	8 GB	16 GB+
VRAM (GPU)	4 GB (auto-offloads TTS to CPU)	8 GB+ (NVIDIA RTX 3060+)
Disk	10 GB free (models + cache)	20 GB+ SSD
Python	3.10+ (managed by `uv`)	3.11–3.12
GPU	Optional — CPU works	NVIDIA CUDA · Apple Silicon MPS · AMD ROCm

Tip

On GPUs with ≤8 GB VRAM, OmniVoice automatically offloads TTS to CPU during transcription — no config needed. A dedicated GPU is not required; the entire pipeline runs on CPU (just slower).

TTS Engines

OmniVoice ships a multi-engine TTS backend. The default engine (OmniVoice) is always available; additional engines are opt-in and auto-detected. Switch engines in Settings → TTS Engine or via the OMNIVOICE_TTS_BACKEND env var.

Engine	Languages	Clone	Instruct	Linux	macOS ARM	Windows	License
OmniVoice (default)	600+	✅	✅	✅ CUDA/CPU	✅ MPS	✅ CUDA/CPU	Built-in
CosyVoice 3	9 + 18 dialects	✅	✅	✅ CUDA/CPU	✅ MPS	✅ CUDA/CPU	Apache-2.0
MLX-Audio (Kokoro, Qwen3-TTS, CSM, Dia, …)	Multi	Varies	Varies	❌	✅ Native	❌	Varies
VoxCPM2	30	✅	✅	✅ CUDA/CPU	✅ MPS	✅ CUDA/CPU	Apache-2.0
MOSS-TTS-Nano	20	✅	❌	✅ CUDA/CPU	✅ CPU	✅ CUDA/CPU	Apache-2.0
KittenTTS	English	❌	❌	✅ CPU	✅ CPU	✅ CPU	MIT

CUDA = GPU-accelerated · MPS = Apple Silicon Metal · CPU = runs everywhere, slower for large models · KittenTTS and MOSS-TTS-Nano run realtime on CPU · MLX-Audio is Apple Silicon only.

Architecture

┌─────────────────────────────────────────────────┐
│                  Frontend (React)                │
│  DubTab · VoicePreview · BatchQueue · Gallery    │
├─────────────────────────────────────────────────┤
│                Backend (FastAPI)                  │
│  97 API endpoints · SSE streaming · SQLite       │
├──────────┬──────────┬──────────┬────────────────┤
│ WhisperX │  Demucs  │OmniVoice │   Pyannote     │
│   ASR    │  Source  │   TTS    │  Diarization   │
│          │  Sep.    │          │                │
└──────────┴──────────┴──────────┴────────────────┘
        CUDA / MPS / ROCm / CPU (auto-detected)

Roadmap

✅ Shipped

Category	Features
Dubbing	Full pipeline (transcribe→translate→synthesize→mux), scene-aware splitting, lip-sync scoring, streaming TTS
Voice	Zero-shot cloning, voice design, A/B comparison, voice preview widget, gallery with favorites/tags
Audio	Demucs vocal isolation, per-segment gain, selective track export, stem/SRT/VTT/MP3 export
Multi-Lang	Multi-language batch picker, batch dubbing queue with sequential GPU execution
Diarization	Pyannote ML diarization, auto speaker clone extraction, per-speaker voice assignment
Infra	Docker deployment, CUDA/MPS/ROCm auto-detect, cuDNN 8 compat, VRAM-aware model offloading
AI Provenance	AudioSeal invisible watermarking (SynthID-like), video logo overlay, watermark detection API
UX	Undo/redo, keyboard shortcuts, drag-and-drop, session persistence, glassmorphism design system
Real-time Events	WebSocket event bus — instant sidebar refresh on data mutations, exponential backoff reconnect
State Management	Zustand store migration — `uiSlice`, `pillSlice`, `dubSlice`, `generateSlice`, `prefsSlice`, `glossarySlice`
Desktop	Cross-platform Tauri installers (macOS DMG, Windows MSI, Linux deb/AppImage), auto-update infrastructure
Windows Hardening	Cross-platform log paths, Triton workaround, HF symlink bypass, 300s health check timeout
Dictation	Global system-wide hotkey (`⌘+⇧+Space`), frameless floating widget, streaming ASR via WebSocket, auto-paste
Batch Pipeline	Full batch TTS: extract → transcribe → translate → generate → mix → export, with live progress tracking

🔜 Up Next

🎬 Lip-sync v2 — visual speech timing with wav2lip
📖 Audiobook Editor — chapter-aware long-form narration
🌐 Hosted Demo — try OmniVoice without installing anything
🔌 Plugin Marketplace — community-contributed TTS engines and effects

Contributing

We welcome contributions of all kinds — bug fixes, new TTS engine adapters, UI improvements, docs, and translations.

📖 Read the Contributing Guide for setup, code style, and PR workflow
🐛 Browse good first issues
💬 Join our Discord to discuss ideas or ask for help

FAQ

Is this really as good as ElevenLabs?

For voice cloning and dubbing, yes — OmniVoice uses a state-of-the-art diffusion TTS model with 646 languages (ElevenLabs supports 32). Quality is comparable for most use cases. Where ElevenLabs wins is in their polished cloud API and pre-made voice library. OmniVoice wins on privacy, cost, language coverage, and customizability.

Does it work on Apple Silicon (M1/M2/M3/M4)?

Yes. MPS acceleration is auto-detected. MLX-optimized Whisper models are available for faster transcription on Apple hardware.

How much VRAM do I need?

4 GB minimum. With ≤8 GB, the TTS model is automatically offloaded to CPU during transcription. With 8+ GB, everything runs on GPU simultaneously. No GPU at all? CPU mode works — just slower (~3× for TTS).

Can I use this commercially?

Personal, educational, internal-team, and non-commercial use is free under FSL-1.1-ALv2. Building a competing product or service on top of OmniVoice Studio requires a commercial license — see License. Pricing tiers coming soon. Each release converts to Apache 2.0 two years after publication.

What languages are supported?

646 languages for TTS via the OmniVoice model. Transcription (WhisperX) supports 99 languages. Translation coverage depends on the target language pair.

Can I add my own TTS engine?

Yes. OmniVoice uses a built-in backend registry. To add an engine in ~50 lines, subclass TTSBackend in backend/services/tts_backend.py and add it to the _REGISTRY dictionary at the bottom. Six engines are built in: OmniVoice, CosyVoice, MLX-Audio (14+ sub-engines), VoxCPM2, MOSS-TTS-Nano, and KittenTTS. See the TTS Engines section for details.

License

OmniVoice Studio is source-available under the Functional Source License (FSL-1.1-ALv2).

Free for personal, educational, research, internal team, and non-commercial use. Each release converts to Apache 2.0 automatically two years after publication.

Business / enterprise users building a competing product or service on top of OmniVoice Studio need a commercial license. Pricing tiers coming soon. For inquiries in the meantime, reach out at OmniVoice@palash.dev.

See LICENSE for the full terms.

Acknowledgments

OmniVoice Studio is built on the shoulders of exceptional open-source work:

Project	Role
OmniVoice (k2-fsa)	Zero-shot diffusion TTS engine — the core voice synthesis model
WhisperX	Word-level speech recognition and alignment
Demucs (Meta)	Music source separation for vocal isolation
Pyannote	Speaker diarization — who said what
CTranslate2	Optimized Transformer inference on CPU and GPU
AudioSeal (Meta)	Invisible neural audio watermarking for AI provenance
Tauri	Native desktop app framework

If you read this far, you're our kind of person.
⭐ Star this repo so others can find it too.

Name		Name	Last commit message	Last commit date
Latest commit History 143 Commits
.github		.github
.planning/codebase		.planning/codebase
backend		backend
deploy		deploy
design		design
docs		docs
examples		examples
frontend		frontend
omnivoice		omnivoice
research		research
scripts		scripts
tests		tests
.dockerignore		.dockerignore
.gitignore		.gitignore
.python-version		.python-version
CHANGELOG.md		CHANGELOG.md
CODE_OF_CONDUCT.md		CODE_OF_CONDUCT.md
CONTRIBUTING.md		CONTRIBUTING.md
LICENSE		LICENSE
README.md		README.md
SECURITY.md		SECURITY.md
alembic.ini		alembic.ini
backend.spec		backend.spec
bun.lock		bun.lock
package.json		package.json
pyproject.toml		pyproject.toml
turbo.json		turbo.json
uv.lock		uv.lock

Folders and files

Latest commit

History

Repository files navigation

OmniVoice Studio

The open-source ElevenLabs alternative.

Features

🎙️ Voice Cloning

🎨 Voice Design

🎬 Video Dubbing

⌨️ Dictation Widget

🔊 Vocal Isolation

👥 Speaker Diarization

📦 Batch Queue

🤖 MCP Server

🛡️ AI Watermark

🔐 100% Local

⚡ GPU Auto-Detect

🧩 Extensible

Quickstart

🖥️ Desktop App

🐳 Docker

⚡ From Source

🖥️ Option 1 — Desktop App

🐳 Option 2 — Docker

⚡ Option 3 — From Source

Screenshots

Why OmniVoice Studio?

System Requirements

TTS Engines

Architecture

Roadmap

✅ Shipped

🔜 Up Next

Contributing

FAQ

License

Acknowledgments

About

Resources

License

Code of conduct

Contributing

Security policy

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Uh oh!

Contributors

Uh oh!

Languages

Packages