feat(voice): pluggable voice backend with Gemini Live & Qwen Realtime#692

Merged

tiann merged 34 commits into

heavygee:feat/pluggable-voice-backend

Jun 4, 2026

Commits on Jun 3, 2026

feat(voice): pluggable voice backend with Gemini Live & Qwen Realtime
heavygee
committed
fix(voice): restore user mic mute state after Gemini turn completes
heavygee
committed
fix(voice): remove hard-coded Chinese language from Gemini backend
heavygee
committed
fix(voice): reset modelSpeaking in cleanup to unblock mic on restart
heavygee
committed
fix(voice): guard stale close handlers in Gemini and Qwen sessions

heavygee
and
HAPI
committed
fix(voice): remove hard-coded Chinese language from Qwen backend

heavygee
and
HAPI
committed
feat(voice): proactive/reactive toggle in voice settings

heavygee
and
HAPI
committed
fix(voice): normalize WS close codes, drop barrel re-exports, fix SSE visibility

heavygee
and
HAPI
committed
fix(voice): respect language setting in Gemini/Qwen; fix voice-start toggle label

heavygee
and
HAPI
committed
fix(voice): send greeting trigger in reactive mode for Gemini

heavygee
and
HAPI
committed
fix(voice): suppress Gemini self-identification and context leak in greeting

heavygee
and
HAPI
committed
fix(voice): address code review findings — error handling, proxy, audio

heavygee
and
HAPI
committed
fix(voice): trailing-slash WS URL, Qwen session.update schema

heavygee
and
HAPI
committed
fix(voice): await audio capture before setMuted; sanitize upstream close codes

heavygee
and
HAPI
committed
fix(voice): wrap startAudioCapture in try/catch to propagate mic errors

heavygee
and
HAPI
committed
fix(voice): propagate backend discovery failure instead of silently falling back to ElevenLabs

heavygee
and
HAPI
committed
fix(voice): throw on unrecognised backend value instead of silently falling back to ElevenLabs

heavygee
and
HAPI
committed
fix(voice): add Qwen greeting/proactive trigger; fix socket buffer for base64 uploads

heavygee
and
HAPI
committed
fix(voice): replace unsupported conversation.item.create with session.update for Qwen text

heavygee
and
HAPI
committed
fix(voice): guard session.updated re-entry and reset config on session start

heavygee
and
HAPI
committed
fix(voice): assert wsUrl presence for Gemini proxy connections

heavygee
and
HAPI
committed
fix(voice): correct Qwen audio formats and default voice

heavygee
and
HAPI
committed
fix(voice): close AudioContext on failed voice session start

heavygee
and
HAPI
committed
chore: restore non-voice files to upstream/main state
heavygee
committed
fix(voice): harden Gemini and Qwen WS proxies against client abuse

heavygee
and
cursoragent
committed
fix(voice): harden Qwen proxy — hub-owned setup, client frame allowlist
heavygee
committed
fix(voice): respect Qwen session.created→session.update protocol ordering
heavygee
committed
fix(voice): use Realtime tool shape for Qwen session.update (not chat-completions)
heavygee
committed
fix(voice): update Qwen Realtime model, voice, and endpoint for intl service
heavygee
committed
fix(voice): correct Qwen text injection and generalise language handling
heavygee
committed
fix(hub): gate Gemini client frames until upstream setupComplete

heavygee
and
HAPI
committed
fix(hub): cap Gemini setup-window pending queue at 1 MiB

heavygee
and
HAPI
committed
fix(gemini): pass all language codes to hub proxy, not just zh

heavygee
and
HAPI
committed
fix(voice): expand LANGUAGE_NAMES to cover full ElevenLabs language set

heavygee
and
HAPI
committed