Skip to content

Feature Request: Add SenseVoice/Paraformer as STT engine option #397

Description

@LauraGPT

Feature Request

Speech Note already supports multiple STT engines. Adding SenseVoice and Paraformer from FunASR would expand language coverage and improve performance.

Why

  • SenseVoice — 234M param non-autoregressive ASR, 50+ languages, very fast inference
  • Paraformer — excellent accuracy on Chinese, English, Japanese, Korean
  • Both are available via Sherpa-ONNX which already supports Linux desktop and Flatpak — ideal for Speech Note's distribution model
  • Built-in emotion detection and audio event classification
  • Fully offline after model download

Integration Path

The easiest integration would be through Sherpa-ONNX (5K+ stars), which provides:

  • C/C++ API suitable for dsnote's C++ codebase
  • Pre-built ONNX models for SenseVoice and Paraformer
  • Linux packages and Flatpak-friendly builds
  • Already used in production by multiple Linux apps

Models

Model Size Languages Speed
SenseVoiceSmall 234M 50+ 170x real-time (GPU)
Paraformer-large 220M zh/en/ja/ko/yue 160x real-time (GPU)

Happy to help with integration!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions