epic: Initial ASR Model selection for Jan #6
Description
User goal or learning goal
Quick summary of the user goal or learning goal.
Select an open source ASR model that can be deployed into production for Jan Server
Not in Scope
Training a new ASR model
Running ASR locally
Approach
Literature review
- Select ASR benchmarks relevant to Jan users
- Determine a good inference benchmark methodology in collaboration with Jan-Server team
Experiments
Benchmark the following models
- Whisper
- Nvidia-Parakeet
- Nvidia-Canary
Evaluation
- Evaluate perfromance and inference costs tradeoffs
Translation
- Deploy with Jan-Server