forked from sebomaniac/lingobuddy
-
Notifications
You must be signed in to change notification settings - Fork 0
Open
Description
Add a transcription to the live conversation. Fetch the text from the STT and TTS in the backend, and display it in the frontend. No need for much styling.
Frontend:
- LiveConversation.js component: https://github.com/uclaacm/lingobuddy/blob/main/frontend/src/components/LiveConversation.js
- [language][level]page: https://github.com/uclaacm/lingobuddy/blob/main/frontend/src/app/lessons/%5Blanguage%5D/%5Blevel%5D/page.js
Backend:
These files have been added/changed to allow the user to receive live translation into english by talking:
- record themselves talking
- send that audio blob to the backend
- process it in a STT -> LLM (translation into English) -> TTS pipeline in the backend
- send translated audio blob back to frontend
- plays audio blob to user
Metadata
Metadata
Assignees
Labels
No labels
