Skip to content

Added support for High fidelity (hi-fi) audio capture #1564

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 22 commits into
base: develop
Choose a base branch
from
Open

Added support for High fidelity (hi-fi) audio capture #1564

wants to merge 22 commits into from

Conversation

@PratimMallick
Copy link
Contributor

@PratimMallick PratimMallick commented Nov 4, 2025 •
edited
Loading

Goal

This PR adds support for HiFi (high-fidelity) audio in the Stream Video Android SDK, enabling users to choose a certain type of audio profile before joining the call.
This enhancement allows applications to provide better audio quality for music streaming, podcast calls, or any scenario requiring higher audio fidelity

Implementation

  1. Audio Bitrate Profile Support (MediaManager.kt):

    • Added audioBitrateProfile StateFlow in MicrophoneManager to track current audio profile
    • Implemented setAudioBitrateProfile() method that validates:
      • HiFi audio must be enabled in dashboard settings to use MUSIC_HIGH_QUALITY
      • Profile can only be changed before joining a call
    • Added AudioBitrateProfile enum support with VOICE_STANDARD_UNSPECIFIED and MUSIC_HIGH_QUALITY options

  2. Peer Connection Factory Refactoring (StreamPeerConnectionFactory.kt):

    • Refactored factory creation to accept audioBitrateProfileProvider function, which enables it to turn off hardware AEC, NS
    • Factory is recreated when audio profile changes (before joining)

  3. Call State Management (Call.kt):

  • Added ensureFactoryMatchesAudioProfile() to validate factory matches current profile
  • Implemented recreateFactoryAndAudioTracks() to rebuild factory and tracks. This is needed if app has to provide a toggle in Lobby screen, where intial factory is already created with the default audioProfile
  • Made video/audio tracks and sources nullable and lazy-initialized for proper recreation
  • Shared EGL base context between factory and media manager to break circular dependency

  1. UI Components (ToggleHifiAudioAction.kt):

    • New composable action button for toggling HiFi audio
    • Integrates with CallAction system via ToggleHifiAudio action
    • Provides visual feedback with music note icons (MusicNote/MusicOff)

  2. Demo App Integration:

    • Added HiFi audio toggle in CallLobbyScreen and CallScreen

🎨 UI Changes

Screenshot_20251105_122805

Testing

  1. HiFi Audio Toggle:
    • Start a call from the demo app
    • Use the music note icon button in call controls to toggle HiFi audio
    • Verify that the publishing bitrate of audio is 128 kbps,
    • Verify that remote audio is looped back and sent again creating an echo which denotes that AEC is turned off
    • If you can, then play an instrument of your choice and observe the quality on the other side. The high notes should not be cut off denoting , both NS and AGC are turned off

PratimMallick and others added 19 commits October 16, 2025 09:33
@PratimMallick
Update to latest proto
383e41d
@PratimMallick
Send stereo = true in Audio track's TrackInfo if hifi is enabled in d…
8a48b85 
…ashboard
@PratimMallick
fix: microphone not getting enabled if we join with USAGE_MEDIA mode
f5d513f
@PratimMallick
Merge branch 'develop' of github.com:GetStream/stream-video-android i…
576f342 
…nto hifi_audio
@PratimMallick
Provide a way to set the audio usage from app to call.speaker - it ca…
379ee0f 
…n be either VOICE_COMMUNICATION or MEDIA
@PratimMallick
Provide a way on the debug option menu to switch between usage_media …
ed1a969 
…and usage_voice_communication
@PratimMallick
Expose the audioDeviceModule from peerConnectionFactory
1ef32b9
@PratimMallick
Apply spotless
16e8e8a
@PratimMallick
Upgraded to webrtc version that supports switching audio usage mid call
2ddc7b7
@PratimMallick
api dump
a8690a8
@PratimMallick
Merge branch 'develop' of github.com:GetStream/stream-video-android i…
e6b9abd 
…nto hifi_audio
@PratimMallick
Dont send stereo = true in trackInfo while publishing. This will be d…
503c9d7 
…one when adding stereo capture to recording feature
@PratimMallick
Added unit tests to test the audioUsage stateFlow of SpeakerManager
bbbbf2b
@aleksandar-apostolov
Merge branch 'develop' into hifi_audio
ace13ef
@aleksandar-apostolov
Merge branch 'develop' into hifi_audio
789ad8b
@PratimMallick
refactor(demo-app): simplify onToggleAudioUsage by removing suspend m…
57bba73 
…odifier
@PratimMallick
Merge remote-tracking branch 'origin/hifi_audio' into hifi_audio
b755b0a
@PratimMallick
Fix: setAudioUsage of speakerManager does not work if called before…
f96d3ec 
… any remote track has come in. Updated to webrtc which has the fix for this.
@PratimMallick
Added : Enable Hifi audio recording
accddc9
@PratimMallick PratimMallick requested a review from a team as a code owner November 4, 2025 13:49
@PratimMallick PratimMallick marked this pull request as draft November 4, 2025 13:50
@PratimMallick
Merge branch 'develop' of github.com:GetStream/stream-video-android i…
b52e65b 
…nto hifi_audio

# Conflicts:
#	stream-video-android-core/api/stream-video-android-core.api
#	stream-video-android-core/src/main/kotlin/io/getstream/video/android/core/MediaManager.kt
#	stream-video-android-core/src/main/kotlin/io/getstream/video/android/core/call/connection/StreamPeerConnectionFactory.kt
@github-actions
Copy link
Contributor

github-actions bot commented Nov 4, 2025 •
edited
Loading

PR checklist ✅

All required conditions are satisfied:

  • Title length is OK (or ignored by label).
  • At least one pr: label exists.
  • Sections ### Goal, ### Implementation, and ### Testing are filled.

🎉 Great job! This PR is ready for review.

@github-actions
Copy link
Contributor

github-actions bot commented Nov 4, 2025 •
edited
Loading

SDK Size Comparison 📏

SDK Before After Difference Status
stream-video-android-core 11.91 MB 11.91 MB 0.00 MB 🟢
stream-video-android-ui-xml 5.68 MB 5.68 MB 0.00 MB 🟢
stream-video-android-ui-compose 6.25 MB 6.27 MB 0.02 MB 🟢

@PratimMallick
Make setters for audio,video and screenshare tracks so that they dont…
de3d61f 
… come under breaking change

Make eglbase optional param while creating StreamPeerConnectionFctory so that it doesnt come under breaking change
@PratimMallick PratimMallick changed the title hifi_audio Added support for High fidelity (hi-fi) audio capture Nov 5, 2025
@PratimMallick PratimMallick added the pr:new-feature Adds new functionality label Nov 5, 2025
@PratimMallick PratimMallick marked this pull request as ready for review November 5, 2025 07:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@rahul-lohra rahul-lohra Awaiting requested review from rahul-lohra

@aleksandar-apostolov aleksandar-apostolov Awaiting requested review from aleksandar-apostolov

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

pr:new-feature Adds new functionality

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@PratimMallick @aleksandar-apostolov