Skip to content

Allow background blur during video calls #5349

@rapterjet2004

Description

@rapterjet2004

Currently, the Web and iOS clients allow background blurring during video calls, but the Android app doesn't. iOS has this feature built into the SDK, but there is no equivalent for android.

One solution could be to use MediaPipe, an open source framework AI/ML with first class support for Android.

The light weight (250 KB), on device image segmentation model is available for commercial use (Apache License V2) here is more info about the model.

It would require capturing the camera frames using the MediaPipe in order to segment the image, blurring the background mask, and then passing the edited frames as a stream through WebRTC.

Due to hardware concerns, this feature should be off by default, and enabled in the more call actions dialog.

Metadata

Metadata

Assignees

Labels

1. to developAccepted and waiting to be taken care of (should be only set by nextcloud employees)enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions