Skip to content

Add finger landmarks (e.g. fingertips) to Body Pose Tracking #5884

Open
@antiero

Description

@antiero

MediaPipe Solution (you are using)

0.4

Programming language

JavaScript

Are you willing to contribute it

None

Describe the feature and the current behaviour/state

Would like to be able to access and track some finger landmarks, in conjunction with the body pose tracking. Ideally, this would be adding 10 additional landmarks to the Body, representing the hand finger tips.

Will this change the current API? How?

Yes, landmarks for body would be extended to include additional fingertip positions

Who will benefit with this feature?

The benefit is that you'd be able to do detection of pinches/grabs with the body pose tracker, without needing to also run a separate Hands pose tracking task.

Please specify the use cases for this feature

Pinch / Grab detection, allowing body pose tracker to detect when a person wants to move a virtual object or do something requiring activation/deactivation, e.g. virtual painting / musical expression / moving objects

Any Other info

No response

Metadata

Metadata

Assignees

Labels

platform:javascriptMediaPipe Javascript issuesstat:awaiting googlerWaiting for Google Engineer's Responsetype:featureEnhancement in the New Functionality or Request for a New Solution

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions