Skip to content

[DRAFT] Add PICO Body tracking support#365

Draft
BastiaanOlij wants to merge 1 commit into
GodotVR:masterfrom
BastiaanOlij:bytedance_body_tracking
Draft

[DRAFT] Add PICO Body tracking support#365
BastiaanOlij wants to merge 1 commit into
GodotVR:masterfrom
BastiaanOlij:bytedance_body_tracking

Conversation

@BastiaanOlij

Copy link
Copy Markdown
Member

This PR implements XR_BD_body_tracking extension, PICO's body tracking extension that is available for users who have purchased PICOs motion trackers.

It works similar to Metas body tracking and provides a completely posed skeleton for our avatar. The main difference is that we do not get hand tracking combined.

This is mostly working, the main issue is that a number of joints do not align with our humanoid character. With bone update mode set to "Rotation Only" the result is usable, but with positioning taken into account our lovely Kun deforms at the legs and around the neck/shoulder area:
image

Todos before this is merge-able:

  • Come up joint offset logic that will resolve the deformations.
  • Figure out why the hand joints aren't being animated (might be an issue on PICO side).
  • See if we can combine this with XRHandTracking to get posed hands and add that to the demo.
  • Combine the META and PICO body tracking demos into one demo that adds a bit of boiler plate logic to enable the right settings depending on what the tracker reports as supported.

@BastiaanOlij BastiaanOlij added this to the 4.x milestone Sep 18, 2025
@BastiaanOlij BastiaanOlij added the enhancement New feature or request label Sep 18, 2025
@BastiaanOlij BastiaanOlij force-pushed the bytedance_body_tracking branch 6 times, most recently from ce6b69e to dddb7a4 Compare January 7, 2026 01:26
@BastiaanOlij BastiaanOlij force-pushed the bytedance_body_tracking branch from dddb7a4 to d04bfca Compare January 7, 2026 01:35
@BastiaanOlij BastiaanOlij modified the milestones: 4.x, 5.x Jan 9, 2026
@dsnopek dsnopek changed the title Add PICO Body tracking support [DRAFT] Add PICO Body tracking support Jan 26, 2026
@m4gr3d m4gr3d added the Pico Label for Pico related issues / PRs label Apr 30, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request Pico Label for Pico related issues / PRs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants