Hand tracking for custom gestures

[mechmillan]

Hello, thanks for the great examples - this has been helpful.

Do you have plans to add / explore the new capabilities in ARKit around hand tracking? I'm curious if it's possible to run the simulator for hand-tracking without having the apple vision pro device itself - what is that experience like? I'm having trouble finding additional information about it online. Thanks!

[satoshi0212]

Unfortunately, at this time, the hand tracking feature cannot be tested without an Apple Pro device. We may need to try it on an actual device in the lab, win a Developer Kit, or wait until the actual device is released next year.

This is a side note, but some developers have implemented it using Meta Quest. However, I think this is a bit hacky.
https://x.com/mouri45/status/1730151268843500005?s=20

[AlohaYos]

Hi mechmillan,
Take a look at this repository.

https://github.com/AlohaYos/ProjectJarvis/tree/main/HandTrackingDemo