Skip to content
Arthur Nishimoto edited this page Jul 24, 2014 · 5 revisions

Last revision: ver. 5.0 - 21 July 2014

Uses the Microsoft Kinect for Windows SDK to access joint and (eventually) speech recognition data. Kinect v2.0 support is currently in development and is not in the current public build.

Generated events

  • Service type: Mocap
  • Event types: Update
  • Event data fields: position (head) and extraData float array containing joint position

Common Mocap Event Fields

  • timestamp:
  • sourceID: Skeleton / body ID
  • serviceID:
  • serviceType: Mocap
  • type: Update
  • flags: 0 (not used)
  • position: x, y, z of the skeleton's head
  • orientation: not used

Extra Data Fields

The following table shows the ExtraData Vector3 index mapping to the current supported skeleton tracking systems (OpenNI and Kinect for Windows v1.x and v2.0). Index values not supported by the current service will return a Vector3(0,0,0).

ExtraDataVector3 index MSKinect2Service (SDK v2.0) OpenNIService MSKinectService (SDK v1.x)
0 JointType_SpineBase --- NUI_SKELETON_POSITION_HIP_CENTER
1 JointType_Head XN_SKEL_HEAD NUI_SKELETON_POSITION_HEAD
2 JointType_Neck XN_SKEL_NECK ---
3 --- XN_SKEL_TORSO ---
4 --- XN_SKEL_WAIST ---
5 --- XN_SKEL_LEFT_COLLAR ---
6 JointType_ShoulderLeft XN_SKEL_LEFT_SHOULDER NUI_SKELETON_POSITION_SHOULDER_LEFT
7 JointType_ElbowLeft XN_SKEL_LEFT_ELBOW NUI_SKELETON_POSITION_ELBOW_LEFT
8 JointType_WristLeft XN_SKEL_LEFT_WRIST NUI_SKELETON_POSITION_WRIST_LEFT
9 JointType_HandLeft XN_SKEL_LEFT_HAND NUI_SKELETON_POSITION_HAND_LEFT
10 JointType_HandTipLeft XN_SKEL_LEFT_FINGERTIP ---
11 JointType_HipLeft XN_SKEL_LEFT_HIP NUI_SKELETON_POSITION_HIP_LEFT
12 JointType_KneeLeft XN_SKEL_LEFT_KNEE NUI_SKELETON_POSITION_KNEE_LEFT
13 JointType_AnkleLeft XN_SKEL_LEFT_ANKLE NUI_SKELETON_POSITION_ANKLE_LEFT
14 JointType_FootLeft XN_SKEL_LEFT_FOOT NUI_SKELETON_POSITION_FOOT_LEFT
15 --- XN_SKEL_RIGHT_COLLAR ---
16 JointType_ShoulderRight XN_SKEL_RIGHT_SHOULDER NUI_SKELETON_POSITION_SHOULDER_RIGHT
17 JointType_ElbowRight XN_SKEL_RIGHT_ELBOW NUI_SKELETON_POSITION_ELBOW_RIGHT
18 JointType_WristRight XN_SKEL_RIGHT_WRIST NUI_SKELETON_POSITION_WRIST_RIGHT
19 JointType_HandRight XN_SKEL_RIGHT_HAND NUI_SKELETON_POSITION_HAND_RIGHT
20 JointType_HandTipRight XN_SKEL_RIGHT_FINGERTIP ---
21 JointType_HipRight XN_SKEL_RIGHT_HIP NUI_SKELETON_POSITION_HIP_RIGHT
22 JointType_KneeRight XN_SKEL_RIGHT_KNEE NUI_SKELETON_POSITION_KNEE_RIGHT
23 JointType_AnkleRight XN_SKEL_RIGHT_ANKLE NUI_SKELETON_POSITION_ANKLE_RIGHT
24 ointType_FootRight XN_SKEL_RIGHT_FOOT NUI_SKELETON_POSITION_FOOT_RIGHT
25 JointType_SpineMid --- NUI_SKELETON_POSITION_SPINE
26 JointType_SpineShoulder --- NUI_SKELETON_POSITION_SHOULDER_CENTER
27 JointType_ThumbLeft --- ---
28 JointType_ThumbRight --- ---

Configuration parameters

  • updateInterval (float): the delay time in seconds between polling for new data (default: 0.01)
Clone this wiki locally