Skip to main content

3D Hand Tracker

The 3D Hand Tracker object is designed to capture detailed hand movements in 3D space, enabling effects that closely follow hand and finger positions. It differs from the basic Hand Tracker by providing precise 3D tracking for both the left and right hands, each with their own skeletal structures and joint keypoints.

3d hand tacker demo

How 3D Hand Tracking Works​

Let's learn about the important concepts and terminology of 3D hand tracking:

  • Dual hand tracking: Separate tracking for the left and right hands, each with a full skeleton structure. Adding a single 3D Hand Tracker object includes both left and right hand trackers.
3d hand tacker in hierarchy
  • 3D finger keypoint tracking: Binds with the hand keypoints in the 3D model. Advanced tracking of specific points can be achieved with the 3D Hand Info node.
hand keypoint
  • Automatic bone binding: Automatically matches the 3D model skeleton to hand joints for seamless integration with custom models
  • Adjustable tracking parameters: Configure which hand to track, adjust tracking position, and enable or disable tracking

Add a 3D Hand Tracking Object​

To add a 3D Hand Tracking object:

  1. Go to the Hierarchy panel
  2. Click + Add object
  3. Go to AR Tracking
  4. Select 3D Hand Tracker
add 3D hand tracker

Example Use Cases​

The 3D Hand Tracker object can be effectively used in the following scenarios:

  • Creating interactive effects where hand movements drive animations or object transformations, similar to glove puppetry

  • With visual scripting, you can virtually try on items such as rings, bracelets, or gloves by overlaying 3D models onto a hand. To achieve this, use the 3D Hand Info node to capture the position and rotation of key hand points, then align your 3D object or brush tip with these coordinates for accurate placement and orientation on the hand.

Components​

The 3D Hand Tracker object is made up of the following components, found in the Inspector panel: