Today I’m going to show you how to build a minimal Xcode project that does hand and head tracking on VisionOS 1.0 and 1.1. Since there are no virtual hands in the Vision Pro simulator, you will need a real device to try this out.
We’re going to start from Andy Kong’s Hand and Head Tracking Demo on Github.
First, clone the project locally or download as ZIP.
Open it and double-click the HeadHandsDemo.xcodeproj file. This should launch Xcode, and you should select the “Trust and Open” option when prompted about security concerns.
You’ll need to set up the Vision Pro to connect to your computer. In the Vision Pro, navigate to General -> Settings -> Remote Devices, then follow the steps there. Afterwards, select your Vision Pro from the build targets dropdown. It should appear where I’m highlighting, but I do not have it connected at the moment.
The Vision Pro takes code uploads over WiFi, but your computer and the headset must be…
