Hand Tracking Sandbox
Vision Pro
Apple Vision Pro is a new technologie. While the majority of apps available are simple ports of the flat-experiences we already know on our smartphones, I'm convinced that the future is spatial and immersive.
HandTracking Sandbox is my first step into Spatial Computing Development. I wanted to understand 3D programming and unlock the possibilities of Apple Vision Pro.
I used ARKit and RealityKit frameworks to make a playful sandbox, where my physical environment can interact with generated virtual content.
ARKit
World Tracking
Determine the position and orientation of Vision Pro relative to its surroundings.
Hand Tracking
Use hand and finger positions as input for custom gestures and interactivity.
Scene Reconstruction
Build a mesh of the physical surroundings and incorporate it into the immersive space.
RealityKit
RealityView
Add 3D models, shape primitives, and sounds to an immersive space.
Physics
Make virtual entities interact with objects in the real-world.
Reality Composer Pro
A standalone software to preview, prepare, convert, and create spatial content.