HAND TRACKING IN ISNESS
Proof-of-concept implementation of META Quest 2 Hand Tracking
The hand tracking (available on the Meta Quest 2 headset) offers an exciting opportunity to increase our modes of molecular manipulation in VR. This mini-project directly employs the hand tracking in Isness to allow users to touch molecules by creating light with their bare hands.
Timeline of molecular manipulation
Originally our software employed traditional VR controllers, starting with the HTC Vive and the Valve Index controllers. We then created the open-source OMG-VR Mudra Gloves, which employ HTC trackers to track the position of the hand and a silver plated fabric circuit with pogo pins to detect pinches (see publications). Now, we show proof-of-concept for hand tracking as a mode of molecular manipulation in Isness.
Timeline of the modes with which users have been able to perform molecular manipulation in the Isness framework. See publications for more information on the OMG-VR Mudra gloves.
Next Steps
Current limitations of the Oculus hand tracking result in inaccurate pinch detection in certain hand positions, for example, due to ocular occlusion. We are in the process of improving pinch detection when using hand tracking in the Isness framework by
Hard-coding workarounds within the Isness software
Creating new hardware (see PinchGloves)
