Facebook's NEW Hand-Tracking Algorithm is INSANE! — for AR/VR Apps & Games!
31Facebook Reality Labs: Constraining Dense Hand Surface Tracking with Elasticity. An advanced hand-tracking algorithm for AR/VR applications that goes way beyond what we have now. I compared it to the Oculus Quest 2 hand-tracking and how it can improve future Augmented Reality and Virtual Reality apps and games in the future.
Information sources via Facebook:
https://research.fb.com/wp-content/uploads/2020/11/Constraining-Dense-Hand-Surface-Tracking-with-Elasticity.pdf
https://research.fb.com/publications/constraining-dense-hand-surface-tracking-with-elasticity/
---QUOTE FROM THE PUBLICATION---
"It is for this reason that precisely tracking hand motion in the presence of significant contact and occlusion is a core—perhaps the core—challenge in analyzing and synthesizing hand behavior. Technically, this challenge presents as the problem of precisely tracking two deformable surfaces undergoing dynamic contact. Visual observations do not fully constrain the deformation and obtaining precise ground truth in these interactions is nearly impossible.
Addressing this problem will enable the production of more immersive and engaging digital doubles, will help add lifelike realism to characters in movies, and will unlock new forms of interaction
modalities in virtual and augmented reality. The ability to track hands with a high degree of fidelity under self-contact and selfocclusion will also help in understanding subtle non-verbal gestures
and human-human interactions in the social sciences, as well as enable new applications in medicine and physical rehabilitation. It will provide data for ideation, training, and validation for dexterous humanoid manipulators."
#HandTracking #AR #VR