Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input

Channel:
Microsoft Research
Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=GqSAZR0NlRc


Duration: 2:31
490 views
6

We present a computer vision technique to detect when the user brings their thumb and forefinger together (a pinch gesture) for close-range and relatively controlled viewing circumstances. The technique avoids complex and fragile hand tracking algorithms by detecting the hole formed when the thumb and forefinger are touching; this hole is found by simple analysis of the connected components of the background segmented against the hand. Our Thumb and ForeFinger Interface (TAFFI) demonstrates the technique for cursor control as well as map navigation using one and twohanded interactions.



Other Videos By Microsoft Research


2016-10-13Global Education Data on What Drives Student Outcomes
2016-10-13Faculty Summit 2016 - Spatial Audio for Augmented and Virtual Reality
2016-10-12Pictionaire: Supporting Collaborative Design Work by Integrating Physical and Digital Artifacts
2016-10-11GWindows: Robust Stereo Vision for Gesture-Based Control of Windows
2016-10-11TouchLight: An Imaging Touch Screen and Display for Gesture-Based Interaction
2016-10-11PlayAnywhere: A Compact Interactive Tabletop Projection-Vision System
2016-10-11PlayTogether
2016-10-11PlayAnywhere & Virtual Earth
2016-10-11PlayAnywhere: Bluetooth & Photo Sync
2016-10-11Precise Selection Techniques for Multi-Touch Screens
2016-10-11Robust Computer Vision-Based Detection of Pinching for One and Two-Handed Gesture Input
2016-10-11Soap: a Pointing Device that Works in Mid-Air
2016-10-11BlueTable: Connecting Wireless Mobile Devices on Interactive Surfaces Using Vision-Based Handshaking
2016-10-11Depth-Sensing Video Cameras for 3D Tangible Tabletop Interaction
2016-10-11SurfaceFusion: Unobtrusive Tracking of Everyday Objects in Tangible User Interfaces
2016-10-11ShapeTouch: Leveraging Contact Shape on Interactive Surfaces
2016-10-11Bringing Physics to the Surface
2016-10-11Separability of Spatial Manipulations in Multi-touch Interfaces
2016-10-11Augmenting Interactive Tables with Mice & Keyboards
2016-10-11Interactions in the Air: Adding Further Depth to Interactive Tabletops
2016-10-11Simulating Grasping Behavior on an Imaging Interactive Surface