Hand and User Detection with Multiple Users on Large Displays

Channel:
Microsoft Research
Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=GrS3bd7e65w


Category:
Let's Play
Duration: 5:32
500 views
10

This video shows a demonstration of a research prototype that distinguishes hand and user on a large display with two users working side by side. The hand and user detection is done using a wearable (Microsoft Band for this research prototype) that seamlessly streams ID and motion sensor data to the large display. The prototype is looking for a spike on the motion sensor correlated with a finger touch on the large display to figure out which hand and user is touching the display. This opens up user experiences were each user have their own menu with preferences, access to documents and images on their non-dominant hand and can seamlessly carry their menu from one device to another. This is a research prototype to test the experience, but there are many ways to make this experience secure in the future.

Learn more at Microsoft Research: https://www.microsoft.com/en-us/research/video/hand-and-user-detection-with-multiple-users-on-large-displays/



Other Videos By Microsoft Research


2019-10-24Microsoft PhD Summit 2019: Martin Roetteler [Short Talk]
2019-10-24Microsoft PhD Summit 2019: Asta Roseway [Short Talk]
2019-10-24Microsoft PhD Summit 2019: Mike Sinclair [Short Talk]
2019-10-24Microsoft PhD Summit 2019: Siddharth Suri [Short Talk]
2019-10-24Microsoft PhD Summit 2019: Irene Zhang [Short Talk]
2019-10-24Microsoft PhD Summit 2019: Bailu Ding [Short Talk]
2019-10-24Microsoft PhD Summit 2019: Nathalie Riche [Short Talk]
2019-10-24Microsoft PhD Summit 2019: Ken Hinckley [Short Talk]
2019-10-24'The Global AI Supercomputer' by Donald Kossmann at Microsoft PhD Summit 2019 [Keynote]
2019-10-23Learning to Map Natural Language to General Purpose Source Code
2019-10-23Hand and User Detection with Multiple Users on Large Displays
2019-10-23Machine teaching, LUIS and the democratization of custom AI with Dr. Riham Mansour [Podcast]
2019-10-21Generalization in Reinforcement Learning with Selective Noise Injection
2019-10-21DreamWalker: Substituting Real-World Walking Experiences with a Virtual Reality
2019-10-21Learning Structured Models for Safe Robot Control
2019-10-21RDMA: Provably More Powerful Communication
2019-10-21Mise-Unseen: Using Eye Tracking to Hide Virtual Reality Scene Changes in Plain Sight
2019-10-21CapstanCrunch: A Haptic VR Controller with User-supplied Force Feedback
2019-10-18Social Computing for Social Good in Low-Resource Environments
2019-10-16News from the front in the post-quantum crypto wars with Dr. Craig Costello [Podcast]
2019-10-14Grounding Natural Language for Embodied Agents


Tags:
large display
Multiple Users
User Detection
hand detection
Microsoft Band
wearable tech
finger touch
touch display
digital whiteboard collaboration
Michel Pahud
Microsoft Research