Eyes on Multimodal Interaction

Channel:
Microsoft Research
Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=xjaleHtdOCg


Duration: 56:44
149 views
1

In a conversation, much can be sensed from the person's eye gazeΓÇöinterested or uninterested, attentive or preoccupied, focused or distracted, engaged or unmindful, wanting to continue or trying to get away etc. With the advance of new eye tracking technology it might be possible to use eye-gaze information in conversations with computers. The research presented in this talk firstly investigates if there are any eye-gaze patterns present in natural dialogues that can be detected and used by a multimodal interactive system, secondly, describes a computer system that embodies the eye-gaze patterns found in natural dialogues. The results demonstrated that eye-gaze can play an assistive role in managing future multimodal human-computer dialogues.



Other Videos By Microsoft Research


2016-09-05Exploring Mars by 4-Wheel Drive
2016-09-05Computing with Selfish Agents [1/2]
2016-09-05Opportunities and Challenges in End-to-End Verification of Software Systems
2016-09-05Tools and Techniques for Prototyping Future Interactions [1/2]
2016-09-05Mathematical Sketching: A New Approach for Creating and Exploring Dynamic Illustrations
2016-09-05A learning-based approach to summarization
2016-09-05Virtual machines: the ultimate tool for computer forensics
2016-09-05Headwinds and Tailwinds:  Where is the U.S. economy going?
2016-09-05Paradigms of Worm Defense & Thoughts from an Ivory Tower
2016-09-05Machine Learning Methods for Discovery of Regulatory Elements in Bacteria
2016-09-05Eyes on Multimodal Interaction
2016-09-05From Promoter to Expression ΓÇô A Probabilistic Framework for Inferring Regulatory Mechanisms
2016-09-05Automated Reconstruction of 3D City Models from Laser Scans and Camera Images
2016-09-05Bergman complexes, Coxeter arrangements, and graph associahedra
2016-09-05Biomal Human Emotion Recognition and Peer Steaming Projects at  Ryerson Multimedia Research Lab
2016-09-05Interfaces for Staying in the Flow         [1/3]
2016-09-05Place Lab: Device Positioning Using Radio Beacons in the Wild
2016-09-05Cost-sharing mechanisms for Network Design
2016-09-05Market-Based Programming Paradigms for Sensor Networks
2016-09-05Convex Geometry of Orbits
2016-09-05The Benefit of Adaptivity in Stochastic Optimization [1/6]


Tags:
microsoft research