Enabling interaction between mixed reality and robots via cloud-based localization

Channel:
Microsoft Research
Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=bhoNnqtte_M


Duration: 2:01
3,807 views
118

We introduce a way to enable more natural interaction between humans and robots through Mixed Reality, by using a shared coordinate system. Azure Spatial Anchors, which already supports colocalizing multiple HoloLens and smartphone devices in the same space, has now been extended to support robots equipped with cameras.

This allows humans and robots sharing the same space to interact naturally: humans can see the plan and intention of the robot, while the robot can interpret commands given from the person's perspective. We hope that this can be a building block in the future of humans and robots being collaborators and coworkers.

See more at https://www.microsoft.com/en-us/research/video/enabling-interaction-between-mixed-reality-and-robots-via-cloud-based-localization/

Check out the code at https://aka.ms/ASALinuxSDK



Other Videos By Microsoft Research


2020-12-02Demonstration of Priorities & Notification Platform (2001)
2020-12-01Recent Efforts Towards Efficient And Scalable Neural Waveform Coding
2020-12-01Geometry-constrained Beamforming Network for end-to-end Farfield Sound Source Separation
2020-11-24Directions in ML: Automating Dataset Comparison and Manipulation with Optimal Transport
2020-11-13Audio-based Toxic Language Detection
2020-11-05CDO roundtable: Generating business value through data quality
2020-11-04Unlocking IoT Data for Research in Healthcare
2020-11-03MSR Twitter Local Events
2020-11-02Spotlight on advancements in AI, HCI, Computing, VR, Systems Networking & more at Microsoft Research
2020-10-30Distinct population of sudden unexpected infant death based on age
2020-10-28Enabling interaction between mixed reality and robots via cloud-based localization
2020-10-26Directions in ML: AutoML & Interpretability: Powering the machine learning revolution in healthcare
2020-10-23Evaluating and validating research that aspires to societal impact in real world scenarios with Tanu
2020-10-23A Closed-loop Adaptive Brain-computer Interface Framework
2020-10-22SurfaceFleet Supplemental Video Demonstration (UIST 2020)
2020-10-20Haptic PIVOT: On-Demand Handhelds in VR
2020-10-16SurfaceFleet: Exploring Distributed Interactions Unbounded from Device, Application, User, and Time
2020-10-16Tilt-Responsive Techniques for Digital Drawing Boards
2020-10-16Soundscape Street Preview
2020-10-14Clinical Research with FHIR
2020-10-02Microsoft Research AI Breakthroughs 2020: 20 minute research talks, Q&A panel, and event wrap-up


Tags:
mixed reality
robots
cloud-based localization
Azure Spatial Anchors
human robot interaction
Marc Pollefeys
Microsoft Mixed Reality and AI Lab Zurich