Duration: 3:44:09

1,987 views

16

The Platform for Situated Intelligence Workshop took place on April 27-28, 2021.

Platform for Situated Intelligence is an open-source framework from Microsoft Research that significantly accelerates development and research on multimodal, integrative-AI applications. This framework makes it easier to build applications that process multimodal streaming data (audio, video, depth, etc.), combine multiple (AI) technologies, and operate in the open world in real-time.

This two-day workshop included both high-level overviews and in-depth tutorials on various aspects of the framework, from the low-level infrastructure for working with multimodal, streaming data, to development and visualization tools, to the ecosystem of available components and integrations with third-party technologies such as ROS, Python, Microsoft Teams, Unity, etc. The first day of the workshop will focus on high-level overviews and community building, whereas the second day will focus more on tutorials on specific topics. See the agenda page for more information on what was included in the schedule.

0:03
Welcome and Workshop overview
Dan Bohus and Sean Andrist

13:24
Opening remarks
Eric Horvitz

22:48
Platform for Situated Intelligence overview + Q&A
Dan Bohus

57:14
Platform for Situated Intelligence: A coding tutorial + Q&A
Dan Bohus

1:45:02
Multimodal data visualization and annotation with Platform for Situated Intelligence Studio + Q&A
Sean Andrist

2:43:42
Building an open-source community (panel discussion)
Sean Andrist, Dan Bohus, Daniel McDuff, Mohammad Soleymani, Kalin Stefanov, Zhi Tan, Willie Wilson

Learn more about the Microsoft Research PSI Workshop: https://www.microsoft.com/en-us/research/event/psi-workshop/