Layers of appearances and motion

Channel:
Microsoft Research
Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=gUE1uIZ6Bt4


Duration: 53:35
15 views
0

Visual scene analysis when posed as an inference problem in a generative model offers efficient and principled integration of various causes of variability such as motion, lighting and appearance changes, all in a single framework. In addition, joint modeling of multiple causes enable each part of the model to capture some of the variability in the data until all is decomposed and explained using modeled causes. In this talk, I will present a layered generative model that describes an image as a composition of appearance, shape, global transformation and non-uniform deformation of objects occupying each layer. I will describe a variational EM algorithm for inference and learning. Inference reveals the distribution over all the hidden variables (appearance, shape and deformation field for each layer) for each frame in the sequence. I will then present epitomic representation as a viable alternative for modeling appearance and shape when we have only small amount of training data. Results on video summarization, image segmentation and frame interpolation will be presented.



Other Videos By Microsoft Research


2016-09-07Microsoft Research Faculty Summit 2005 — Classroom Presenter: Hands-on Lab
2016-09-07Pen Computing, Digital Ink, and Research for the Tablet PC
2016-09-07WACE 2005 - Using Shared Displays to Create a Collaborative Classroom Learning Environment
2016-09-07Using Microsoft Visual C++ and Other Tools to Create Custom Games Based on the Half-Life 2 Engine
2016-09-07Predicting Tornados with Data Driven Workflows
2016-09-07Shared Display Wall Based Collaboration Environment in the Control Room
2016-09-07WACE 2005 - What Makes for Success in Science and Engineering Collaboratories?
2016-09-07Some Observations About Broader Societal Issues of Computing Research and Education
2016-09-07Microsoft Research Faculty Summit 2005 — Microsoft and Academia: A Dialog
2016-09-07eScience Workshop 2005 - eScience - The Revolution Is Starting
2016-09-07Layers of appearances and motion
2016-09-07WACE 2005 - Technology, Technology, Everywhere!
2016-09-07Lambda Table: High Resolution Tiled Display Table for Interacting with Large Visualizations
2016-09-07Microsoft Research Faculty Summit 2005 — Gaming for Computer Science Instruction
2016-09-07Datamining in Science: Mining Patterns in Protein StructuresΓÇöAlgorithms and Applications
2016-09-07Programming in Bed: Dispersed Agile Development
2016-09-07WACE 2005 - The Connection Project: Toward Supporting Virtual Collocation
2016-09-07Microsoft Research Faculty Summit 2005 — Embedded Systems and Robotics Research
2016-09-07eScience Workshop 2005 - Welcome
2016-09-07Algorithmic performance in large scale distributed networks:
2016-09-07Web Services: Using Microsoft Indigo Services as Building Blocks to Build Robust Distributed Systems


Tags:
microsoft research