Duration: 1:09:29

1,873 views

37

We often think about perceptual experiences one modality at a time; we “see” this or we “hear” that, etc. These distinctions often imply that our perception of each sense is independent from each other. Research in human neuroscience, however, increasingly supports a multisensory view of human perception whereby our perception of any one sensory modality is a product of simultaneous information streams from all the available senses. Discrepant information between two or more senses, can lead to perceptual illusions and/or plastic changes in future perception in each sensory modality. In this talk, I will discuss how research in multisensory perception and multisensory plasticity can be used to provide more compelling and intuitive experiences for users as products become increasingly multi-modal (particularly in the domain of virtual and augmented reality).

See more at https://www.microsoft.com/en-us/research/video/multimodal-devic…n-and-plasticity/