Planeverb: Interactive sound propagation for dynamic scenes using 2D wave simulation

Channel:
Microsoft Research
Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=t7QpXB2y-6k


Duration: 4:18
1,413 views
57

We present a technique to model wave-based sound propagation to complement visual animation in fully dynamic scenes. We employ 2D wave simulation that captures geometry-based diffraction effects such as obstruction, reverberation, and directivity of perceptually-salient initial sound at the source and listener. We show real-time performance on a single CPU core on modestly-sized scenes that are nevertheless topologically complex. Our key ideas are to exploit reciprocity and use a perceptual encoding and rendering framework. These allow the use of low-frequency finite-difference simulations on static scene snapshots. Our results show plausible audio variation that remains robust to motion and geometry changes. We suggest that wave solvers can be a practical approach to real-time dynamic acoustics. The complete C++ code of our “Planeverb” system [source repo: https://github.com/themattrosen/Planeverb].

Note: There is no narration in this video, only acoustic loudness and direction variations as indicated by notes in each scene.

See more at https://www.microsoft.com/en-us/research/video/planeverb-interactive-sound-propagation-for-dynamic-scenes-using-2d-wave-simulation/



Other Videos By Microsoft Research


2020-09-22The physics of hologram formation in iron doped lithium niobate
2020-09-22How does holographic storage work?
2020-09-15Decoding Music Attention from “EEG headphones”: a User-friendly Auditory Brain-computer Interface
2020-09-15Forest Sound Scene Simulation and Bird Localization with Distributed Microphone Arrays
2020-09-11Novel Image Captioning
2020-09-09Sirius: A Flat Datacenter Network with Nanosecond Optical Switching (SIGCOMM 2020 short talk)
2020-09-09Beyond the mega-data center: networking multi-data center regions (SIGCOMM 2020 short talk)
2020-09-09Optics for the cloud – Light at the end of the tunnel? (SIGCOMM 2020 Workshop)
2020-09-09Beyond the mega-data center: networking multi-data center regions (SIGCOMM 2020 Talk)
2020-09-09Making cryptography accessible, efficient, and scalable with Dr. Divya Gupta and Dr. Rahul Sharma
2020-09-04Planeverb: Interactive sound propagation for dynamic scenes using 2D wave simulation
2020-09-04What Kind of Computation is Human Cognition? A Brief History of Thought (Episode 1/2)
2020-09-03What Kind of Computation is Human Cognition? A Brief History of Thought (Episode 2/2)
2020-09-03Exporting Animations with Microsoft Expressive Pixels (8 of 9)
2020-09-03Using Layers in Microsoft Expressive Pixels (7 of 9)
2020-09-03Creating Fragments in Microsoft Expressive Pixels (6 of 9)
2020-09-03Managing Animation Galleries in Microsoft Expressive Pixels (5 of 9)
2020-09-03Creating Animations in Microsoft Expressive Pixels (4 of 9)
2020-09-03Creating an Image in Microsoft Expressive Pixels (3 of 9)
2020-09-03Getting Started with Microsoft Expressive Pixels (2 of 9)
2020-09-03Welcome to Microsoft Expressive Pixels (1 of 9)


Tags:
Planeverb
interactive sound propagation
wave-based sound propagation
2D wave simulation
Matthew Rosen
Keith Godin
Nikunj Raghuvanshi
acoustics
Microsoft Research
computer animation
mixed reality