Parametric Wave Field Coding for Precomputed Sound Propagation

Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=x-56vYzewGk



Duration: 7:24
1,711 views
25


The acoustic wave field in a complex scene is a chaotic 7D function of time and the positions of source and listener, making it difficult to compress and interpolate. This hampers precomputed approaches which tabulate impulse responses (IRs) to allow immersive, real-time sound propagation in static scenes. We code the field of time-varying IRs in terms of a few perceptual parameters derived from the IR’s energy decay. The resulting parameter fields are spatially smooth and compressed using a lossless scheme similar to PNG. We show that this encoding removes two of the seven dimensions, making it possible to handle large scenes such as entire game maps within 100MB of memory. Run-time decoding is fast, taking 100 microseconds per source. We introduce an efficient and scalable method for convolutionally rendering acoustic parameters that generates artifact-free audio even for fast motion and sudden changes in reverberance. We demonstrate convincing spatially-varying effects in complex scenes including occlusion/obstruction and reverberation, in our system integrated with Unreal Engine (TM).




Other Videos By Microsoft Research


2016-10-28Pre-Touch Sensing for Mobile Interaction (CHI 2016 Live Presentation)
2016-10-28A Duality Based Framework for Designing Simple Mechanisms
2016-10-27NormalTouch and TextureTouch: 3D Haptic Shape Controllers for Virtual Reality
2016-10-25Proxy-guided Image-based Rendering for Mobile Devices
2016-10-25Parallel Poisson Disk Sampling with Spectrum Analysis on Surfaces
2016-10-25Unlock deeper learning with the new Microsoft Cognitive Toolkit
2016-10-21Interactive Sound Synthesis for Large Scale Virtual Environments
2016-10-21Efficient and Accurate Sound Propagation Using Adaptive Rectangular Decomposition
2016-10-21Precomputed Wave Simulation for Real-Time Sound Propagation of Dynamic Sources in Complex Scenes
2016-10-21Wave-Based Sound Propagation in Large Open Scenes using an Equivalent Source Formulation
2016-10-21Parametric Wave Field Coding for Precomputed Sound Propagation
2016-10-20Aerophones in Flatland: Interactive Wave Simulation of Wind Instruments
2016-10-20The FedEx Problem
2016-10-20Tight Complexity Bounds for Composite Optimization
2016-10-17XWand: UI for Intelligent Spaces
2016-10-17Pointing in Intelligent Environments with the WorldCursor
2016-10-13A Neurally-Inspired Model of Habit and its Empirical Implications
2016-10-13Global Education Data on What Drives Student Outcomes
2016-10-13Faculty Summit 2016 - Spatial Audio for Augmented and Virtual Reality
2016-10-12Pictionaire: Supporting Collaborative Design Work by Integrating Physical and Digital Artifacts
2016-10-11GWindows: Robust Stereo Vision for Gesture-Based Control of Windows