Interactive Sound Synthesis for Large Scale Virtual Environments

Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=Rs16MSkTmb8



Duration: 1:58
627 views
15


We present an interactive approach for generating realistic physically-based sounds from rigid-body dynamic simulations. We use spring-mass systems to model each object’s local deformation and vibration, which we demonstrate to be an adequate approximation for capturing physical effects such as magnitude of impact forces, location of impact, and rolling sounds. No assumption is made about the mesh connectivity or topology. Surface meshes used for rigid-body dynamic simulation are utilized for sound simulation without any modifications. We use results in auditory perception and a novel priority-based quality scaling scheme to enable the system to meet variable, stringent time constraints in a real-time application, while ensuring minimal reduction in the perceived sound quality. With this approach, we have observed up to an order of magnitude speed-up compared to an implementation without the acceleration. As a result, we are able to simulate moderately complex simulations with upto hundreds of sounding objects at over 100 frames per second (FPS), making this technique well suited for interactive applications like games and virtual environments. Furthermore, we utilize OpenAL and EAX (TM) on Creative Sound Blaster Audigy 2 (TM) cards for fast hardware-accelerated propagation modeling of the synthesized sound.




Other Videos By Microsoft Research


2016-10-29A Tap and Gesture Hybrid Method for Authenticating Smartphone Users
2016-10-29Motion and Context Sensing Techniques for Pen Computing
2016-10-29Stroke Shortcuts for a Touchscreen Keyboard with Gesture-Redundant Keys Removed
2016-10-29Sensing Tablet Grasp + Micro-mobility for Active Reading
2016-10-28Pre-Touch Sensing for Mobile Interaction (CHI 2016 Live Presentation)
2016-10-28A Duality Based Framework for Designing Simple Mechanisms
2016-10-27NormalTouch and TextureTouch: 3D Haptic Shape Controllers for Virtual Reality
2016-10-25Proxy-guided Image-based Rendering for Mobile Devices
2016-10-25Parallel Poisson Disk Sampling with Spectrum Analysis on Surfaces
2016-10-25Unlock deeper learning with the new Microsoft Cognitive Toolkit
2016-10-21Interactive Sound Synthesis for Large Scale Virtual Environments
2016-10-21Efficient and Accurate Sound Propagation Using Adaptive Rectangular Decomposition
2016-10-21Precomputed Wave Simulation for Real-Time Sound Propagation of Dynamic Sources in Complex Scenes
2016-10-21Wave-Based Sound Propagation in Large Open Scenes using an Equivalent Source Formulation
2016-10-21Parametric Wave Field Coding for Precomputed Sound Propagation
2016-10-20Aerophones in Flatland: Interactive Wave Simulation of Wind Instruments
2016-10-20The FedEx Problem
2016-10-20Tight Complexity Bounds for Composite Optimization
2016-10-17XWand: UI for Intelligent Spaces
2016-10-17Pointing in Intelligent Environments with the WorldCursor
2016-10-13A Neurally-Inspired Model of Habit and its Empirical Implications