GASP: Gaussian Avatars with Synthetic Priors

Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=3oWB7-UJUYE



Duration: 0:00
1,729 views
65


Gaussian Splatting has changed the game for real-time photo-realistic rendering. One of the most popular applications of Gaussian Splatting is to create animatable avatars, known as Gaussian Avatars. Recent works have pushed the boundaries of quality and rendering efficiency but suffer from two main limitations. Either they require expensive multi-camera rigs to produce avatars with free-view rendering, or they can be trained with a single camera but only rendered at high quality from this fixed viewpoint. An ideal model would be trained using a short monocular video or image from available hardware, such as a webcam, and rendered from any view.

To this end, we propose GASP: Gaussian Avatars with Synthetic Priors. To overcome the limitations of existing datasets, we exploit the pixel-perfect nature of synthetic data to train a Gaussian Avatar prior. By fitting this prior model to a single photo or video and fine-tuning it, we get a high-quality Gaussian Avatar, which supports 360-degree rendering. Our prior is only required for fitting, not inference, enabling real-time application. Through our method, we obtain high-quality, animatable Avatars from limited data which can be animated and rendered at 70fps on commercial hardware.




Other Videos By Microsoft Research


2025-02-25Magma: A foundation model for multimodal AI Agents | Microsoft Research Forum
2025-02-25Chimera: Accurate synthesis prediction by ensembling models with... | Microsoft Research Forum
2025-02-25AI for Precision Health: Learning the language of nature and patients | Microsoft Research Forum
2025-02-25Keynote: Multimodal Generative AI for Precision Health | Microsoft Research Forum
2025-02-21WHAM Demonstrator tutorial
2025-02-07Attestations over TLS 1.3 and ZKP
2025-01-02Accelerating Multilingual RAG Systems
2024-12-30Pronouns in the Workplace: Learning Inclusive Software Design from Real-World Experiences
2024-12-20Culturally Aware Machines: Why and when are they useful?
2024-12-18Embodied AI Workshop at CVPR 2024
2024-12-10GASP: Gaussian Avatars with Synthetic Priors
2024-12-09A Closer Look at Falcon
2024-12-09Quantum Lattice Enumeration in Limited Depth, Fernando Virdia
2024-12-09Enhancing Security of Bluetooth Secure Connections via Deferrable Authentication
2024-12-09Improving the Security of United States Elections with Robust Optimization
2024-11-18Introducing BiomedParse, a groundbreaking foundation model for biomedical image analysis
2024-11-11Low latency carbon budget 2023
2024-10-31Future Directions for XR Interactions with Advanced Sensing Techniques and Haptic Design Frameworks
2024-10-31Estimating mental workload in a simulated flight task using optical f-NIRS signals
2024-10-17Look Ma, no markers: holistic performance capture without the hassle
2024-10-17Hairmony: Fairness-aware hairstyle classification