RDMA: Provably More Powerful Communication

Subscribers:
351,000
Published on ● Video Link: https://www.youtube.com/watch?v=ZLSV-WiXb-g



Duration: 52:40
3,573 views
76


In recent years, a technology known as Remote Direct Memory Access (RDMA) has made its way into data centers, earning a spotlight in distributed systems research. RDMA provides the traditional send/receive communication primitives, but also allows a process to directly read/write remote memory. Recent work shows that RDMA leads to some new and exciting distributed algorithms. However, it is unclear whether the performance benefits observed with RDMA are inherent to its non-traditional features, or just an artifact of the way it is currently being used.

In this talk, I’ll present a theoretical model of RDMA, called the Message-and-Memory model, and use it to show that RDMA has some fundamental advantages over previous communication mechanisms. I’ll use the classic problem of consensus to analyze the benefits that RDMA brings, and prove upper and lower bounds on fault tolerance and performance of solving crash-fault-tolerant and Byzantine-fault-tolerant consensus in this model.

See more at https://www.microsoft.com/en-us/research/video/rdma-provably-more-powerful-communication/




Other Videos By Microsoft Research


2019-10-24Microsoft PhD Summit 2019: Bailu Ding [Short Talk]
2019-10-24Microsoft PhD Summit 2019: Nathalie Riche [Short Talk]
2019-10-24Microsoft PhD Summit 2019: Ken Hinckley [Short Talk]
2019-10-24'The Global AI Supercomputer' by Donald Kossmann at Microsoft PhD Summit 2019 [Keynote]
2019-10-23Learning to Map Natural Language to General Purpose Source Code
2019-10-23Hand and User Detection with Multiple Users on Large Displays
2019-10-23Machine teaching, LUIS and the democratization of custom AI with Dr. Riham Mansour [Podcast]
2019-10-21Generalization in Reinforcement Learning with Selective Noise Injection
2019-10-21DreamWalker: Substituting Real-World Walking Experiences with a Virtual Reality
2019-10-21Learning Structured Models for Safe Robot Control
2019-10-21RDMA: Provably More Powerful Communication
2019-10-21Mise-Unseen: Using Eye Tracking to Hide Virtual Reality Scene Changes in Plain Sight
2019-10-21CapstanCrunch: A Haptic VR Controller with User-supplied Force Feedback
2019-10-18Social Computing for Social Good in Low-Resource Environments
2019-10-16News from the front in the post-quantum crypto wars with Dr. Craig Costello [Podcast]
2019-10-14Grounding Natural Language for Embodied Agents
2019-10-14Towards Using Batch Reinforcement Learning to Identify Treatment Options in Healthcare
2019-10-14Can quantum mechanics help us learn models of classical systems?
2019-10-14Reinforcement Learning From Small Data in Feature Space
2019-10-14Reward Machines: Structuring Reward Function Specifications and Reducing Sample Complexity...
2019-10-14Safe and Fair Reinforcement Learning



Tags:
Remote Direct Memory Access
RDMA
distributed systems research
algorithms
Message-and-Memory model
fault tolerance
microsoft research
Naama Ben-David