Transparency and Intelligibility Throughout the Machine Learning Life Cycle

Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=I-TSjiXGfSI



Duration: 1:01:51
685 views
14


People play a central role in the machine learning life cycle. Consequently, building machine learning systems that are reliable, trustworthy, and fair requires that relevant stakeholders—including developers, users, and anybody affected by these systems—have at least a basic understanding of how they work.

In this webinar led by Microsoft researcher Jenn Wortman Vaughan, explore how to best incorporate transparency into the machine learning life cycle. Here, we will explore these three components of transparency (with examples): traceability, communication, and intelligibility.

The second part of this webinar dives deeper into intelligibility. Building on recent research, we explore the importance of evaluating methods for achieving intelligibility in context with relevant stakeholders, how to empirically test whether intelligibility techniques let users achieve their goals, and why we should expand our concept of intelligibility beyond machine learning models to other aspects of machine learning systems, such as datasets and performance metrics.

Together, you’ll explore:

■ Traceability: documenting goals, definitions, design choices, and assumptions of machine learning systems
■ Communication: being open about the ways machine learning technology is used and the limitations of this technology
■ Intelligibility: giving people the ability to understand and monitor the behavior of machine learning systems to the extent necessary to achieve their goals
■ The intelligible machine learning landscape: the diverse ways that needs for intelligibility can arise and techniques for achieving and evaluating intelligibility that have been proposed in the machine learning literature

See more at https://www.microsoft.com/en-us/research/video/transparency-and-intelligibility-throughout-the-machine-learning-life-cycle/




Other Videos By Microsoft Research


2020-06-14Memory Enhanced Global Local Aggregation for Video Object Detection
2020-06-14Dynamic Convolution: Attention over Convolution Kernels
2020-06-14Adversarial Robustness: From Self-Supervised Pre-Training to Fine-Tuning
2020-06-14Women in CV
2020-06-14RoutedFusion: Learning Real-time Depth Map Fusion
2020-06-14Multi Granularity Reference Aided Attentive Feature Aggregation for Video based Person Re identifica
2020-06-14Hyper-STAR: Task-Aware Hyperparameters for Deep Networks
2020-06-14Violin: A Large-Scale Dataset for Video-and-Language Inference
2020-06-14Local Context Normalization: Revisiting Local Normalization
2020-06-10Supervised Deep Hashing for Efficient Audio Retrieval
2020-06-10Transparency and Intelligibility Throughout the Machine Learning Life Cycle
2020-06-10Machine Learning and Fairness Webinar
2020-06-10Consumer Brain-Computer Interfaces: From Science Fiction to Reality
2020-06-10Highly Conductive Flexible Sensor Integrated With Personal Devices For Practical Bio-Signal Measure
2020-06-08Microsoft Build 2020: Kevin Scott keynote with Lila Tretikov
2020-06-03Harvesting randomness, HAIbrid algorithms and safe AI with Dr. Siddhartha Sen | Podcast
2020-06-03Provably efficient reinforcement learning with Dr. Akshay Krishnamurthy | Podcast
2020-06-01What ‘bhasha’ do you want to talk in? With Kalika Bali and Dr. Monojit Choudhury | Podcast
2020-05-26Explaining Decisions from Vision Models and Correcting them via Human Feedback
2020-05-26Auditing Outsourced Services
2020-05-26MSR Distinguished Lecture Series: First-person Perception and Interaction



Tags:
machine learning life cycle
trustworthy machine learning systems traceability
communication
intelligibility in context
Jenn Wortman Vaughan
Microsoft Research New York
AI