TensorFuzz: Debugging Neural Networks with Coverage-Guided Fuzzing | AISC

Channel:
Canada LLMs Explained - Aggregate Intellect - AI.SCIENCE
Subscribers:
22,300
Published on ● Video Link: https://www.youtube.com/watch?v=lDlyimn7IsQ


Category:
Guide
Duration: 1:49:47
698 views
16

For slides and more information on the paper, visit https://aisc.ai.science/events/2019-08-26

Discussion lead: Tahseen Shabab


Motivation:
Machine learning models are notoriously difficult to interpret and debug. This is particularly true of neural networks. In this work, we introduce automated software testing techniques for neural networks that are well-suited to discovering errors which occur only for rare inputs. Specifically, we develop coverage-guided fuzzing (CGF) methods for neural networks. In CGF, random mutations of inputs to a neural network are guided by a coverage metric toward the goal of satisfying user-specified constraints. We describe how fast approximate nearest neighbor algorithms can provide this coverage metric. We then discuss the application of CGF to the following goals: finding numerical errors in trained neural networks, generating disagreements between neural networks and quantized versions of those networks, and surfacing undesirable behavior in character level language models. Finally, we release an open source library called TensorFuzz that implements the described techniques.



Other Videos By LLMs Explained - Aggregate Intellect - AI.SCIENCE


2019-09-24Similarity of neural network representations revisited
2019-09-23Detecting Customer Complaint Escalation w/ Recurrent Neural Networks & Manually-Engineered Features
2019-09-23Graph Normalizing Flows
2019-09-23CNN Architectures for Large-Scale Audio Classification | AISC
2019-09-222019 AI Squared Forum Paper Track | AISC
2019-09-16Making of a conversational agent platform | AISC
2019-09-09A Survey of Singular Learning | AISC
2019-09-04Overview of Reinforcement Learning | AISC
2019-09-03Ernie 2.0: A Continual Pre-Training Framework for Language Understanding | AISC
2019-08-28Consistency by Agreement in Zero-shot Neural Machine Translation | AISC
2019-08-26TensorFuzz: Debugging Neural Networks with Coverage-Guided Fuzzing | AISC
2019-08-21Science of science: Identifying Fundamental Drivers of Science | AISC
2019-08-19AI Product Stream Meet and Greet | AISC
2019-08-12[Original ResNet paper] Deep Residual Learning for Image Recognition | AISC
2019-08-11[GAT] Graph Attention Networks | AISC Foundational
2019-08-06XLNet: Generalized Autoregressive Pretraining for Language Understanding | AISC
2019-07-31Overview of Generative Adversarial Networks | AISC
2019-07-29Multi-Armed Bandit Strategies for Non-Stationary Reward Distributions and Delayed Feedback Processes
2019-07-22AISC Abstract Night
2019-07-15The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words & Sentences From Natural Supervision
2019-07-10TF-Encrypted: Private machine learning in tensorflow with secure computing | AISC Lunch & Learn