Duration: 2:20

1,293 views

42

AdaTest is an open-source tool for finding and fixing bugs in natural language processing (NLP) systems. In this demo, learn how AdaTest capitalizes on large language models’ ability to generate tests and users’ knowledge of how a model being tested should behave. The result is an iterative testing-and-debugging loop that helps identify and address model failures more effectively than current user-driven or automated approaches.

Learn more about AdaTest:

Microsoft Research blog post: https://www.microsoft.com/en-us/research/blog/partnering-people-with-large-language-models-to-find-and-fix-bugs-in-nlp-systems/
Paper: https://www.microsoft.com/en-us/research/publication/adaptive-testing-and-debugging-of-nlp-models/