
Litmus Predictor
Channel:
Subscribers:
344,000
Published on ● Video Link: https://www.youtube.com/watch?v=20dR8oKc9j0
LITMUS: Linguistically Inspired Training and testing of MUltilingual Systems
LITMUS Predictor provides support for simulating performance in ~100 languages given training observations of the desired task-model. Each training observation specifies the finetuning data size + test-performance in different languages.
Further, the tool provides support for constructing a data collection strategy to maximize performance in desired targets subject to different constraints.
Project – https://www.microsoft.com/en-us/research/project/project-litmus/
Demo – https://microsoft.github.io/Litmus/
Codebase – https://github.com/microsoft/Litmus