Creating an Interactive Metric Authoring Experience for Microsoft’s Experimentation Platform

Microsoft Mathematics, 2022–23

Liaison(s): Dr. Jonathan Litz ’09, Dr. David Hall
Advisor(s): Talithia Williams
Students(s): Katie Wu (PM), Amber Means, Julianna Schalkwyk, Qing Yang, Justin Yeh

The Experimentation Platform (ExP) team at Microsoft runs A/B tests for Microsoft’s products and uses Metric Definition Language (MDL) to define statistics calculated on their datasets. The goal of the clinic team was to create an interactive metric authoring web application to teach MDL to entry-level software engineers, product managers and data scientists. The team’s project will aid users in learning and using MDL at a faster pace and help them write more accurate expressions.