Automatic Video Scene Extraction and Annotation Tool for Customer Experience Enhancement

DIRECTV Computer Science, 2022–23

Liaison(s): Peshala Pahalawatta, Rudy Lowenstein
Advisor(s): Calden Wloka
Students(s): Marcos Acosta, Aldrin Feliciano, Isabel MacGinnitie, Ruth Mekonnen, Alina Saratova, Daniela Sechen (PM-S)

DIRECTV offers streaming and satellite TV services that curate content for its viewers. DIRECTV aims to automate generation of personalized football highlight reels, so fans who miss a game should be able to keep up-to-date with their favorite teams and players in real time without the need for manually curated content. To achieve this, the Clinic team created a dataset, which pairs a full-length game with highlight scenes, and applied machine learning models to label football plays as either highlight or non-highlight.