Research Areas
Our projects often span most or all of these areas,
as they are all important to making effective, human-like music technology
Generative Audio and DSP
How can Companion utilize machine learning and filtering to resynthesize string instrument articulations on-the-fly?
Beat Detection and Tempo Tracking
What are the most effective methods for Companion, Evaluator, and Mus2Vid to follow a musician's playing in reference to a score, and play along to match?
Emotion and Perception
How can Mus2Vid analyze emotion of classical music in real-time and utilize it to generate real-time video accompaniments?
Music Classification
What musical features extracted from various media, such as tempo, key, genre, notes, are useful to music performance technology, and how can we extract such features?
Human-Computer Interaction
How can our apps be designed in ways that are human-like and natural for humans to interact with?
User Studies + Deployments
How can we ensure that our users actually utilize and enjoy the apps we develop?