User Guided Audio Selection from Complex Sound Mixtures

In the 22nd ACM Symposium on User Interface Software and Technology (UIST 09) . Victoria, BC, Canada. October 2009

Published October 30, 2009

Paris Smaragdis

In this paper we present a novel interface for selecting sounds in audio mixtures. Traditional interfaces in audio editors pro- vide a graphical representation of sounds which is either a waveform, or some variation of a time/frequency transform. Although with these representations a user might be able to visually identify elements of sounds in a mixture, they do not facilitate object-specific editing (e.g. selecting only the voice of a singer in a song). This interface uses audio guidance from a user in order to select a target sound within a mix- ture. The user is asked to vocalize (or otherwise sonically represent) the desired target sound, and an automatic process identifies and isolates the elements of the mixture that best relate to the user’s input. This way of pointing to specific parts of an audio stream allows a user to perform audio se- lections which would have been infeasible otherwise.

Learn More

Research Area:  Audio