Audio

We invent audio AI technology for human-centered creativity. Our goal is to empower people to bring their creative ideas to life through high quality audio content. This ranges from music and podcasts to video and immersive experiences, as well as emerging media types. We are dramatically simplifying the creation process with AI so that people can quickly go from idea to produced content regardless of skill level, iterating on the creative aspects rather than the technical ones. We do this through our research in the analysis, processing, and generation of speech, music, everyday sounds, and more. We also work on problems at the intersection of audio with video, augmented reality, and natural language processing. To advance all of these research areas, we develop new machine learning models, novel signal processing algorithms, and new human computer interaction paradigms. 

Meet some of our researchersView More

Jui-Hsien Wang

Research Engineer

Nicholas J. Bryan

Senior Research Scientist

Gautham Mysore

Senior Principal Scientist

View our latest publicationsView More

Deep Embeddings and Section Fusion Improve Music Segmentation

Salamon, J., Nieto, O., Bryan, N. (Nov. 8, 2021)

International Society for Music Information Retrieval Conference (ISMIR)

Controllable deep melody generation via hierarchical music representation

Dai, S., Jin, Z., Gomes, C., Dannenberg, R. (Nov. 8, 2021)

International Society for Music Information Retrieval Conference

Emotion Embedding Spaces for Matching Music to Stories

Won, M., Salamon, J., Bryan, N., Mysore, G., Serra, X. (Nov. 8, 2021)

Best Student Paper AwardInternational Society for Music Information Retrieval Conference (ISMIR)

Project Awesome Audio

Project Awesome Audio, an experimental technology, converts low quality home voice recordings into studio quality audio at the press of a button. It uses a deep learning model to jointly perform high quality dereverberation, denoising, and more.

View our latest newsView All News

Join us!

We are looking for researchers, engineers, and interns to take our technologies to the next level. We're recruiting, and we would love to hear from you!