Audio

We invent audio AI technology for human-centered creativity. Our goal is to empower people to bring their creative ideas to life through high quality audio content. This ranges from music and podcasts to video and immersive experiences, as well as emerging media types. We are dramatically simplifying the creation process with AI so that people can quickly go from idea to produced content regardless of skill level, iterating on the creative aspects rather than the technical ones. We do this through our research in the analysis, processing, and generation of speech, music, everyday sounds, and more. We also work on problems at the intersection of audio with video, augmented reality, and natural language processing. To advance all of these research areas, we develop new machine learning models, novel signal processing algorithms, and new human computer interaction paradigms. 

Meet some of our researchersView More

Oriol Nieto

Senior Audio Research Engineer

Jui-Hsien Wang

Research Engineer

Tim Ganter

Research Software Developer

View our latest publicationsView More

Identifying Speakers in Dialogue Transcripts: A Text-based Approach Using Pretrained Language Models

Van Nguyen, M., Dernoncourt, F., Yoon, D., Deilamsalehy, H., Tan, H., Rossi, R., Tran, Q., Bui, T., Nguyen, T. (Sep. 5, 2024)

Interspeech 2024

Efficient Spoken Language Recognition Via Multilabel Classification

Nieto, O., Jin, Z., Dernoncourt, F., Salamon, J. (Aug. 24, 2023)

Interspeech 2023

Audio-Text Models Do Not Yet Leverage Natural Language

Wu, H., Nieto, O., Bello, J., Salamon, J. (Jun. 4, 2023)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Project Awesome Audio

Project Awesome Audio, an experimental technology, converts low quality home voice recordings into studio quality audio at the press of a button. It uses a deep learning model to jointly perform high quality dereverberation, denoising, and more.

View our latest newsView All News

Join us!

We are looking for researchers, engineers, and interns to take our technologies to the next level. We're recruiting, and we would love to hear from you!