Gautham Mysore

Gautham is a senior principal scientist and head of the CAVA (Co-Creation for Audio, Video, & Animation) Research organization in Adobe Research. Please visit his website for more about him.

AI & Machine Learning Audio Computer Vision, Imaging & Video

Publications

November 8, 2021 International Society for Music Information Retrieval Conference (ISMIR)

Emotion Embedding Spaces for Matching Music to Stories

Minz Won, Justin Salamon, Nicholas J. Bryan, Gautham Mysore, Xavier Serra

Best Student Paper Award

AI & Machine Learning Audio

December 11, 2020 Transactions of the International Society for Music Information Retrieval (TISMIR)

Audio-Based Music Structure Analysis: Current Trends, Open Challenges, and Applications

Oriol Nieto, Gautham Mysore, Cheng-i Wang, Jordan B. L. Smith, Jan Schlüter, Thomas Grill, Brian McFee

AI & Machine Learning Audio

October 26, 2020 Interspeech 2020

Controllable Neural Prosody Synthesis

Maxwell Morrison, Zeyu Jin, Justin Salamon, Nicholas J. Bryan, Gautham Mysore

Audio

October 26, 2020 Interspeech 2020

A Differentiable Perceptual Audio Metric Learned from Just Noticeable Differences

Pranay Manocha, Adam Finkelstein, Richard Zhang, Nicholas J. Bryan, Gautham Mysore, Zeyu Jin

AI & Machine Learning Audio

May 4, 2019 ACM Conference on Human Factors in Computing Systems (CHI)

VoiceAssist: Guiding Users to High-Quality Voice Recordings

Prem Seetharaman, Gautham Mysore, Bryan Pardo, Paris Smaragdis, Celso Gomes

AI & Machine Learning Audio Human Computer Interaction

May 4, 2019 ACM Conference on Human Factors in Computing Systems (CHI)

B-Script: Transcript-based B-roll Video Editing with Recommendations

Bernd Huber, Hijung Valentina Shin, Bryan Russell, Oliver Wang, Gautham Mysore

Audio Computer Vision, Imaging & Video Human Computer Interaction

January 10, 2019 IEEE Signal Processing Magazine

Recent Advances in Music Signal Processing

Meinard Mueller, Bryan Pardo, Gautham Mysore, Vesa Valimaki

Audio

August 3, 2018 Book Chapter in Audio Source Separation and Speech Enhancement, Wiley, 2018

Temporal extensions of Nonnegative Matrix Factorization

Cedric Fevotte, Paris Smaragdis, Nasser Mohammadiha, Gautham Mysore

AI & Machine Learning Audio

April 21, 2018 ACM Conference on Human Factors in Computing Systems (CHI)

LoopMaker: Automatic Creation of Music Loops from Pre-recorded Music

Kitty Shi, Gautham Mysore

Audio Human Computer Interaction

April 15, 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

FFTNet: a Real-Time Speaker-Dependent Neural Vocoder

Zeyu Jin, Adam Finkelstein, Gautham Mysore, Jingwan (Cynthia) Lu

AI & Machine Learning Audio

April 15, 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Blind Estimation of the Speech Transmission Index for Speech Quality Prediction

Prem Seetharaman, Gautham Mysore, Paris Smaragdis, Bryan Pardo

AI & Machine Learning Audio

April 15, 2018 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Crowdsourced Pairwise-comparison for Source Separation Evaluation

Mark Cartwright, Bryan Pardo, Gautham Mysore

Audio

March 11, 2018 ACM IUI Workshop on Intelligent Music Interfaces for Listening and Creation (MILC)

A System for Personalized Music Medley Creation

Kitty Shi, Gautham Mysore

Audio

March 3, 2018 Book Chapter in Audio Source Separation, Springer

Dynamic Non-negative Models for Audio Source Separation

Paris Smaragdis, Gautham Mysore, Nasser Mohammadiha

AI & Machine Learning Audio

October 23, 2017 International Society of Music Information Retrieval Conference (ISMIR)

Re-visiting the Music Segmentation Problem with Crowdsourcing

Cheng-i Wang, Gautham Mysore, Shlomo Dubnov

Audio

October 22, 2017 ACM Symposium on User Interface Software and Technology (UIST)

AutoDub: Automatic Redubbing for Voiceover Editing

Shrikant Venkataramani, Paris Smaragdis, Gautham Mysore

Audio Human Computer Interaction

July 31, 2017 ACM Transactions on Graphics (SIGGRAPH)

VoCo: text-based insertion and replacement in audio narration

Zeyu Jin, Gautham Mysore, Stephen DiVerdi, Jingwan (Cynthia) Lu, Adam Finkelstein

Audio Human Computer Interaction

January 1, 2017 Communications of the ACM

Eulerian Video Magnification and Analysis

Neal Wadhwa, Hao-Yu Wu, Abe Davis, Michael Rubinstein, Eugene Shih, Gautham Mysore, Justin G. Chen, Oral Buyukozturk, John V. Guttag, William T. Freeman, Frédo Durand

Audio Computer Vision, Imaging & Video

May 24, 2016 Speech Prosody

Analysis of Prosody Increment Induced by Pitch Accents for Automatic Emphasis Correction

Yang Zhang, Gautham Mysore, Floraine Berthouzoz, Mark Hasegawa-Johnson

Audio

March 25, 2016 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Structural Segmentation with the Variable Markov Oracle and Boundary Adjustment

Cheng-i Wang, Gautham Mysore

Audio

March 20, 2016 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Fast and Easy Crowdsourced Perceptual Audio Evaluation

Mark Cartwright, Bryan Pardo, Gautham Mysore, Matt Hoffman

Audio

March 20, 2016 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Equalization Matching of Speech Recordings in Real-World Environments

Francois Germain, Gautham Mysore, Tatako Fujioka

Audio

March 1, 2016 The 41st IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

CUTE: a Concatenative Method for Voice Conversion Using Exemplar-based Unit Selection

Zeyu Jin, Adam Finkelstein, Stephen DiVerdi, Jingwan (Cynthia) Lu, Gautham Mysore

Audio Human Computer Interaction

November 8, 2015 ACM Symposium on User Interface Software and Technology (UIST)

Capture-Time Feedback for Recording Scripted Narration

Steve Rubin, Floraine Berthouzoz, Gautham Mysore, Maneesh Agrawala

Audio Human Computer Interaction

August 1, 2015 IEEE Signal Processing Letters

Can We Automatically Transform Speech Recorded on Common Consumer Devices in Real-World Environments into Professional Production Quality Speech? – A Dataset, Insights, and Challenges

Gautham Mysore

Audio

April 19, 2015 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Speaker and Noise Independent Online Single Channel Speech Enhancement

Francois Germain, Gautham Mysore

AI & Machine Learning Audio

April 19, 2015 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Speech Dereverberation using a Learned Speech Model

Dawen Liang, Matt Hoffman, Gautham Mysore

AI & Machine Learning Audio

April 19, 2015 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Efficient Manifold Preserving Audio Source Separation using Locality Sensitive Hashing

Minje Kim, Paris Smaragdis, Gautham Mysore

AI & Machine Learning Audio

April 18, 2015 ACM Conference on Human Factors in Computing Systems (CHI)

Lamello: Passive Acoustic Sensing for Tangible Input Components

Valkyrie Savage, Andrew Head, Bjorn Hartmann, Dan Goldman, Gautham Mysore, Wilmot Li

Audio Human Computer Interaction

October 1, 2014 IEEE Signal Processing Letters

Stopping Criteria for Non-negative Matrix Factorization Based Supervised and Semi-Supervised Source Separation

Francois Germain, Gautham Mysore

AI & Machine Learning Audio

August 12, 2014 ACM Transactions on Graphics (SIGGRAPH)

The Visual Microphone: Passive Recovery of Sound from Video

Abe Davis, Michael Rubinstein, Neal Wadhwa, Gautham Mysore, Fredo Durand, William T. Freeman

Audio Computer Vision, Imaging & Video

May 9, 2014 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Exploiting Long-Term Temporal Dependencies in NMF using Recurrent Neural Networks with Application to Source Separation

Nicolas Boulanger-Lewandowski, Gautham Mysore, Matthew Hoffman

AI & Machine Learning Audio

May 9, 2014 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Speech Decoloration based on the Product-of-Filters Model

Dawen Liang, Daniel P. W. Ellis, Matthew Hoffman, Gautham Mysore

AI & Machine Learning Audio

May 1, 2014 IEEE Signal Processing Magazine Special Issue on Source Separation and Applications

Static and Dynamic Source Separation Using Nonnegative Factorizations: A unified view

Paris Smaragdis, Cedric Fevotte, Gautham Mysore, Nasser Mohammadiha, Matthew Hoffman

AI & Machine Learning Audio

April 26, 2014 ACM Human Factors in Computing Systems (CHI)

ISSE: An Interactive Source Separation Editor

Nicholas J. Bryan, Gautham Mysore, Ge Wang

AI & Machine Learning Audio Human Computer Interaction

April 1, 2014 Proceedings of the 2nd International Conference on Learning Representations (ICLR 2014), April 2014

A Generative Product-of-Filters Model of Audio

M. Hoffman, Gautham Mysore

November 4, 2013 International Society of Music Information Retrieval Conference (ISMIR)

Combining Modeling of Singing Voice and Background Music for Automatic Separation of Musical Mixtures

Zafar Rafii, Francois Germain, Dennis Sun, Gautham Mysore

AI & Machine Learning Audio

November 4, 2013 International Society for Music Information Retrieval Conference (ISMIR)

Source Separation of Polyphonic Music With Interactive User-Feedback on a Piano Roll Display

Nicholas J. Bryan, Gautham Mysore, Ge Wang

AI & Machine Learning Audio Human Computer Interaction

October 1, 2013 Proceedings of the 26th Annual ACM Symposium on User interface Software and Technology

Content-Based Tools for Editing Audio Stories

S. Rubin, F. Berthouzoz, Gautham Mysore, Wilmot Li, M. Agrawala

August 25, 2013 Interspeech

Speaker and Noise Independent Voice Activity Detection

Francois Germain, Dennis Sun, Gautham Mysore

Best Student Paper Award

AI & Machine Learning Audio

June 16, 2013 International Conference on Machine Learning (ICML)

An Efficient Posterior Regularized Latent Variable Model for Interactive Sound Source Separation

Nicholas J. Bryan, Gautham Mysore

AI & Machine Learning Audio Human Computer Interaction

May 1, 2013 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Interactive Refinement Of Supervised And Semi-Supervised Sound Source Separation Estimates

Nicholas J. Bryan, Gautham Mysore

AI & Machine Learning Audio Human Computer Interaction

May 1, 2013 ICASSP 2013 – Proceedings of the 38th International Conference on Acoustics, Speech, and Signal Processing, May 2013

Universal Speech Models for Speaker Independent Single Channel Source Separation

D. Sun, Gautham Mysore

March 19, 2013 In Proc. IUI 2013 - IEEE International Conference on Automatic Face and Gesture Recognition , March 19 - 22. Presented in the Interactive Machine Learning Workshop, 2013.

Interactive User-feedback for Audio Source Separation

N. Bryan, Gautham Mysore

October 1, 2012 Proceedings of the 25th annual ACM Symposium on User interface Software and Technology

UnderScore: Musical Underlays for Audio Stories

S. Rubin, F. Berthouzoz, Gautham Mysore, Wilmot Li, M. Agrawala

Audio Human Computer Interaction

September 23, 2012 IEEE International Workshop on Machine Learning for Signal Processing

Language Informed Bandwidth Expansion

Jinyu Han, Gautham Mysore, Paris Smaragdis

AI & Machine Learning Audio

September 9, 2012 Interspeech

Speech Enhancement by Online Non-negative Spectrogram Decomposition in Non-stationary Noise Environments

Zhiyao Duan, Gautham Mysore, Paris Smaragdis

AI & Machine Learning Audio

June 26, 2012 Proceedings of the International Conference on Machine Learning (ICML)

Variational Inference in Non-negative Factorial Hidden Markov Models for Efficient Audio Source Separation

Gautham Mysore, Maneesh Sahani

AI & Machine Learning Audio

March 25, 2012 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Clustering and Synchronizing Multi-camera Video via Landmark Cross-Correlation

Nicholas J. Bryan, Paris Smaragdis, Gautham Mysore

Audio Computer Vision, Imaging & Video

March 25, 2012 ICASSP - IEEE International Conference on Acoustics, Speech, and Signal Processing , March 2012

Following Musical Sources by Example

Paris Smaragdis, Gautham Mysore

Audio

March 25, 2012 ICASSP - IEEE International Conference on Acoustics, Speech, and Signal Processing , March 2012

Noise-Robust Dynamic Time Warping Using PLCA Features

B. King, Paris Smaragdis, Gautham Mysore

Audio

March 25, 2012 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Following Musical Sources by Example

Paris Smaragdis, Gautham Mysore

Audio

March 12, 2012 LVA/ICA - International Conference on Latent Variable Analysis and Signal Separation, March 2012

Audio Imputation Using the Non-negative Hidden Markov Model

J. Han, Gautham Mysore, B. Pardo

AI & Machine Learning Audio

March 12, 2012 LVA/ICA - International Conference on Latent Variable Analysis and Signal Separation, March 2012

Sound Recognition in Mixtures

J. Nam, Gautham Mysore, Paris Smaragdis

Audio

March 12, 2012 LVA/ICA - International Conference on Latent Variable Analysis and Signal Separation, March 2012

Online PLCA for Real-Time Semi-supervised Source Separation

Z. Duan, Gautham Mysore, Paris Smaragdis

Audio

March 12, 2012 LVA/ICA - International Conference on Latent Variable Analysis and Signal Separation, March 2012

A Non-negative Approach to Language Informed Speech Separation

Gautham Mysore, Paris Smaragdis

Audio

September 18, 2011 MLSP - IEEE International Workshop on Machine Learning for Signal Processing , September 2011

A Convolutive Spectral Decomposition Approach to the Separation of Feedback from Target Speech

Gautham Mysore, Paris Smaragdis

Audio

May 22, 2011 ICASSP - IEEE International Conference on Acoustics, Speech, and Signal Processing , May 2011

A Non-Negative Approach to Semi-Supervised Separation of Speech from Noise with the Use of Temporal Dynamics

Gautham Mysore, Paris Smaragdis

Audio

September 27, 2010 LVA/ICA - International Conference on Latent Variable Analysis and Signal Separation, September 2010

Non-negative Hidden Markov Modeling of Audio with Application to Source Separation

Gautham Mysore, Paris Smaragdis, B. Raj

Best Student Paper Award

AI & Machine Learning Audio

October 18, 2009 WASPAA - IEEE Workshop on Applications of Signal Processing to Audio and Acoustics , October 2009

Separation by Humming: User Guided Sound Extraction from Monophonic Mixtures

Paris Smaragdis, Gautham Mysore

AI & Machine Learning Audio

June 18, 2009 IMCL - International Conference on Machine Learning (ICML) Workshop on Sparse Methods for Music Audio , June 2009

Multipitch Estimation using Sparse Impulse Distributions and Instrument Specific Priors

Gautham Mysore, Paris Smaragdis

March 15, 2009 ICA - International Conference on Independent Component Analysis and Signal Separation , March 2009

Probabilistic Factorization of Non-Negative Data with Entropic Co-occurrence Constraints

Paris Smaragdis, M. Shashanka, B. Raj, Gautham Mysore

News

Bridging technology and musical creativity: ISMIR 2024

Adobe Research played a key role at ISMIR 2024, contributing groundbreaking research in music AI, leading a top-tier tutorial, and supporting the event as a Platinum Sponsor. Our work continues to push the boundaries of music technology and innovation.

March 17, 2025

New Horizons for Audio Research at Adobe

The Audio Research Group is re-imagining audio technology to empower people to tell their story, without the tools getting in the way.

September 6, 2019

Helping Vloggers Create Better Videos

Adobe Research's intuitive, text-based interface could allow even novice vloggers to quickly create more engaging videos.

April 12, 2019