A Non-Negative Approach to Semi-Supervised Separation of Speech from Noise with the Use of Temporal Dynamics

ICASSP - IEEE International Conference on Acoustics, Speech, and Signal Processing , May 2011

Published May 22, 2011

Gautham Mysore, Paris Smaragdis

We present a semi-supervised source separation methodology to denoise speech by modeling speech as one source and noise as the other source. We model speech using the recently pro- posed non-negative hidden Markov model, which uses multiple non-negative dictionaries and a Markov chain to jointly model spectral structure and temporal dynamics of speech. We perform separation of the speech and noise using the recently proposed non-negative factorial hidden Markov model. Although the speech model is learned from training data, the noise model is learned during the separation process and requires no training data. We show that the proposed method achieves superior results to using non-negative spectrogram factorization, which ignores the non-stationarity and temporal dynamics of speech.

Learn More

Research Area:  Audio