Justin Salamon

Senior Research Scientist

San Francisco

Justin is a senior research scientist and member of the Audio Research Group at Adobe Research in San Francisco. Previously he was a senior research scientist at the Music and Audio Research Laboratory and Center for Urban Science and Progress of New York University.

His research focuses on the application of machine learning and signal processing to audio & video, with applications in machine listening, audiovisual and multi-modal understanding, representation learning & self-supervision, audio for video, music information retrieval, bioacoustics, environmental sound analysis, and open source software & data.

Please visit his personal website for a complete list of publications, research topics, code/data releases, and research news.

Publications

Efficient Spoken Language Recognition Via Multilabel Classification

Nieto, O., Jin, Z., Dernoncourt, F., Salamon, J. (Aug. 24, 2023)

Interspeech 2023

Audio-Text Models Do Not Yet Leverage Natural Language

Wu, H., Nieto, O., Bello, J., Salamon, J. (Jun. 4, 2023)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Automated Acoustic Monitoring Captures Timing and Intensity of Bird Migration

Doren, B., Lostanlen, V., Cramer, A., Salamon, J., Dokter, A., Kelling, S., Bello, J., Farnsworth, A. (Dec. 14, 2022)

Journal of Applied Ecology

Filler Word Detection and Classification: A Dataset and Benchmark

Zhu, G., Caceres, J., Salamon, J. (Sep. 18, 2022)

23rd Annual Conference of the International Speech Communication Association (INTERSPEECH 2022)

HEAR: Holistic Evaluation of Audio Representations

Turian, J., Shier, J., Khan, H., Raj, B., Schuller, B., Steinmetz, C., Malloy, C., Tzanetakis, G., Velarde, G., McNally, K., Henry, M., Pinto, N., Noufi, C., Clough, C., Herremans, D., Fonseca, E., Engel, J., Salamon, J., Esling, P., Manocha, P., Watanabe, S., Jin, Z., Bisk, Y. (Jul. 20, 2022)

NeurIPS 2021

It’s Time for Artistic Correspondence in Music and Video

Surís, D., Vondrick, C., Russell, B., Salamon, J. (Jun. 19, 2022)

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Emotion Embedding Spaces for Matching Music to Stories

Won, M., Salamon, J., Bryan, N., Mysore, G., Serra, X. (Nov. 8, 2021)

Best Student Paper Award

International Society for Music Information Retrieval Conference (ISMIR)

Deep Embeddings and Section Fusion Improve Music Segmentation

Salamon, J., Nieto, O., Bryan, N. (Nov. 8, 2021)

International Society for Music Information Retrieval Conference (ISMIR)

Who Calls the Shots? Rethinking Few-Shot Learning for Audio

Wang, Y., Bryan, N., Salamon, J., Cartwright, M., Bello, J. (Oct. 18, 2021)

Best Audio Few-Shot Learning Paper Award

IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA)

Sound Event Detection and Separation: A Benchmark on DESED Synthetic Soundscapes

Turpault, N., Serizel, R., Wisdom, S., Erdogan, H., Hershey, J., Fonseca, E., Seetharaman, P., Salamon, J. (Jun. 8, 2021)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Few-Shot Continual Learning for Audio Classification

Wang, Y., Bryan, N., Cartwright, M., Bello, J., Salamon, J. (Jun. 8, 2021)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

What’s all the Fuss about Free Universal Sound Separation Data?

Wisdom, S., Erdogan, H., Ellis, D., Serizel, R., Turpault, N., Fonseca, E., Salamon, J., Seetharaman, P., Hershey, J. (Jun. 8, 2021)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

SONYC-UST-V2: An Urban Sound Tagging Dataset with Spatiotemporal Context

Cartwright, M., Cramer, A., Méndez, A., Wang, Y., Wu, H., Lostanlen, V., Fuentes, M., Dove, G., Mydlarz, C., Salamon, J., Nov, O., Bello, J. (Nov. 2, 2020)

Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE)

Improving Sound Event Detection in Domestic Environments using Sound Separation

Turpault, N., Wisdom, S., Erdogan, H., Hershey, J., Serizel, R., Fonseca, E., Seetharaman, P., Salamon, J. (Nov. 2, 2020)

Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE)

Controllable Neural Prosody Synthesis

Morrison, M., Jin, Z., Salamon, J., Bryan, N., Mysore, G. (Oct. 26, 2020)

Interspeech 2020

Metric Learning vs Classification for Disentangled Music Representation Learning

Lee, J., Bryan, N., Salamon, J., Jin, Z., Nam, J. (Oct. 11, 2020)

International Society for Music Information Retrieval Conference (ISMIR)

Few-Shot Drum Transcription in Polyphonic Music

Wang, Y., Salamon, J., Cartwright, M., Bryan, N., Bello, J. (Oct. 11, 2020)

International Society for Music Information Retrieval Conference (ISMIR)

Telling Left From Right: Learning Spatial Correspondence of Sight and Sound

Yang, K., Russell, B., Salamon, J. (Jun. 14, 2020)

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Chirping up the Right Tree: Incorporating Biological Taxonomies into Deep Bioacoustic Classifiers

Cramer, J., Lostanlen, V., Farnsworth, A., Salamon, J., Bello, J. (May. 4, 2020)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Sound Event Detection in Synthetic Domestic Environments

Serizel, R., Turpault, N., Shah, A., Salamon, J. (May. 4, 2020)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Disentangled Multidimensional Metric Learning For Music Similarity

Lee, J., Bryan, N., Salamon, J., Jin, Z., Nam, J. (May. 4, 2020)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Few-Shot Sound Event Detection

Wang, Y., Salamon, J., Bryan, N., Bello, J. (May. 4, 2020)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Robust Sound Event Detection in Bioacoustic Sensor Networks

Lostanlen, V., Salamon, J., Farnsworth, A., Kelling, S., Bello, J. (Oct. 26, 2019)

PLoS ONE 14(10): e0214168, 2019. DOI: https://doi.org/10.1371/journal.pone.0214168

Sound Event Detection in Domestic Environments with Weakly Labeled Data and Soundscape Synthesis

Turpault, N., Serizel, R., Shah, A., Salamon, J. (Oct. 25, 2019)

Detection and Classification of Acoustic Scenes and Events 2019 Workshop (DCASE2019)

SONYC Urban Sound Tagging (SONYC-UST): A Multilabel Dataset from an Urban Acoustic Sensor Network

Cartwright, M., Mendez, A., Cramer, J., Lostanlen, V., Dove, G., Wu, H., Salamon, J., Nov, O., Bello, J. (Oct. 25, 2019)

Detection and Classification of Acoustic Scenes and Events 2019 Workshop (DCASE2019)

TriCycle: Audio Representation Learning from Sensor Network Data Using Self-Supervision

Cartwright, M., Cramer, J., Salamon, J., Bello, J. (Oct. 20, 2019)

IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA)

What’s Broken in Music Informatics Research? Three Uncomfortable Statements

Salamon, J. (Jun. 15, 2019)

Machine Learning for Music Discovery workshop, International Conference on Machine Learning (ICML)

News