Zeyu Jin

Zeyu Jin

Senior Research Scientist

San Francisco, CA

Zeyu is a senior research scientist at Adobe Research in San Francisco. His research area is in deep generative models for speech, on topics such as studio-quality speech enhancement, speech quality assessment and personalized voice generation. He is also interested in HCI for audio applications and music generation.

He received a Ph.D. degree in computer science from Princeton University adviced by Adam Finkelstein and M.S in music technology in Carnegie Mellon University. Between 2015 and 2017, he interned at Adobe for three times and presented his primary research project – VoCo – at Adobe MAX Sneaks (link to video) in 2016.

Publications

July 20, 2022 NeurIPS 2021

HEAR: Holistic Evaluation of Audio Representations

Joseph Turian, Jordie Shier, Humair Raj Khan, Bhiksha Raj, Björn W Schuller, Christian J Steinmetz, Colin Malloy, George Tzanetakis, Gissel Velarde, Kirk McNally, Max Henry, Nicolas Pinto, Camille Noufi, Christian Clough, Dorien Herremans, Eduardo Fonseca, Jesse Engel, Justin Salamon, Philippe Esling, Pranay Manocha, Shinji Watanabe, Zeyu Jin, Yonatan Bisk

August 1, 2019 ACM Transactions on Graphics (Proc. SIGGRAPH'19)

Text-based Editing of Talking-head Video

Ohad Fried, Ayush Tewari, Michael Zollhofer, Adam Finkelstein, Eli Shechtman, Dan B Goldman, Kyle Genova, Zeyu Jin, Christian Theobalt, Maneesh Agarwala

News

Behind the Tech: Enhance Speech in Adobe Podcast

We invited Research Scientist Jiaqi Su and Senior Research Scientist Zeyu Jin from Adobe Research to discuss their inspiration behind the Enhance Speech feature in Adobe Podcast. This groundbreaking technology is transforming the way creators produce studio-quality audio content.

October 13, 2023

Readability Research: This New Field Can Help Us All Read Better

Each person reads differently, and what could help one person read digital text better may not help another. That’s the issue at the heart of Adobe’s Readability Initiative—a partnership of Adobe Research, Adobe engineering, product management, corporate social responsibility, and education teams, as well as external collaborators.

February 15, 2022