Dingzeyu Li

Senior Research Scientist

Seattle

He is a Senior Research Scientist at Adobe Research. He obtained his PhD in Computer Science from Columbia University and BEng from HKUST.

He is interested in audiovisual cross-modal analysis and synthesis for video authoring and creative tools. Leveraging tools from computer vision, graphics, deep learning, and HCI, he focuses on novel creative authoring/editing experiences for everyone. His past research and engineering has been recognized by two ACM UIST Best Paper Awards 🏅 (2022 and 2017), an Emmy Award 🏆 for Technology and Engineering (2020), two Adobe MAX Sneaks Demos ✨(2019 , 2020), an Adobe Research Fellowship 🎓 (2017), a NVIDIA PhD Fellowship Finalist (2017), a Shapeways Educational Grant 🧧 (2016), and an HKUST academic achievement medal 🥇 (2013). He has served as international program committee members for Eurographics 2020/2021, Graphics Interface 2020, and ACM Multimedia 2019, and as reviewers for various academic conferences including SIGGRAPH, CVPR, ICCV, UIST, CHI, etc. He has served as the Adobe Fellowship program co-chair with Valentina Shin, recognizing outstanding PhD students conducting exceptional research.

He is always looking for interns and collaborators to work on research projects leading to publications/patents/product features. Please feel free to reach out to learn more.

Publications

Concept Weaver: Enabling Multi-Concept Fusion in Text-to-Image Models

Kwon, G., Jenni, S., Li, D., Lee, J., Ye, J., Heilbron, F. (Jun. 19, 2024)

CVPR 2024

CrossA11y: Identifying Video Accessibility Issues via Cross-modal Grounding

Liu, X., Wang, R., Li, D., Chen, X., Pavel, A. (Nov. 2, 2022)

Best Paper Award

UIST 2022

Beyond Subtitles: Captioning and Visualizing Non-speech Sounds to Improve Accessibility of User-Generated Videos

Alonzo, O., Shin, H., Li, D. (Oct. 26, 2022)

ASSETS 2022

Can one hear the shape of a neural network?: Snooping the GPU via Magnetic Side Channel

Maia, H., Xiao, C., Li, D., Grinspun, E., Zheng, C. (Aug. 9, 2022)

USENIX Security 2022

Audio-Driven Neural Gesture Reenactment With Video Motion Graphs

Zhou, Y., Yang, J., Li, D., Saito, J., Aneja, D., Kalogerakis, E. (Jun. 24, 2022)

IEEE / CVF Computer Vision and Pattern Recognition Conference (CVPR)

Toward Automatic Audio Description Generation for Accessible Videos

Wang, Y., Liang, W., Huang, H., Zhang, Y., Li, D., Yu, L. (Jun. 16, 2021)

CHI 2021

MakeItTalk: Speaker-Aware Talking Head Animation

Zhou, Y., Han, X., Shechtman, E., Echevarria, J., Kalogerakis, E., Li, D. (Nov. 30, 2020)

SIGGRAPH Asia 2020

Unified Multisensory Perception: Weakly-Supervised Audio-Visual Video Parsing

Li, D., Tian, Y., Xu, C. (Aug. 24, 2020)

ECCV 2020

Deep Audio Prior: Learning Sound Source Separation from a Single Audio Mixture

Li, D., Tian, Y., Xu, C. (Jun. 24, 2020)

CVPR 2020 Sight and Sound Workshop

Scene-Aware Audio Rendering via Deep Acoustic Analysis

Tang, Z., Bryan, N., Li, D., Langlois, T., Manocha, D. (Mar. 23, 2020)

IEEE VR Journal Track (TVCG)

LayerCode: Optical Barcodes for 3D Printed Shapes

Maia, H., Li, D., Zheng, C. (Aug. 1, 2019)

ACM Transactions on Graphics (SIGGRAPH)

Audible Panorama: Automatic Spatial Audio Generation for Panorama Imagery

Huang, H., Solah, M., Li, D., Yu, L. (May. 3, 2019)

ACM Conference on Human Factors and Computing Systems (SIGCHI)

Scene-Aware Audio for 360° Videos

Li, D., Langlois, T., Zheng, C. (Aug. 13, 2018)

ACM Transactions on Graphics (SIGGRAPH)

AirCode: Unobtrusive Physical Tags for Digital Fabrication

Li, D., Nair, A., Nayar, S., Zheng, C. (Oct. 24, 2017)

Best Paper Award --

ACM Symposium on User Interface Software and Technology (UIST)

Crumpling Sound Synthesis

Cirio, G., Li, D., Grinspun, E., Otaduy, M., Zheng, C. (Dec. 2, 2016)

ACM Transactions on Graphics (SIGGRAPH Asia)

Interactive Acoustic Transfer Approximation for Modal Sound

Li, D., Fei, Y., Zheng, C. (Aug. 3, 2016)

ACM Transactions on Graphics (presented at SIGGRAPH)

Acoustic Voxels: Computational Optimization of Modular Acoustic Filters

Li, D., Levin, D., Matusik, W., Zheng, C. (Aug. 3, 2016)

ACM Transactions on Graphics (SIGGRAPH)

Expediting Precomputation for Reduced Deformable Simulation

Yang, Y., Li, D., Xu, W., Tian, Y., Zheng, C. (Dec. 2, 2015)

ACM Transactions on Graphics (SIGGRAPH Asia)

Motion-Aware KNN Laplacian for Video Matting

Li, D., Chen, Q., Tang, C. (Dec. 3, 2013)

ICCV 2013

KNN Matting

Chen, Q., Li, D., Tang, C. (Sep. 1, 2013)

CVPR 2012 / TPAMI 2013

News