He Zhang

Senior Research Scientist

San Jose

I am a Senior Research Scientist at and Tech Lead at Adobe Research working on MLLM for image/video generation and editing.   I did my PhD advised by Vishal M. Patel.    More info can be found on my homepage

Publications

Baking Gaussian Splatting into Diffusion Denoiser for Fast and Scalable Single-stage Image-to-3D Generation and Reconstruction

Cai, Yuanhao., Zhang, He., Zhang, Kai., Liang, Yixun., Ren, Mengwei., Luan, Fujun., Liu, Qing., Kim, Soo., Zhang, Jianming., Zhang, Zhifei., Zhou, Yuqian., Zhang, Yulun., Yang, Xiaokang., Lin, Zhe., Yuille, Alan. (Oct. 18, 2025)

International Conference on Computer Vision (ICCV 2025)

DIVE: Taming DINO for Subject-Driven Video Editing

huang, Yi., Xiong, Wei., Zhang, He., Chen, Chaoqi., Liu, Jianzhuang., Yan, Mingfu., Chen, Shifeng. (Oct. 15, 2025)

International Conference on Computer Vision (ICCV 2025)

Multitwine: Multi-Object Compositing with Text and Layout Control

Tarrés, Gemma., Lin, Zhe., Zhang, Zhifei., Zhang, He., Gilbert, Andrew., Collomosse, John., Kim, Soo. (Jun. 13, 2025)

Highlight

Conference on Computer Vision and Pattern Recognition (CVPR 2025)

UniReal: Universal Image Generation and Editing via Learning Real-world Dynamics

Chen, Xi., Zhang, Zhifei., Zhang, He., Zhou, Yuqian., Kim, Soo., Liu, Qing., Li, Yijun., Zhang, Jianming., Zhao, Nanxuan., Wang, Yilin., Ding, Hui., Lin, Zhe., Zhao, Hengshuang. (Jun. 11, 2025)

CVPR 2025

Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonization

Wang, Junying., Liu, Jingyuan., Sun, Xin., Singh, Krishna., Shu, Zhixin., Zhang, He., Yang, Jimei., Zhao, Nanxuan., Wang, Tuanfeng., Chen, Simon., Neumann, Ulrich., Yoon, Jae. (Jun. 1, 2025)

IEEE Computer Vision and Pattern Recognition (CVPR) 2025

Text2Relight: Creative Portrait Relighting with Text Guidance

Cha, Junuk., Ren, Mengwei., Singh, Krishna., Zhang, He., Hold-Geoffroy, Yannick., Yoon, Seunghyun., Jung, HyunJoon., Baek, Seungryul., Yoon, Jae. (Mar. 1, 2025)

The Association for the Advancement of Artificial Intelligence (AAAI) 2025

Generative Portrait Shadow Removal

Yoon, Jae., Shu, Zhixin., Ren, Mengwei., Zhang, Xuaner., Hold-Geoffroy, Yannick., Singh, Krishna., Zhang, He. (Dec. 1, 2024)

ACM Transactions on Graphics, Vol.43(6) (TOG), SIGGRAPH Asia 2024

COMPOSE: Comprehensive Portrait Shadow Editing

Hou, Andrew., Shu, Zhixin., Zhang, Xuaner., Zhang, He., Hold-Geoffroy, Yannick., Yoon, Jae., Liu, Xiaoming. (Oct. 1, 2024)

European Conference on Computer Vision (ECCV) 2024

Relightful Harmonization: Lighting-aware Portrait Background Replacement

Ren, Mengwei., Xiong, Wei., Yoon, Jae., Shu, Zhixin., Zhang, Jianming., Jung, HyunJoon., Gerig, Guido., Zhang, He. (Jun. 17, 2024)

CVPR 2024

Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image

Mei, Yiqun., Zeng, Yu., Zhang, He., Shu, Zhixin., Zhang, Xuaner., Bi, Sai., Zhang, Jianming., Jung, HyunJoon., Patel, Vishal. (Jun. 17, 2024)

CVPR 2024

IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representation

Song, Yizhi., Zhang, Zhifei., Lin, Zhe., Cohen, Scott., Price, Brian., Zhang, Jianming., Kim, Soo., Zhang, He., Xiong, Wei., Aliaga, Daniel., Price, Price. (Jun. 17, 2024)

CVPR 2024

Perceptual Artifacts Localization for Image Synthesis Tasks

Zhang, Lingzhi., Xu, Zhengjie., Barnes, Connelly., Zhou, Yuqian., Liu, Qing., Zhang, He., Lin, Zhe., Amirghodsi, Sohrab., Shechtman, Eli., Shi, Jianbo. (Oct. 4, 2023)

International Conference on Computer Vision (ICCV'23)

Semi-supervised Parametric Real-world Image Harmonization

Wang, Ke., Gharbi, Michaël., Zhang, He., Xia, Zhihao., Shechtman, Eli., Shechtman, Shechtman. (Jun. 21, 2023)

Computer Vision and Pattern Recognition (CVPR'23)

Boosting Robustness of Image Matting With Context Assembling and Strong Data Augmentation

Dai, Yutong., Price, Brian., Zhang, He., Shen, Chunhua. (Jun. 19, 2022)

CVPR 2022

News