Jianming Zhang

Research Scientist

San Jose

I am interested in solving real world problems using computer vision and machine learning. At Adobe, I work on research and tech transfer projects related to deep learning, computer vision and intelligent systems. Before joining Adobe, I studied computer vision with Prof. Stan Sclaroff at Boston University and got my PhD in 2016.

[Personal website] [Google Scholar]

 

Publications

Thinking Outside the BBox: Unconstrained Generative Object Compositing

Tarres, G., Lin, Z., Zhang, Z., Zhang, J., Song, Y., Ruta, D., Gilbert, A., Collomosse, J., Kim, S. (Oct. 1, 2024)

European Conference on Computer Vision (ECCV)

Object-level Scene Deocclusion

Liu, Z., Liu, Q., Chang, C., Zhang, J., Pakhomov, D., Zheng, H., Lin, Z., Cohen-Or, D., Fu, C. (Jul. 28, 2024)

SIGGRAPH 2024

IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representation

Song, Y., Zhang, Z., Lin, Z., Cohen, S., Price, B., Zhang, J., Kim, S., Zhang, H., Xiong, W., Aliaga, D., Price, P. (Jun. 17, 2024)

CVPR 2024

Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image

Mei, Y., Zeng, Y., Zhang, H., Shu, Z., Zhang, X., Bi, S., Zhang, J., Jung, H., Patel, V. (Jun. 17, 2024)

CVPR 2024

Relightful Harmonization: Lighting-aware Portrait Background Replacement

Ren, M., Xiong, W., Yoon, J., Shu, Z., Zhang, J., Jung, H., Gerig, G., Zhang, H. (Jun. 17, 2024)

CVPR 2024

UniHuman: A Unified Model for Editing Human Images in the Wild

Li, N., Liu, Q., Singh, K., Wang, Y., Zhang, J., Plummer, B., Lin, Z. (Jun. 17, 2024)

CVPR 2024

SmartMask: Context Aware High-Fidelity Mask Generation for Fine-grained Object Insertion and Layout Control

Singh, J., Zhang, J., Liu, Q., Smith, C., Lin, Z., Zheng, L. (Jun. 17, 2024)

CVPR 2024

SceneComposer: Any-Level Semantic Image Synthesis

Zeng, Y., Lin, Z., Zhang, J., Liu, Q., Collomosse, J., Kuen, J., Patel, V. (Jun. 20, 2023)

Computer Vision and Pattern Recognition (CVPR)

ObjectStitch: Generative Object Compositing

Song, Y., Zhang, Z., Lin, Z., Cohen, S., Price, B., Zhang, J., Kim, S., Aliaga, D. (Jun. 18, 2023)

CVPR 2023

Controllable Shadow Generation Using Pixel Height Maps

Sheng, Y., Liu, Y., Zhang, J., Yin, W., Oztireli, A., Zhang, H., Lin, Z., Shechtman, E., Benes, B. (Oct. 24, 2022)

European Conference on Computer Vision (ECCV'22)

CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training

Zheng, H., Lin, Z., Lu, J., Cohen, S., Shechtman, E., Barnes, C., Zhang, J., Xu, N., Amirghodsi, S., Luo, J. (Oct. 23, 2022)

European Conference on Computer Vision (ECCV'22)

Layered Depth Refinement with Mask Guidance

Kim, S., Zhang, J., Niklaus, S., Fan, Y., Chen, S., Lin, Z., Kim, M. (Jun. 21, 2022)

Conference on Computer Vision and Pattern Recognition (CVPR)

Semantic Layout Manipulation with High-Resolution Sparse Attention

Zheng, H., Lin, Z., Lu, J., Cohen, S., Zhang, J., Xu, N., Luo, J. (Apr. 15, 2022)

TPAMI 2022

High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsampling

Zeng, Y., Lin, Z., Yang, J., Zhang, J., Shechtman, E., Lu, H. (Aug. 23, 2020)

To appear in European Conference on Computer Vision (ECCV'20)

Adaptive Photographic Composition Guidance

E, J., Fried, O., Lu, J., Zhang, J., Měch, R., Echevarria, J., Hanrahan, P., Landay, J. (Apr. 1, 2020)

ACM CHI 2020

Scaling Object Detection by Transferring Classification Weights

Kuen, J., Perazzi, F., Lin, Z., Zhang, J., Tan, Y. (Nov. 1, 2019)

ICCV (oral, acceptance rate ~5.0%)

Learning to Blend Photos

Hung, W., Zhang, J., Shen, X., Lin, Z., Lee, J., Yang, M. (Sep. 8, 2018)

European Conference on Computer Vision

Contemplating Visual Emotions: Understanding and Overcoming Dataset Bias

Panda, R., Zhang, J., Li, H., Lee, J., Lu, X., Roy-Chowdhury, A. (Sep. 8, 2018)

European Conference on Computer Vision

FlyCam: Multi-touch Gesture Controlled Drone Gimbal Photography

Kang, H., Li, H., Zhang, J., Lu, X., Benes, B. (Jul. 16, 2018)

IEEE Robotics and Automation Letters

Excitation Backprop for RNNs

Bargal, S., Zunino, A., Kim, D., Zhang, J., Murino, V., Sclaroff, S. (Jun. 18, 2018)

Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Good View Hunting: Learning Photo Composition from Dense View Pairs

Wei, Z., Zhang, J., Shen, X., Lin, Z., Měch, R., Hoai, M., Samaras, D. (Jun. 18, 2018)

Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

The Boolean Map Distance: Theory and Efficient Computation

Malmberg, F., Strand, R., Zhang, J., Sclaroff, S. (Aug. 22, 2017)

Proc. International Conference on Discrete Geometry for Computer Imagery (DGCI)

Top-down Visual Saliency Guided by Captions

Ramanishka, V., Das, A., Zhang, J., Saenko, K. (Jul. 10, 2017)

Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Top-down Neural Attention by Excitation Backprop

Zhang, J., Lin, Z., Brandt, J., Shen, X., Sclaroff, S., Zhang, Z. (Sep. 12, 2016)

European Conference on Computer Vision (ECCV)

News