Zhe Lin

Senior Principal Research Scientist

San Jose

Zhe is a researcher in Imagination Lab, Adobe Research. He received his Ph.D. degree in electrical engineering from University of Maryland at College Park in May 2009. Prior to that, he obtained his M.S. degree in electrical engineering from Korea Advanced Institute of Science and Technology in August 2004, and B.Eng. degree in automatic control from University of Science and Technology of China.

He has been a member of Adobe Research since May 2009. His research interests include computer vision, image processing, machine learning, deep learning, artificial intelligence. His contact email is “zlin AT adobe.com”, and more information about his publications and profile can be found at: DBLP, Google Scholar, LinkedIn.

Publications

Perceptual Artifacts Localization for Image Synthesis Tasks

Zhang, L., Xu, Z., Barnes, C., Zhou, Y., Liu, Q., Zhang, H., Lin, Z., Amirghodsi, S., Shechtman, E., Shi, J. (Oct. 4, 2023)

International Conference on Computer Vision (ICCV'23)

SimpSON: Simplifying Photo Cleanup With Single-Click Distracting Object Segmentation Network

Huynh, C., Zhou, Y., Lin, Z., Barnes, C., Shechtman, E., Amirghodsi, S., Shrivastava, A. (Jun. 20, 2023)

Computer Vision and Pattern Recognition (CVPR'23)

Automatic High Resolution Wire Segmentation and Removal

Chiu, M., Zhang, X., Wei, Z., Zhou, Y., Shechtman, E., Barnes, C., Lin, Z., Kainz, F., Amirghodsi, S., Shi, H., Shechtman, S. (Jun. 20, 2023)

Computer Vision and Pattern Recognition (CVPR'23)

SceneComposer: Any-Level Semantic Image Synthesis

Zeng, Y., Lin, Z., Zhang, J., Liu, Q., Collomosse, J., Kuen, J., Patel, V. (Jun. 20, 2023)

Computer Vision and Pattern Recognition (CVPR)

ObjectStitch: Generative Object Compositing

Song, Y., Zhang, Z., Lin, Z., Cohen, S., Price, B., Zhang, J., Kim, S., Aliaga, D. (Jun. 18, 2023)

CVPR 2023

Perceptual Artifacts Localization for Inpainting

Zhang, L., Zhou, Y., Barnes, C., Amirghodsi, S., Lin, Z., Shechtman, E., Shi, J. (Oct. 27, 2022)

Oral

European Conference on Computer Vision (ECCV'22)

Inpainting at Modern Camera Resolution by Guided PatchMatch with Auto-Curation

Zhang, L., Barnes, C., Wampler, K., Amirghodsi, S., Shechtman, E., Lin, Z., Shi, J. (Oct. 26, 2022)

European Conference on Computer Vision (ECCV'22)

Controllable Shadow Generation Using Pixel Height Maps

Sheng, Y., Liu, Y., Zhang, J., Yin, W., Oztireli, A., Zhang, H., Lin, Z., Shechtman, E., Benes, B. (Oct. 24, 2022)

European Conference on Computer Vision (ECCV'22)

CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training

Zheng, H., Lin, Z., Lu, J., Cohen, S., Shechtman, E., Barnes, C., Zhang, J., Xu, N., Amirghodsi, S., Luo, J. (Oct. 23, 2022)

European Conference on Computer Vision (ECCV'22)

CoGS: Controllable Generation and Search from Sketch and Style

Ham, C., Tarres, G., Bui, T., Hays, J., Lin, Z., Collomosse, J. (Oct. 23, 2022)

European Conference on Computer Vision (ECCV)

3D-FM GAN: Towards 3D-Controllable Face Manipulation

Liu, Y., Shu, Z., Li, Y., Lin, Z., Zhang, R., Kung, S. (Oct. 23, 2022)

European Conference on Computer Vision (ECCV)

HyperNST: Hyper-Networks for Neural Style Transfer

Ruta, D., Gilbert, A., Motiian, S., Faeita, B., Lin, Z., Collomosse, J. (Oct. 22, 2022)

European Conference on Computer Vision Workshop (ECCVW) on Vision and Art (VISART)

EI-CLIP: Entity-Aware Interventional Contrastive Learning for E-Commerce Cross-Modal Retrieval

Ma, H., Zhao, H., Lin, Z., Kale, A., Wang, Z., Yu, T., Gu, J., Choudhary, S., Xie, X. (Sep. 27, 2022)

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Layered Depth Refinement with Mask Guidance

Kim, S., Zhang, J., Niklaus, S., Fan, Y., Chen, S., Lin, Z., Kim, M. (Jun. 21, 2022)

Conference on Computer Vision and Pattern Recognition (CVPR)

Semantic Layout Manipulation with High-Resolution Sparse Attention

Zheng, H., Lin, Z., Lu, J., Cohen, S., Zhang, J., Xu, N., Luo, J. (Apr. 15, 2022)

TPAMI 2022

ALADIN: All Layer Adaptive Instance Normalization for Fine-grained Style Similarity

Ruta, D., Motiian, S., Faeita, B., Lin, Z., Jin, H., Filipkowski, A., Gilbert, A., Collomosse, J. (Oct. 17, 2021)

International Conference on Computer Vision (ICCV)

Multi-Scale Aligned Distillation for Low-Resolution Detection

Qi, L., Kuen, J., Gu, J., Lin, Z., Wang, Y., Chen, Y., Li, Y., Jia, J. (Jun. 21, 2021)

Conference on Computer Vision and Pattern Recognition (CVPR'21)

Content-Aware GAN Compression

Liu, Y., Shu, Z., Li, Y., Lin, Z., Perazzi, F., Kung, S. (Jun. 19, 2021)

Conference on Computer Vision and Pattern Recognition (CVPR)

Scene Graph Modification Based on Natural Language Commands

He, X., Tran, Q., Haffari, G., Chang, W., Lin, Z., Bui, T., Dernoncourt, F., Dam, N. (Nov. 18, 2020)

EMNLP Findings 2020

Unselfie: Translating Selfies to Neutral-pose Portraits in the Wild

Ma, L., Lin, Z., Barnes, C., Efros, A., Lu, J. (Aug. 23, 2020)

16th European conference on computer vision (ECCV2020)

High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsampling

Zeng, Y., Lin, Z., Yang, J., Zhang, J., Shechtman, E., Lu, H. (Aug. 23, 2020)

To appear in European Conference on Computer Vision (ECCV'20)

Scaling Object Detection by Transferring Classification Weights

Kuen, J., Perazzi, F., Lin, Z., Zhang, J., Tan, Y. (Nov. 1, 2019)

ICCV (oral, acceptance rate ~5.0%)

Modeling Visual Relationships in Language

Tan, H., Dernoncourt, F., Lin, Z., Bui, T., Bansal, M. (Jul. 28, 2019)

Proc. of ACL

Scene Graph Generation with External Knowledge and Image Reconstruction

Gu, J., Zhao, H., Lin, Z., Li, S., Cai, J., Ling, M. (Jun. 16, 2019)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Learning to Blend Photos

Hung, W., Zhang, J., Shen, X., Lin, Z., Lee, J., Yang, M. (Sep. 8, 2018)

European Conference on Computer Vision

Compositing-aware Image Search

Zhao, H., Shen, X., Lin, Z., Sunkavalli, K., Price, B., Jiaya, J. (Sep. 8, 2018)

European Conference on Computer Vision (ECCV) 2018

Good View Hunting: Learning Photo Composition from Dense View Pairs

Wei, Z., Zhang, J., Shen, X., Lin, Z., Měch, R., Hoai, M., Samaras, D. (Jun. 18, 2018)

Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Learning to Understand Image Blur

Zhang, S., Shen, X., Lin, Z., Měch, R., Costeira, J., Moura, J. (Jun. 18, 2018)

CVPR 2018

Good View Hunting: Learning Photo Composition from 1 Million View Pairs

Wei, Z., Zhang, J., Shen, X., Lin, Z., Měch, R., Hoai, M., Samaras, D. (Jun. 18, 2018)

CVPR 2018

Learning to Detect Multiple Photographic Defects

Yu, N., Shen, X., Lin, Z., Měch, R., Barnes, C. (Mar. 12, 2018)

WACV 2018 : IEEE Winter Conference on Applications of Computer Vision

Personalized Image Aesthetics

Ren, J., Shen, X., Lin, Z., Měch, R., Foran, D. (Oct. 22, 2017)

ICCV 2017 - IEEE International Conference on Computer Vision

Recognizing and Curating Photo Albums via Event-Specific Image Importance

Wang, Y., Lin, Z., Shen, X., Měch, R., Miller, G., Cottrell, G. (Sep. 4, 2017)

BMVC 2017 - 28th British Machine Vision Conference

Salient Object Subtizing

Zhang, J., Ma, S., Sameki, M., Sclaroff, S., Betke, M., Lin, Z., Shen, X., Price, B., Měch, R. (Sep. 1, 2017)

International Journal of Computer Vision

Spatial-Semantic Image Search by Visual Feature Synthesis

Mai, L., Jin, H., Lin, Z., Fang, C., Brandt, J., Liu, F. (Jul. 28, 2017)

Spotlight Presentation

Computer Vision and Pattern Recognition (2017)

Deep Image Harmonization

Tsai, Y., Shen, X., Lin, Z., Sunkavalli, K., Lu, X., Yang, M. (Jul. 21, 2017)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017

High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesis

Yang, H., Lu, X., Lin, Z., Shechtman, E., Wang, O., Li, H. (Jul. 21, 2017)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR'17)

Photo Aesthetics Ranking Network with Attributes and Content Adaptation

Kong, S., Shen, X., Lin, Z., Měch, R., Fowlkes, C. (Oct. 8, 2016)

European Conference on Computer Vision (ECCV)

Top-down Neural Attention by Excitation Backprop

Zhang, J., Lin, Z., Brandt, J., Shen, X., Sclaroff, S. (Oct. 8, 2016)

European Conference on Computer Vision (ECCV)

Top-down Neural Attention by Excitation Backprop

Zhang, J., Lin, Z., Brandt, J., Shen, X., Sclaroff, S., Zhang, Z. (Sep. 12, 2016)

European Conference on Computer Vision (ECCV)

Sky is Not the Limit: Semantic-Aware Sky Replacement

Tsai, Y., Shen, X., Lin, Z., Sunkavalli, K., Yang, M. (Jul. 1, 2016)

ACM Transactions on Graphics (Proc. of SIGGRAPH)

Shortlist Selection with Residual-Aware Distance Estimator for K-Nearest Neighbor Search

Heo, J., Lin, Z., Shen, X., Brandt, J., Yoon, S. (Jun. 26, 2016)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

A Multi-Level Contextual Model For Person Recognition in Photo Albums

Li, H., Brandt, J., Lin, Z., Shen, X., Hua, G. (Jun. 26, 2016)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Automatic Content-Aware Color and Tone Stylization

Lee, J., Sunkavalli, K., Lin, Z., Shen, X., Kweon, I. (Jun. 26, 2016)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Discovering Primary Objects in Videos by Saliency Fusion and Iterative Appearance Estimation

Yang, J., Zhao, G., Yang, J., Shen, X., Lin, Z., Price, B., Brandt, J. (Jun. 1, 2016)

IEEE Transactions on Circuits and Systems for Video Technology

Unconstrained Salient Object Detection via Proposal Subset Optimization

Zhang, J., Sclaroff, S., Lin, Z., Shen, X., Price, B., Měch, R. (Jun. 1, 2016)

CVPR 2016

Event-specific Image Importance

Wang, Y., Lin, Z., Shen, X., Měch, R., Miller, G., Cottrell, G. (Jun. 1, 2016)

CVPR 2016

Fast Appearance Modeling for Automatic Primary Video Object Segmentation

Yang, J., Price, B., Shen, X., Lin, Z., Yuan, J. (Feb. 1, 2016)

Transactions on Image Processing, Feb 2016.

Minimum Barrier Salient Object Detection at 80 FPS

Zhang, J., Lin, Z., Shen, X., Měch, R., Price, B., Sclaroff, S. (Dec. 1, 2015)

ICCV 2015

Joint Object and Part Segmentation using Deep Learned Potentials

Wang, P., Shen, X., Lin, Z., Cohen, S., Price, B., Yuille, A. (Dec. 1, 2015)

In Proc. International Conference on Computer Vision (ICCV) 2015

Deep Multi-Patch Aggregation Network for Image Style, Aesthetics, and Quality Estimation

Lu, X., Lin, Z., Shen, X., Měch, R., Wang, J. (Dec. 1, 2015)

ICCV 2015

Rating Image Aesthetics Using Deep Learning

Lu, X., Lin, Z., Jin, H., Yang, J., Wang, J. (Nov. 1, 2015)

IEEE Transactions on Multimedia 17(11): 2021-2034

Adaptive Metric Learning for Saliency Detection

Li, S., Lu, H., Lin, Z., Shen, X., Price, B. (Nov. 1, 2015)

Transactions on Image Processing

Inner and Inter Label Propagation: Salient Object Detection in the Wild

Li, H., Lu, H., Lin, Z., Shen, X., Price, B. (Oct. 1, 2015)

Transactions on Image Processing

Discriminative feature learning from big data for visual recognition

Jiang, Z., Lin, Z., Ling, H., Porikli, F., Shao, L., Turaga, P. (Sep. 1, 2015)

Pattern Recognition 48(10): 2961-2963

A Convolutional Neural Network Cascade for Face Detection

Li, H., Lin, Z., Shen, X., Brandt, J., Hua, G. (Jun. 23, 2015)

IEEE Conference on Computer Vision and Pattern Recognition

PatchCut: Data-Driven Object Segmentation via Local Shape Transfer

Yang, J., Price, B., Cohen, S., Lin, Z., Yang, M. (Jun. 8, 2015)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015.

Salient Object Subitizing

Zhang, J., Ma, S., Sameki, M., Sclaroff, S., Betke, M., Lin, Z., Shen, X., Price, B., Měch, R. (Jun. 1, 2015)

CVPR 2015

Subcategory-Aware Object Detection

Yu, X., Yang, J., Lin, Z., Wang, J., Wang, T., Huang, T. (Feb. 1, 2015)

Signal Processing Lett. 22(9): 1472-1476 (2015)

Data-Driven Automatic Cropping for Semantic Composition Search

Samii, A., Lin, Z., Měch, R. (Feb. 1, 2015)

Computer Graphics Forum, 33(1), 2015

Towards Unified Depth and Semantic Prediction from a Single Image

Wang, P., Shen, X., Lin, Z., Cohen, S., Price, B., Yuille, A. (Jan. 1, 2015)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015

Learning an Aesthetic Photo Cropping Cascade

Wang, P., Lin, Z., Měch, R. (Jan. 1, 2015)

WACV 2015

Automatic Image Cropping using Visual Composition, Boundary Simplicity and Content Preservation Models

Fang, C., Lin, Z., Měch, R., Shen, X. (Nov. 1, 2014)

ACM Multimedia 2014

Automatic Cropping Using Semantic Composition Search

Samii, A., Měch, R., Lin, Z. (Oct. 1, 2014)

Computer Graphics Forum. doi: 10.1111/cgf.12465

Consensus of Regression for Occlusion-Robust Facial Feature Localization

Yu, X., Lin, Z., Brandt, J., Metaxas, D. (Sep. 6, 2014)

European Conference on Computer Vision

Efficient Boosted Exemplar-Based Face Detection

Li, H., Lin, Z., Brandt, J., Shen, X., Hua, G. (Jun. 24, 2014)

Computer Vision and Pattern Recognition

Nonparametric Context Modeling of Local Appearance for Pose- and Expression- Robust Facial Landmark Localization

Smith, B., Brandt, J., Lin, Z., Zhang, L. (Jun. 24, 2014)

Computer Vision and Pattern Recognition

Spatially-Constrained Similarity Measure for Large-Scale Object Retrieval

Shen, X., Lin, Z., Brandt, J., Wu, Y. (Jun. 1, 2014)

IEEE Trans. on Pattern Analysis and Machine Intelligence

GPU Asynchronous Stochastic Gradient Descent to Speed Up Neural Network Training

Jin, H., Lin, Z., Yang, J. (Apr. 1, 2014)

Proceedings of the 2nd International Conference on Learning Representations (ICLR 2014), April 2014

Probabilistic Elastic Part Model for Unsupervised Face Detector Adaptation

Li, H., Hua, G., Lin, Z., Brandt, J. (Dec. 1, 2013)

International Conference of Computer Vision

Exemplar-based Graph Matching for Robust Facial Landmark Localization

Zhou, F., Brandt, J., Lin, Z. (Dec. 1, 2013)

Proceedings of the IEEE International Conference on Computer Vision (ICCV 2013), December 2013

Text Localization in Natural Images Using Stroke Feature Transform and Text Covariance Descriptors

Huang, W., Lin, Z., Yang, J., Wang, J. (Dec. 1, 2013)

Proceedings of the IEEE International Conference on Computer Vision (ICCV 2013), December 2013

Probabilistic Elastic Matching for Pose Variant Face Verification

Li, H., Hua, G., Lin, Z., Brandt, J., Yang, J. (Jun. 25, 2013)

Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Large Displacement Optical Flow from Nearest Neighbor Fields

Chen, Z., Jin, H., Lin, Z., Cohen, S., Wu, Y. (Jun. 25, 2013)

Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Fast Image Super-resolution Based on In-place Example Regression

Yang, J., Lin, Z., Cohen, S. (Jun. 25, 2013)

Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Exemplar-Based Face Parsing

Smith, B., Zhang, L., Brandt, J., Lin, Z., Yang, J. (Jun. 25, 2013)

Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Detecting and Aligning Faces by Image Retrieval

Shen, X., Lin, Z., Brandt, J., Wu, Y. (Jun. 25, 2013)

Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Interactive facial feature localization

Le, V., Brandt, J., Lin, Z., Bourdev, L., Huang, T. (Oct. 7, 2012)

European Conf. Computer Vision

Mobile Product Image Search by Automatic Query Object Extraction

Shen, X., Lin, Z., Brandt, J., Wu, Y. (Oct. 7, 2012)

European Conference of Computer Vision

Class Consistent k-means: Application to Face and Action Recognition

Jiang, Z., Lin, Z., Davis, L. (May. 1, 2012)

Computer Vision and Image Understanding , Volume 16, Issue 6, June 2012, Pages 730–741.

Bilevel Sparse Coding for Coupled Feature Spaces

Yang, J., Wang, Z., Lin, Z., Shu, X., Huang, T. (May. 1, 2012)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2012.

Coupled Dictionary Training for Image Super-Resolution

Yang, J., Wang, Z., Lin, Z., Cohen, S., Huang, T. (May. 1, 2012)

IEEE Transactions on Image Processing, 21(8), 3467-3478, Aug. 2012 .

Multi-Scale Shared Features for Cascade Object Detection

Lin, Z., Hua, G., Davis, L. (May. 1, 2012)

IEEE International Conference on Image Processing , 2012.

Object Retrieval and Localization with Spatially-Constrained Similarity Measure and k-NN Re-ranking

Shen, X., Lin, Z., Brandt, J., Avidan, S., Wu, Y. (May. 1, 2012)

IEEE Conference on Computer Vision and Pattern Recognition , 2012.

Recognizing Human Actions by Learning and Matching Shape-Motion Prototype Trees

Jiang, Z., Lin, Z., Davis, L. (Mar. 1, 2012)

IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.34, no.3, pp.533-547, March 2012.

Learning A Discriminative Dictionary for Sparse Coding via Label Consistent K-SVD

Jiang, Z., Lin, Z., Davis, L. (Jun. 21, 2011)

IEEE Conference on Computer Vision and Pattern Recognition , 2011.

A Local Bag-of Features Model for Large-Scale Object Retrieval

Lin, Z., Brandt, J. (Sep. 5, 2010)

European Conference on Computer Vision , 2010.

A Tree-based Approach to Integrated Action Localization, Recognition and Segmentation

Jiang, Z., Lin, Z., Davis, L. (Feb. 1, 2010)

Third Workshop on Human Motion Understanding, Modeling, Capture and Animation, 2010.

Shape-based Human Detection and Segmentation via Hierarchical Part-Template Matching

Lin, Z., Davis, L. (Jan. 31, 2010)

IEEE Transactions on Pattern Analysis and Machine Intelligence , 32 (4), 2010.

Modeling Shape, Appearance and Motion for Human Movement Analysis

Lin, Z. (Jan. 31, 2009)

PhD. Thesis, University of Maryland, College Park.

Multiple Instance Feature for Robust Part-based Object Detection

Lin, Z., Hua, G., Davis, L. (Jan. 31, 2009)

IEEE Computer Society Conference on Computer Vision and Pattern Recognition , Miami, FL

Recognizing Actions by Shape-Motion Prototype Trees

Lin, Z., Jiang, Z., Davis, L. (Jan. 31, 2009)

IEEE International Conference on Computer Vision , Kyoto, Japan, 2009.

A Pose-Invariant Descriptor for Human Detection and Segmentation

Lin, Z., Davis, L. (Jan. 31, 2008)

European Conference on Computer Vision (ECCV 2008), Marseille, France

Learning Pairwise Dissimilarity Profiles for Appearance Recognition in Visual Surveillance

Lin, Z., Davis, L. (Jan. 31, 2008)

International Symposium on Visual Computing (ISVC) , Las Vegas, NV

An Interactive Approach to Pose-Assisted and Appearance-based Segmentation of Humans

Lin, Z., Davis, L., Doermann, D., DeMenthon, D. (Jan. 31, 2007)

ICCV Workshop on Interactive Computer Vision , Rio de Janeiro, Brazil

Hierarchical Part-Template Matching for Human Detection and Segmentation

Lin, Z., Davis, L., Dementhon, D., Doermann, D. (Jan. 31, 2007)

IEEE International Conference on Computer Vision (ICCV 2007), Rio de Janeiro, Brazil

Simultaneous Appearance Modeling and Segmentation for Matching People Under Occlusion

Lin, Z., Davis, L., Doermann, D., DeMenthon, D. (Jan. 31, 2007)

Asian Conference on Computer Vision (ACCV) , Tokyo, Japan

UMD_VDT, an Integration of Detection and Tracking Methods for Multiple Human Tracking

Son., T., Lin, Z., Harwood, D., Davis, L. (Jan. 31, 2007)

NIST CLEAR Evaluation Workshop , Baltimore, MD

Robust Invariant Features for Object Recognition and Mobile Robot Navigation

Lin, Z., Kim, S., Kweon, I. (Jan. 31, 2005)

IAPR Conference on Machine Vision Applications (MVA) , Tsukuba, Japan

Recognition-based Indoor Topological Navigation using Robust Invariant Features

Lin, Z., Kim, S., Kweon, I. (Jan. 31, 2005)

IEEE/RAS Conference on Intelligent Robots and Systems (IROS) , Edmonton, Canada