Connelly Barnes

Senior Research Scientist

Seattle

Connelly is a researcher whose interests span a variety of topics in computer graphics and vision. He is interested in image and video processing, compiler tools, patch-based algorithms, deep learning, brush interfaces, and augmented and virtual reality.

Connelly received his Ph.D. from Princeton University in 2011. During his Ph.D., he did Adobe internships and his research was integrated into Adobe features such as “content-aware fill.” He worked as a postdoctoral research scientist at Adobe from 2011-2013. He then was an assistant professor of computer science at the University of Virginia from 2013-2017, where he continued to have a number of Adobe collaborations. He returned to Adobe in 2018 to continue the adventure.

A complete list of his publications can be found on his personal website or his Google Scholar profile.

Publications

Diffusion2GAN: Distilling Diffusion Models into Conditional GANs

Kang, M., Zhang, R., Barnes, C., Paris, S., Kwak, S., Park, J., Shechtman, E., Zhu, J., Park, T. (Oct. 3, 2024)

European Conference on Computer Vision (ECCV'24)

Brush2Prompt: Contextual Prompt Generator for Object Inpainting

Chiu, M., Zhou, Y., Zhang, L., Lin, Z., Barnes, C., Amirghodsi, S., Shechtman, E., Shi, H. (Jun. 17, 2024)

CVPR 2024

Perceptual Artifacts Localization for Image Synthesis Tasks

Zhang, L., Xu, Z., Barnes, C., Zhou, Y., Liu, Q., Zhang, H., Lin, Z., Amirghodsi, S., Shechtman, E., Shi, J. (Oct. 4, 2023)

International Conference on Computer Vision (ICCV'23)

SimpSON: Simplifying Photo Cleanup With Single-Click Distracting Object Segmentation Network

Huynh, C., Zhou, Y., Lin, Z., Barnes, C., Shechtman, E., Amirghodsi, S., Shrivastava, A. (Jun. 20, 2023)

Computer Vision and Pattern Recognition (CVPR'23)

Automatic High Resolution Wire Segmentation and Removal

Chiu, M., Zhang, X., Wei, Z., Zhou, Y., Shechtman, E., Barnes, C., Lin, Z., Kainz, F., Amirghodsi, S., Shi, H., Shechtman, S. (Jun. 20, 2023)

Computer Vision and Pattern Recognition (CVPR'23)

Automatic High Resolution Wire Segmentation and Removal

Chiu, M., Zhang, X., Wei, Z., Zhou, Y., Shechtman, E., Barnes, C., Lin, Z., Kainz, F., Amirghodsi, S., Shi, H. (Apr. 1, 2023)

CVPR 2023

GeoFill: Reference-Based Image Inpainting with Better Geometric Understanding

Zhao, Y., Barnes, C., Zhou, Y., Shechtman, E., Amirghodsi, S., Fowlkes, C. (Jan. 3, 2023)

WACV 2023

Perceptual Artifacts Localization for Inpainting

Zhang, L., Zhou, Y., Barnes, C., Amirghodsi, S., Lin, Z., Shechtman, E., Shi, J. (Oct. 27, 2022)

Oral

European Conference on Computer Vision (ECCV'22)

Inpainting at Modern Camera Resolution by Guided PatchMatch with Auto-Curation

Zhang, L., Barnes, C., Wampler, K., Amirghodsi, S., Shechtman, E., Lin, Z., Shi, J. (Oct. 26, 2022)

European Conference on Computer Vision (ECCV'22)

CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training

Zheng, H., Lin, Z., Lu, J., Cohen, S., Shechtman, E., Barnes, C., Zhang, J., Xu, N., Amirghodsi, S., Luo, J. (Oct. 23, 2022)

European Conference on Computer Vision (ECCV'22)

Modulated Periodic Activations for Generalizable Local Functional Representations

Mehta, I., Gharbi, M., Barnes, C., Shechtman, E., Ramamoorthi, R., Chandraker, M. (Oct. 13, 2021)

International Conference on Computer Vision (ICCV'21)

TransFill: Reference-guided Image Inpainting by Merging Multiple Color and Spatial Transformations

Zhou, Y., Barnes, C., Shechtman, E., Amirghodsi, S. (Jun. 21, 2021)

Computer Vision and Pattern Recognition (CVPR'21)

Unselfie: Translating Selfies to Neutral-pose Portraits in the Wild

Ma, L., Lin, Z., Barnes, C., Efros, A., Lu, J. (Aug. 23, 2020)

16th European conference on computer vision (ECCV2020)

Image Morphing with Perceptual Constraints and STN Alignment

Fish, N., Zhang, R., Perry, L., Cohen-Or, D., Shechtman, E., Barnes, C. (May. 1, 2020)

Computer Graphics Forum (CGF)

Texture Mixer: A Network for Controllable Synthesis and Interpolation of Texture

Yu, N., Barnes, C., Shechtman, E., Amirghodsi, S., Lukáč, M. (Jun. 18, 2019)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR'19)

Learning to Generate Textures on 3D Meshes

Raj, A., Ham, C., Barnes, C., Hays, J., Kim, V., Lu, J. (Jun. 15, 2019)

Best paper award

CVPR 2019 Workshop on Deep Generative models for 3D understanding

On the Continuity of Rotation Representations in Neural Networks

Zhou, Y., Barnes, C., Lu, J., Yang, J., Li, H. (Jun. 15, 2019)

CVPR 2019

Learning to Detect Multiple Photographic Defects

Yu, N., Shen, X., Lin, Z., Měch, R., Barnes, C. (Mar. 12, 2018)

WACV 2018 : IEEE Winter Conference on Applications of Computer Vision

Synthesis of Complex Image Appearance from Limited Exemplars

Diamanti, O., Paris, S., Barnes, C., Shechtman, E., Sorkine-Hornung, O. (Feb. 1, 2015)

ACM Transactions on Graphics (Proc. TOG'15), 34(2)

DecoBrush: Drawing Structured Decorative Patterns by Example

Lu, J., Barnes, C., Wan, C., Asente, P., Měch, R., Finkelstein, A. (Aug. 12, 2014)

ACM Transactions on Graphics (Proc. of SIGGRAPH 2014), 33(4), August 2014

Style Transfer for Headshot Portraits

Shih, Y., Paris, S., Barnes, C., Durand, F., Freeman, W. (Aug. 1, 2014)

ACM SIGGRAPH 2014

Camouflaging an Object from Many Viewpoints

Owens, A., Barnes, C., Flint, A., Singh, H., Freeman, W. (Jan. 3, 2014)

CVPR 2014 (oral presentation)

Patch-based High Dynamic Range Video

Kalantari, N., Shechtman, E., Barnes, C., Darabi, S., Goldman, D., Sen, P. (Nov. 19, 2013)

ACM Transactions on Graphics (Proc. SIGGRAPH Asia'13), 32(5), November 2013

RealBrush: Painting with Examples of Physical Media

Lu, J., Barnes, C., DiVerdi, S., Finkelstein, A. (Jul. 1, 2013)

ACM Transactions on Graphics (SIGGRAPH)

Halide: A Language and Compiler for Optimizing Parallelism, Locality and Recomputation in Image Processing Pipelines

Ragan-Kelley, J., Barnes, C., Adams, A., Paris, S., Durand, F., Amarasinghe, S. (Jun. 1, 2013)

ACM PLDI

Image melding: Combining inconsistent images using patch-based synthesis

Darabi, S., Shechtman, E., Barnes, C., Goldman, D., Sen, P. (Aug. 5, 2012)

ACM Transactions on Graphics (Proc. SIGGRAPH'12) , 31(4), August 2012.

The PatchMatch randomized matching algorithm for image manipulation

Barnes, C., Goldman, D., Shechtman, E., Finkelstein, A. (Nov. 1, 2011)

Research Highlight

Communications of the ACM (CACM)

The generalized PatchMatch correspondence algorithm

Barnes, C., Shechtman, E., Goldman, D., Finkelstein, A. (Sep. 1, 2010)

In Proc. European Conference on Computer Vision , Crete, 2010.

Video tapestries with continuous temporal zoom

Barnes, C., Goldman, D., Shechtman, E., Finkelstein, A. (Jul. 2, 2010)

ACM Transactions on Graphics (Proc. SIGGRAPH) , 29(3), 2010.

PatchMatch: A randomized correspondence algorithm for structural image editing

Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D. (Aug. 2, 2009)

ACM Transactions on Graphics (Proc. SIGGRAPH), 28(3), 2009.

Video puppetry: A performative interface for cutout animation

Barnes, C., Jacobs, D., Sanders, J., Goldman, D., Rusinkiewicz, S., Finkelstein, A., Agarwala, M. (Dec. 2, 2008)

ACM Transactions on Graphics (Proc. SIGGRAPH Asia) , 27(5), 2008.