Scott Cohen

Principal Scientist

San Jose

Scott is a researcher at Adobe Systems, Incorporated working in the areas of computer vision and image processing. He received his Ph.D. degree in computer science from Stanford University in 1999 where his advisor was Professor Leonidas Guibas. He also earned a B.S. degree in mathematics from Stanford University in 1993. He did two summer internships in 1993 and 1994 at the Lawrence Livermore National Laboratory under the guidance of Dr. Alan Hindmarsh, where he worked on the CVODE ordinary differential equation solver.

He joined Adobe in July 1999 after completing his doctorate degree. A major focus of his work at Adobe has been selection in images and videos. For example, he made fundamental technology contributions to the Photoshop Quick Selection Tool which uses a brush-based interface to allow users to make a very good selection quickly, and to the Photoshop Refine Edge dialog which allows users to refine a selection to capture fine details such as hair and fur. His technical work for both of these selection features was done with his frequent Adobe collaborator Gregg Wilensky. He has also been a frequent collaborator with Brigham Young University, most recently with Professor Bryan Morse and his Ph.D. student Brian Price on interactive selection in video and images, and image matting.

His research interests include interactive image and video segmentation, image and video matting, stereo, upsampling, and deblurring.

Publications

FineMatch: Aspect-based Fine-grained Image and Text Mismatch Detection and Correction

Hua, H., Shi, J., Kafle, K., Jenni, S., Zhang, D., Collomosse, J., Cohen, S., Liu, J. (Oct. 1, 2024)

European Conference on Computer Vision (ECCV)

FairDeDup: Detecting and Mitigating Vision-Language Fairness Disparities in Semantic Dataset Deduplication

Slyman, E., Lee, S., Cohen, S., Kafle, K. (Jun. 17, 2024)

CVPR 2024

IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representation

Song, Y., Zhang, Z., Lin, Z., Cohen, S., Price, B., Zhang, J., Kim, S., Zhang, H., Xiong, W., Aliaga, D., Price, P. (Jun. 17, 2024)

CVPR 2024

GamutMLP: A Lightweight MLP for Color Loss Recovery

Le, H., Price, B., Cohen, S., Brown, M. (Jun. 18, 2023)

CVPR 2023

ObjectStitch: Generative Object Compositing

Song, Y., Zhang, Z., Lin, Z., Cohen, S., Price, B., Zhang, J., Kim, S., Aliaga, D. (Jun. 18, 2023)

CVPR 2023

CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training

Zheng, H., Lin, Z., Lu, J., Cohen, S., Shechtman, E., Barnes, C., Zhang, J., Xu, N., Amirghodsi, S., Luo, J. (Oct. 23, 2022)

European Conference on Computer Vision (ECCV'22)

Semantic Layout Manipulation with High-Resolution Sparse Attention

Zheng, H., Lin, Z., Lu, J., Cohen, S., Zhang, J., Xu, N., Luo, J. (Apr. 15, 2022)

TPAMI 2022

Deep Interactive Thin Object Selection

Liew, J., Cohen, S., Price, B., Mai, L., Feng, J. (Jan. 3, 2021)

WACV 2021

​ PhraseClick: Toward Achieving Flexible Interactive Segmentation by Phrase and Click

Ding, H., Cohen, S., Price, B., Jiang, X. (Aug. 23, 2020)

ECCV 2020

Deepstrip: High-Resolution Boundary Refinement

Zhou, P., Price, B., Cohen, S., Wilensky, G., Davis, L. (Jun. 20, 2020)

CVPR 2020

Interactive Training and Architecture for Deep Object Selection

Forte, M., Price, B., Cohen, S., Xu, N., Pitie, F. (Jun. 10, 2020)

ICME 2020

Answering Questions About Data Visualizations using Efficient Bimodal Fusion

Kafle, K., Shrestha, R., Price, B., Cohen, S., Kanan, C. (Mar. 1, 2020)

WACV 2020

Unconstrained Foreground Object Search

Zhao, Y., Price, B., Cohen, S., Gurari, D. (Oct. 28, 2019)

International Conference on Computer Vision (ICCV)

MultiSeg: Semantically Meaningful, Scale-Diverse Segmentations from Minimal User Input

Liew, J., Cohen, S., Price, B., Mai, L., Ong, S., Feng, J. (Oct. 28, 2019)

International Conference on Computer Vision (ICCV)

Deep Splitting and Merging for Table Structure Decomposition

Tensmeyer, C., Morariu, V., Price, B., Cohen, S., Martinez, T. (Sep. 23, 2019)

Oral

International Conference on Document Analysis and Recognition (ICDAR)

Deep Visual Template-Free Form Parsing

Davis, B., Morse, B., Cohen, S., Price, B., Tensmeyer, C. (Sep. 20, 2019)

Oral

International Conference on Document Analysis and Recognition (ICDAR)

Multi-label Connectionist Temporal Classification

Wigington, C., Price, B., Cohen, S. (Sep. 20, 2019)

International Conference on Document Analysis and Recognition (ICDAR)

When Color Constancy Goes Wrong: Correcting Improperly White-Balanced Images

Afifi, M., Price, B., Cohen, S., Brown, M. (Jun. 16, 2019)

Conference on Computer Vision and Pattern Recognition (CVPR) 2019

Image Recoloring Based on Object Color Distributions

Afifi, M., Price, B., Cohen, S., Brown, M. (May. 6, 2019)

Eurographics 2019 (short paper)

Guided Image Inpainting: Replacing an Image Region by Pulling Content from Another Image

Zhao, Y., Price, B., Cohen, S., Gurari, D., Price, B. (Jan. 8, 2019)

Winter Conference on Applications of Computer Vision (WACV) 2020

Start, Follow, Read: End-to-End Full-Page Handwriting Recognition

Wigington, C., Tensmeyer, C., Davis, B., Barrett, B., Price, B., Cohen, S. (Sep. 8, 2018)

European Conference on Computer Vision 2018

Interactive Boundary Prediction for Object Selection

Le, H., Mai, L., Price, B., Cohen, S., Jin, H., Liu, F. (Sep. 8, 2018)

European Conference on Computer Vision 2018

YouTube-VOS: Sequence-to-Sequence Video Object Segmentation

Xu, N., Yang, L., Fan, Y., Yang, J., Yue, D., Liang, Y., Price, B., Cohen, S., Huang, T. (Sep. 8, 2018)

European Conference on Computer Vision 2018

DVQA: Understanding Data Visualization via Question Answering

Kafle, K., Cohen, S., Price, B., Kanan, C. (Jun. 18, 2018)

Conference on Computer Vision and Pattern Recognition (CVPR) 2018

Discriminability objective for training descriptive captions

Luo, R., Price, B., Cohen, S., Shakhnarovich, G. (Jun. 18, 2018)

Conference on Computer Vision and Pattern Recognition (CVPR) 2018

Data Augmentation for Recognition of Handwritten Words and Lines using a CNN-LSTM Network

Wigington, C., Stewart, S., Barrett, B., Davis, B., Price, B., Cohen, S. (Nov. 13, 2017)

International Conference on Document Analysis and Retrieval (ICDAR) 2017

Deep Multi-scale Multi-task FCN for Semantic Page Segmentation and Table Structure Detection

He, D., Price, B., Cohen, S., Kifer, D., Giles, L. (Nov. 13, 2017)

International Conference on Document Analysis and Retrieval (ICDAR) 2017

Group-Theme Recoloring for Multi-Image Color Consistency

Nguyen, R., Price, B., Cohen, S., Brown, M. (Oct. 16, 2017)

Pacific Graphics 2017

Deep GrabCut for Object Selection

Xu, N., Price, B., Cohen, S., Yang, J., Huang, T. (Sep. 4, 2017)

British Machine Vision Conference (BMVC) 2017

Depth From Defocus in the Wild

Tang, H., Cohen, S., Price, B., Schiller, S., Kutulakos, K. (Jul. 24, 2017)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition

Forecasting Human Dynamics from Static Images

Chao, Y., Yang, J., Price, B., Cohen, S., Deng, J. (Jul. 23, 2017)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition

Deep Image Matting

Xu, N., Price, B., Cohen, S., Huang, T. (Jul. 22, 2017)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition

Relationship Proposal Networks

Zhang, J., Elhoseiny, M., Cohen, S., Chang, W., Elgammal, A. (Jul. 21, 2017)

IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2017

Expanding Color Query Results via Image Recoloring

Hu, S., Laffont, P., Price, B., Cohen, S., Brown, M. (Apr. 24, 2017)

Eurographics (short paper track)

Towards Richer and Scalable Understanding of facts in Images

Elhoseiny, M., Cohen, S., Chang, W., Price, B., Elgammal, A. (Feb. 4, 2017)

AAAI Conference on Artificial Intelligence

Sherlock: Scalable Fact Learning in Images

Elhoseiny, M., Cohen, S., Chang, W., Price, B., Elgammal, A. (Feb. 4, 2017)

Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence (AAAI-17)

SURGE: Surface Regularized Geometry Estimation from a Single Image

Wang, P., Russell, B., Shen, X., Cohen, S., Price, B., Yuille, A. (Dec. 1, 2016)

Conference on Neural Information Processing Systems

Deep Interactive Object Selection

Xu, N., Price, B., Cohen, S., Yang, J., Huang, T. (Jun. 27, 2016)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016.

Object Contour Detection with a Fully Convolutional Encoder-Decoder Network

Yang, J., Price, B., Cohen, S., Lee, H., Yang, M. (Jun. 27, 2016)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016. (Spotlight)

Interactive Segmentation on RGBD Images via Cue Selection

Feng, J., Price, B., Cohen, S., Chang, S. (Jun. 1, 2016)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016.

Two Illuminant Estimation and User Correction Preference

Cheng, D., Kamel, A., Price, B., Cohen, S., Brown, M. (Jun. 1, 2016)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016.

Automatic Annotation of Structured Facts in Images

Elhoseiny, M., Cohen, S., Chang, W., Price, B., Elgammal, A. (Apr. 2, 2016)

Vision and Language workshop

Beyond White: Ground Truth Colors for Color Constancy Correction

Chen, D., Price, B., Cohen, S., Brown, M. (Dec. 1, 2015)

In Proc. International Conference on Computer Vision (ICCV) 2015

Joint Object and Part Segmentation using Deep Learned Potentials

Wang, P., Shen, X., Lin, Z., Cohen, S., Price, B., Yuille, A. (Dec. 1, 2015)

In Proc. International Conference on Computer Vision (ICCV) 2015

PatchCut: Data-Driven Object Segmentation via Local Shape Transfer

Yang, J., Price, B., Cohen, S., Lin, Z., Yang, M. (Jun. 8, 2015)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015.

Efficient Learning-based Illuminant Estimation Using Simple Features

Cheng, D., Price, B., Cohen, S., Brown, M. (Jan. 1, 2015)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015.

Towards Unified Depth and Semantic Prediction from a Single Image

Wang, P., Shen, X., Lin, Z., Cohen, S., Price, B., Yuille, A. (Jan. 1, 2015)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015

Context Driven Scene Parsing with Attention to Rare Classes

Yang, J., Price, B., Cohen, S., Yang, M. (Jun. 24, 2014)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2014. (Oral)

Semantic Object Segmentation

Ahmed, E., Cohen, S., Price, B. (Jun. 24, 2014)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2014

Temporally Coherent and Spatially Accurate Video Matting

Shahrian, E., Price, B., Cohen, S., Rajan, D. (Apr. 1, 2014)

Proceedings of the 33rd Annual Conference of the European Association for Computer Graphics (Eurographics 2014), April 2014

Depth-based Patch Scaling for Content-Aware Stereo Image Completion

Howard, J., Morse, B., Cohen, S., Price, B. (Jan. 1, 2014)

In Proc. Winter Conference on Applications of Computer Vision (WACV) 2014.

Estimating Spatially Varying Defocus Blur from A Single Image

Zhu, X., Cohen, S., Schiller, S., Milanfar, P. (Dec. 1, 2013)

IEEE Transactions on Image Processing (TIP), Vol. 22, No. 12, Dec 2013

Stereo+Kinect for High Resolution Stereo Correspondences

Somanath, G., Cohen, S., Price, B., Kambhamettu, C. (Jul. 23, 2013)

In Proc. International Conference on 3D Vision (3DV), 2013.

Improving Image Matting using Comprehensive Sampling Sets

Shahrian, E., Rajan, D., Price, B., Cohen, S. (Jul. 23, 2013)

In Proc. International Conference on Computer Vision and Pattern Recognition (CVPR) 2013. (Oral)

High-Quality Stereo Video Matching via User Interaction and Space-Time Propagation

Zhang, C., Price, B., Cohen, S., Yang, R. (Jul. 23, 2013)

In Proc. International Conference on 3D Vision (3DV) , 2013.

Large Displacement Optical Flow from Nearest Neighbor Fields

Chen, Z., Jin, H., Lin, Z., Cohen, S., Wu, Y. (Jun. 25, 2013)

Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Fast Image Super-resolution Based on In-place Example Regression

Yang, J., Lin, Z., Cohen, S. (Jun. 25, 2013)

Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

PatchMatch-Based Content Completion of Stereo Image Pairs

Morse, B., Howard, J., Cohen, S., Price, B. (Oct. 13, 2012)

Best Paper Award

3DIMPVT 2012.

Coupled Dictionary Training for Image Super-Resolution

Yang, J., Wang, Z., Lin, Z., Cohen, S., Huang, T. (May. 1, 2012)

IEEE Transactions on Image Processing, 21(8), 3467-3478, Aug. 2012 .

StereoCut: Consistent Interactive Object Selection in Stereo Image Pairs

Price, B., Cohen, S. (Nov. 21, 2011)

In Proc. International Conference on Computer Vision (ICCV) 2011.

Simultaneous Foreground, Background, and Alpha Estimation for Image Matting

Price, B., Morse, B., Cohen, S. (Feb. 1, 2010)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2010.

Geodesic Graph Cut for Interactive Image Segmentation

Price, B., Morse, B., Cohen, S. (Feb. 1, 2010)

In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2010.

Color Adjacency Modeling for Improved Image and Video Segmentation

Price, B., Morse, B., Cohen, S. (Feb. 1, 2010)

In Proc. International Conference on Pattern Recognition (ICPR) 2010.

LIVEcut: Learning-based Interactive Video Segmentation by Evaluation of Multiple Propagated Cues

Price, B., Morse, B., Cohen, S. (Sep. 2, 2009)

In Proc. International Conference of Computer Vision (ICCV) 2009.

Fast and Adaptive Color-to-Grayscale Conversion

Ruzon, M., Cohen, S., Wilensky, G., Newell, M. (Jan. 31, 2006)

SIGGRAPH '06: ACM SIGGRAPH 2006 Sketches, p. 124

Background Estimation as a Labeling Problem

Cohen, S. (Oct. 10, 2005)

ICCV 2005: Tenth IEEE International Conference on Computer Vision , vol. 2, pp. 1034-1041

The Earth Mover’s Distance under Transformation Sets

Cohen, S., Guibas, L. (Sep. 19, 1999)

ICCV 1999: Seventh IEEE International Conference on Computer Vision

Finding Color and Shape Patterns in Images

Cohen, S. (May. 3, 1999)

Technical Report STAN-CS-TR-99-1620 . This is my thesis work. ( pdf )

The Earth Mover’s Distance: Lower Bounds and Invariance under Translation

Cohen, S., Guibas, L. (Nov. 4, 1997)

Technical Report STAN-CS-TR-97-1597. ( pdf )

Systems of Bilinear Equations

Cohen, S., Tomasi, C. (Apr. 22, 1997)

Technical Report STAN-CS-TR-97-1588 . ( pdf )

Partial Matching of Planar Polylines Under Similarity Transformations

Cohen, S., Guibas, L. (Jan. 1, 1997)

Proceedings of the Eighth Annual ACM-SIAM Symposium on Discrete Algorithms , 777-786

CVODE, a Stiff/Nonstiff ODE Solver in C

Cohen, S., Hindmarsh, A. (Jan. 31, 1996)

Computers in Physics , 10(2):138-143

CVODE User Guide

Cohen, S., Hindmarsh, A. (Aug. 31, 1994)

Technical Report UCRL-MA-118618, LLNL

News