Scott Cohen

Principal Scientist

Creative Intelligence Lab, San Jose

Scott isĀ a researcher at Adobe Systems, Incorporated working in the areas of computer vision and image processing. He received his Ph.D. degree in computer science from Stanford University in 1999 where his advisor was Professor Leonidas Guibas. He also earned a B.S. degree in mathematics from Stanford University in 1993. He did two summer internships in 1993 and 1994 at the Lawrence Livermore National Laboratory under the guidance of Dr. Alan Hindmarsh, where he worked on the CVODE ordinary differential equation solver.

He joined Adobe in July 1999 after completing his doctorate degree. A major focus of his work at Adobe has been selection in images and videos. For example, he made fundamental technology contributions to the Photoshop Quick Selection Tool which uses a brush-based interface to allow users to make a very good selection quickly, and to the Photoshop Refine Edge dialog which allows users to refine a selection to capture fine details such as hair and fur. His technical work for both of these selection features was done with his frequent Adobe collaborator Gregg Wilensky. He has also been a frequent collaborator with Brigham Young University, most recently with Professor Bryan Morse and his Ph.D. student Brian Price on interactive selection in video and images, and image matting.

HisĀ research interests include interactive image and video segmentation, image and video matting, stereo, upsampling, and deblurring.

My Publications

Discriminability objective for training descriptive captions

Luo, R., Price, B., Cohen, S., Shakhnarovich, G. (Jun. 18, 2018)
Conference on Computer Vision and Pattern Recognition (CVPR) 2018

DVQA: Understanding Data Visualization via Question Answering

Kafle, K., Cohen, S., Price, B., Kanan, C. (Jun. 18, 2018)
Conference on Computer Vision and Pattern Recognition (CVPR) 2018

Deep Multi-scale Multi-task FCN for Semantic Page Segmentation and Table Structure Detection

He, D., Price, B., Cohen, S., Kifer, D., Giles, L. (Nov. 13, 2017)
International Conference on Document Analysis and Retrieval (ICDAR) 2017

Data Augmentation for Recognition of Handwritten Words and Lines using a CNN-LSTM Network

Wigington, C., Stewart, S., Barrett, B., Davis, B., Price, B., Cohen, S. (Nov. 13, 2017)
International Conference on Document Analysis and Retrieval (ICDAR) 2017

Group-Theme Recoloring for Multi-Image Color Consistency

Nguyen, R., Price, B., Cohen, S., Brown, M. (Oct. 16, 2017)
Pacific Graphics 2017

Deep GrabCut for Object Selection

Xu, N., Price, B., Cohen, S., Yang, J., Huang, T. (Sep. 4, 2017)
British Machine Vision Conference (BMVC) 2017

Depth From Defocus in the Wild

Tang, H., Cohen, S., Price, B., Schiller, S., Kutulakos, K. (Jul. 24, 2017)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition

Forecasting Human Dynamics from Static Images

Chao, Y., Yang, J., Price, B., Cohen, S., Deng, J. (Jul. 23, 2017)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition

Deep Image Matting

Xu, N., Price, B., Cohen, S., Huang, T. (Jul. 22, 2017)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition

Expanding Color Query Results via Image Recoloring

Hu, S., Laffont, P., Price, B., Cohen, S., Brown, M. (Apr. 24, 2017)
Eurographics (short paper track)

Towards Richer and Scalable Understanding of facts in Images

Elhoseiny, M., Cohen, S., Chang, W., Price, B., Elgammal, A. (Feb. 4, 2017)
AAAI Conference on Artificial Intelligence

SURGE: Surface Regularized Geometry Estimation from a Single Image

Wang, P., Russell, B., Shen, X., Cohen, S., Price, B., Yuille, A. (Dec. 1, 2016)
Conference on Neural Information Processing Systems

Deep Interactive Object Selection

Xu, N., Price, B., Cohen, S., Yang, J., Huang, T. (Jun. 27, 2016)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016.

Object Contour Detection with a Fully Convolutional Encoder-Decoder Network

Yang, J., Price, B., Cohen, S., Lee, H., Yang, M. (Jun. 27, 2016)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016. (Spotlight)

Interactive Segmentation on RGBD Images via Cue Selection

Feng, J., Price, B., Cohen, S., Chang, S. (Jun. 1, 2016)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016.

Two Illuminant Estimation and User Correction Preference

Cheng, D., Kamel, A., Price, B., Cohen, S., Brown, M. (Jun. 1, 2016)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2016.

Automatic Annotation of Structured Facts in Images

Elhoseiny, M., Cohen, S., Chang, W., Price, B., Elgammal, A. (Apr. 2, 2016)
Vision and Language workshop

Beyond White: Ground Truth Colors for Color Constancy Correction

Chen, D., Price, B., Cohen, S., Brown, M. (Dec. 1, 2015)
In Proc. International Conference on Computer Vision (ICCV) 2015

Joint Object and Part Segmentation using Deep Learned Potentials

Wang, P., Shen, X., Lin, Z., Cohen, S., Price, B., Yuille, A. (Dec. 1, 2015)
In Proc. International Conference on Computer Vision (ICCV) 2015

PatchCut: Data-Driven Object Segmentation via Local Shape Transfer

Yang, J., Price, B., Cohen, S., Lin, Z., Yang, M. (Jun. 8, 2015)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015.

Efficient Learning-based Illuminant Estimation Using Simple Features

Cheng, D., Price, B., Cohen, S., Brown, M. (Jan. 1, 2015)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015.

Towards Unified Depth and Semantic Prediction from a Single Image

Wang, P., Shen, X., Lin, Z., Cohen, S., Price, B., Yuille, A. (Jan. 1, 2015)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015

Context Driven Scene Parsing with Attention to Rare Classes

Yang, J., Price, B., Cohen, S., Yang, M. (Jun. 24, 2014)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2014. (Oral)

Semantic Object Segmentation

Ahmed, E., Cohen, S., Price, B. (Jun. 24, 2014)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2014

Temporally Coherent and Spatially Accurate Video Matting

Shahrian, E., Price, B., Cohen, S., Rajan, D. (Apr. 1, 2014)
Proceedings of the 33rd Annual Conference of the European Association for Computer Graphics (Eurographics 2014), April 2014

Depth-based Patch Scaling for Content-Aware Stereo Image Completion

Howard, J., Morse, B., Cohen, S., Price, B. (Jan. 1, 2014)
In Proc. Winter Conference on Applications of Computer Vision (WACV) 2014.

Estimating Spatially Varying Defocus Blur from A Single Image

Zhu, X., Cohen, S., Schiller, S., Milanfar, P. (Dec. 1, 2013)
IEEE Transactions on Image Processing (TIP), Vol. 22, No. 12, Dec 2013

High-Quality Stereo Video Matching via User Interaction and Space-Time Propagation

Zhang, C., Price, B., Cohen, S., Yang, R. (Jul. 23, 2013)
In Proc. International Conference on 3D Vision (3DV) , 2013.

Improving Image Matting using Comprehensive Sampling Sets

Shahrian, E., Rajan, D., Price, B., Cohen, S. (Jul. 23, 2013)
In Proc. International Conference on Computer Vision and Pattern Recognition (CVPR) 2013. (Oral)

Stereo+Kinect for High Resolution Stereo Correspondences

Somanath, G., Cohen, S., Price, B., Kambhamettu, C. (Jul. 23, 2013)
In Proc. International Conference on 3D Vision (3DV), 2013.

Fast Image Super-resolution Based on In-place Example Regression

Yang, J., Lin, Z., Cohen, S. (Jun. 25, 2013)
Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

Large Displacement Optical Flow from Nearest Neighbor Fields

Chen, Z., Jin, H., Lin, Z., Cohen, S., Wu, Y. (Jun. 25, 2013)
Proceedings of IEEE conference on Computer Vision and Pattern Recognition (CVPR), June 2013.

PatchMatch-Based Content Completion of Stereo Image Pairs

Morse, B., Howard, J., Cohen, S., Price, B. (Oct. 13, 2012)
Best Paper Award 3DIMPVT 2012.

Coupled Dictionary Training for Image Super-Resolution

Yang, J., Wang, Z., Lin, Z., Cohen, S., Huang, T. (May. 1, 2012)
IEEE Transactions on Image Processing, 21(8), 3467-3478, Aug. 2012 .

StereoCut: Consistent Interactive Object Selection in Stereo Image Pairs

Price, B., Cohen, S. (Nov. 21, 2011)
In Proc. International Conference on Computer Vision (ICCV) 2011.

Color Adjacency Modeling for Improved Image and Video Segmentation

Price, B., Morse, B., Cohen, S. (Feb. 1, 2010)
In Proc. International Conference on Pattern Recognition (ICPR) 2010.

Geodesic Graph Cut for Interactive Image Segmentation

Price, B., Morse, B., Cohen, S. (Feb. 1, 2010)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2010.

Simultaneous Foreground, Background, and Alpha Estimation for Image Matting

Price, B., Morse, B., Cohen, S. (Feb. 1, 2010)
In Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2010.

LIVEcut: Learning-based Interactive Video Segmentation by Evaluation of Multiple Propagated Cues

Price, B., Morse, B., Cohen, S. (Sep. 2, 2009)
In Proc. International Conference of Computer Vision (ICCV) 2009.

Fast and Adaptive Color-to-Grayscale Conversion

Ruzon, M., Cohen, S., Wilensky, G., Newell, M. (Jan. 31, 2006)
SIGGRAPH '06: ACM SIGGRAPH 2006 Sketches, p. 124

Background Estimation as a Labeling Problem

Cohen, S. (Oct. 10, 2005)
ICCV 2005: Tenth IEEE International Conference on Computer Vision , vol. 2, pp. 1034-1041

The Earth Mover’s Distance under Transformation Sets

Cohen, S., Guibas, L. (Sep. 19, 1999)
ICCV 1999: Seventh IEEE International Conference on Computer Vision

Finding Color and Shape Patterns in Images

Cohen, S. (May. 3, 1999)
Technical Report STAN-CS-TR-99-1620 . This is my thesis work. ( pdf )

The Earth Mover’s Distance: Lower Bounds and Invariance under Translation

Cohen, S., Guibas, L. (Nov. 4, 1997)
Technical Report STAN-CS-TR-97-1597. ( pdf )

Systems of Bilinear Equations

Cohen, S., Tomasi, C. (Apr. 22, 1997)
Technical Report STAN-CS-TR-97-1588 . ( pdf )

Partial Matching of Planar Polylines Under Similarity Transformations

Cohen, S., Guibas, L. (Jan. 1, 1997)
Proceedings of the Eighth Annual ACM-SIAM Symposium on Discrete Algorithms , 777-786

CVODE, a Stiff/Nonstiff ODE Solver in C

Cohen, S., Hindmarsh, A. (Jan. 31, 1996)
Computers in Physics , 10(2):138-143

CVODE User Guide

Cohen, S., Hindmarsh, A. (Aug. 31, 1994)
Technical Report UCRL-MA-118618, LLNL