Kalyan Sunkavalli

Senior Research Scientist

San Jose

I am a Senior Research Scientist at Adobe Research.

I received my Ph.D. from Harvard University in 2012 under the supervision of Hanspeter Pfister. I received my Masters in 2006 from Columbia University. I graduated from the Indian Institute of Technology, Delhi in 2003.

My research interests lie at the intersection of Computer Vision and Graphics; in particular, my work focuses on understanding different aspects of visual appearance in images and videos—illumination, geometry, reflectance, color, texture, motion, etc.—and building tools that enable users to reconstruct, edit and enhance them.

My Publications

Published October 29, 2019

Deep CG2Real: Synthetic-to-Real Translation via Image Disentanglement

International Conference on Computer Vision (ICCV'19)

Sai Bi, Kalyan Sunkavalli, Federico Perazzi, Eli Shechtman, Vladimir Kim, Ravi Ramamoorthi
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published October 27, 2019

Deep Single-Image Portrait Relighting

ICCV 2019

Hao Zhou, Sunil Hadap, Kalyan Sunkavalli, David Jacobs
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published October 27, 2019

Deep Parametric Indoor Lighting Estimation

ICCV 2019

Marc-André Gardner, Yannick Hold-Geoffroy, Kalyan Sunkavalli, Christian Gagné, Jean-François Lalonde
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published August 1, 2019

Deep View Synthesis from Sparse Photometric Images

SIGGRAPH 2019

Zexiang Xu, Sai Bi, Kalyan Sunkavalli, Sunil Hadap, Ravi Ramamoorthi
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published June 16, 2019

Fast Spatially-Varying Indoor Lighting Estimation

Computer Vision and Pattern Recognition (CVPR)

Mathieu Garon, Kalyan Sunkavalli, Sunil Hadap, Nathan Carr, Jean-Francois Lalonde
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published June 1, 2019

All-Weather Deep Outdoor Lighting Estimation

CVPR 2019

Jinsong Zhang, Kalyan Sunkavalli, Yannick Hold-Geoffroy, Sunil Hadap, Jean-François Lalonde
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published June 1, 2019

Learning to Separate Multiple Illuminants in a Single Image

CVPR 2019

Zhuo Hui, Ayan Chakrabarti, Kalyan Sunkavalli, Aswin Sankaranarayanan, Kalyan Sunkavalli
  • AI & Machine Learning
  • Computer Vision, Imaging & Video

Published November 22, 2018

Learning to Reconstruct Shape and Spatially-Varying Reflectance from a Single Image

ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 2018

Zhengqin Li, Zexiang Xu, Ravi Ramamoorthi, Kalyan Sunkavalli, Manmohan Chandraker
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published September 10, 2018

MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamics

European Conference on Computer Vision (ECCV'18)

Xinchen Yan, Akash Rastogi, Ruben Villegas, Kalyan Sunkavalli, Eli Shechtman, Sunil Hadap, Ersin Yumer, Honglak Lee
  • AI & Machine Learning
  • Computer Vision, Imaging & Video

Published September 8, 2018

Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Image

European Conference on Computer Vision (ECCV) 2018 (Oral)

Zhengqin Li, Kalyan Sunkavalli, Manmohan Chandraker
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published September 8, 2018

Compositing-aware Image Search

European Conference on Computer Vision (ECCV) 2018

Hengshuang Zhao, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Brian Price, Jia Jiaya
  • AI & Machine Learning
  • Computer Vision, Imaging & Video

Published August 12, 2018

Deep Image-based Relighting using Optimal Sparse Samples

ACM Transactions on Graphics (Proc. SIGGRAPH) 2018

Zexiang Xu, Kalyan Sunkavalli, Sunil Hadap, Ravi Ramamoorthi
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published June 18, 2018

A Perceptual Measure for Deep Single Image Camera Calibration

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018

Yannick Hold-Geoffroy, Kalyan Sunkavalli, Jonathan Eisenmann, Matt Fisher, Emiliano Gambaretto, Sunil Hadap, Jean-Francois Lalonde
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published June 18, 2018

Fast Video Object Segmentation by Reference-Guided Mask Propagation

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018 (Spotlight)

Seoung Wug Oh, Joon-Young Lee, Kalyan Sunkavalli, Seon Joo Kim
  • AI & Machine Learning
  • Computer Vision, Imaging & Video

Published June 18, 2018

Illuminant Spectra-based Source Separation Using Flash Photography

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018 (Oral)

Zhuo Hui, Kalyan Sunkavalli, Sunil Hadap, Aswin C. Sankaranarayanan
  • Computer Vision, Imaging & Video

Published November 27, 2017

Learning to Predict Indoor Illumination from a Single Image

ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 2017

Marc-Andre Gardner, Kalyan Sunkavalli, Ersin Yumer, Xiaohui Shen, Emiliano Gambaretto, Christian Gagné, Jean-François Lalonde
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published October 22, 2017

Reflectance Capture using Univariate Sampling of BRDFs

International Conference on Computer Vision 2017

Zhuo Hui, Kalyan Sunkavalli, Joon-Young Lee, Sunil Hadap, Aswin C. Sankaranarayanan
  • Computer Vision, Imaging & Video

Published October 15, 2017

Photometric Stabilization for Fast-forward Videos

Pacific Graphics 2017

Xuaner Zhang, Joon-Young Lee, Kalyan Sunkavalli, Zhaowen Wang
  • Computer Vision, Imaging & Video

Published July 30, 2017

Nautilus: Recovering Regional Symmetry Transformations for Image Editing

ACM Transactions on Graphics (Proc. of SIGGRAPH 2017)

Michal Lukáč, Daniel Sykora, Kalyan Sunkavalli, Eli Shechtman, Ondřej Jamriška, Nathan Carr, Tomáš Pajdla
  • Computer Vision, Imaging & Video

Published July 29, 2017

Portrait Lighting Transfer using a Mass Transport Approach

ACM Transactions on Graphics (TOG'17, presented at SIGGRAPH'17)

Zhixin Shu, Sunil Hadap, Eli Shechtman, Kalyan Sunkavalli, Sylvain Paris, Dimitris Samaras
  • Computer Vision, Imaging & Video

Published July 21, 2017

Neural Face Editing with Intrinsic Image Disentangling

IEEE Conference on Computer Vision and Pattern Recognition (CVPR'17)

Zhixin Shu, Ersin Yumer, Sunil Hadap, Kalyan Sunkavalli, Eli Shechtman, Dimitris Samaras
(Oral)
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published July 21, 2017

Deep Outdoor Illumination Estimation

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017 (Oral)

Yannick Hold-Geoffroy, Kalyan Sunkavalli, Sunil Hadap, Emiliano Gambaretto, Jean-François Lalonde
  • AI & Machine Learning
  • Computer Vision, Imaging & Video
  • Graphics (2D & 3D)

Published July 21, 2017

Deep Image Harmonization

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017

Yi-Hsuan Tsai, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Xin Lu, Ming-Hsuan Yang
  • AI & Machine Learning
  • Computer Vision, Imaging & Video

Published April 24, 2017

Consistent Video Filtering for Camera Arrays

Eurographics 2017

Nicolas Bonneel, James Tompkin, Deqing Sun, Oliver Wang, Kalyan Sunkavalli, Sylvain Paris, Hanspeter Pfister
  • Computer Vision, Imaging & Video

Published November 26, 2016

Removing Shadows from Images of Documents

Asian Conference on Computer Vision (ACCV) 2016

Steve Bako, Soheil Darabi, Eli Shechtman, Jue Wang, Kalyan Sunkavalli, Pradeep Sen
  • Computer Vision, Imaging & Video

Published October 25, 2016

Single-image RGB Photometric Stereo With Spatially-varying Albedo

International Conference on 3D Vision (3DV) 2016

Ayan Chakrabarti, Kalyan Sunkavalli
  • Computer Vision, Imaging & Video

Published October 10, 2016

Appearance Harmonization for Single Image Shadow Removal

Computer Graphics Forum (Proc. Pacific Graphics 2016)

Li-Qian Ma, Jue Wang, Eli Shechtman, Kalyan Sunkavalli, Shi-Min Hu
  • Computer Vision, Imaging & Video

Published October 8, 2016

Shading-aware Multi-view Stereo

European Conference on Computer Vision 2016

Fabian Langguth, Kalyan Sunkavalli, Sunil Hadap, Michael Goesele
  • Computer Vision, Imaging & Video

Published July 1, 2016

Sky is Not the Limit: Semantic-Aware Sky Replacement

ACM Transactions on Graphics (Proc. of SIGGRAPH)

Yi-Hsuan Tsai, Xiaohui Shen, Zhe Lin, Kalyan Sunkavalli, Ming-Hsuan Yang
  • AI & Machine Learning
  • Computer Vision, Imaging & Video

Published June 26, 2016

Automatic Content-Aware Color and Tone Stylization

IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

Joon-Young Lee, Kalyan Sunkavalli, Zhe Lin, Xiaohui Shen, In So Kweon
  • Computer Vision, Imaging & Video

Published May 13, 2016

White Balance under Mixed Illumination using Flash Photography

International Conference on Computational Photography (ICCP) 2016

Zhuo Hui, Aswin Sankaranarayanan, Kalyan Sunkavalli, Sunil Hadap
  • Computer Vision, Imaging & Video

Published December 11, 2015

PatchMatch-based Automatic Lattice Detection for Near-Regular Textures

ICCV

S. Liu, Kalyan Sunkavalli, Nathan Carr, E. Shectman, M. Do, T. Ng

Published November 3, 2015

High-Quality Hair Modeling from a Single Portrait Photo

ACM Transactions on Graphics (Proc. SIGGRAPH Asia 2015)

M. Chai, L. Luo, Kalyan Sunkavalli, Nathan Carr, K. Zhou

Published November 2, 2015

Blind Video Temporal Consistency

ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 2015

Nicolas Bonneel, James Tompkin, Kalyan Sunkavalli, Deqing Sun, Sylvain Paris, Hanspeter Pfister
  • Computer Vision, Imaging & Video

Published June 24, 2015

Smooth Loops for Unconstrained Video

Computer Graphics Forum (Proc. of EGSR'15)

L. Sevilla, J. Wulff, Kalyan Sunkavalli, Eli Shechtman

Published April 1, 2014

Automatic scene inference for 3D object compositing

ACM Transactions on Graphics

K. Karsch, Kalyan Sunkavalli, Sunil Hadap, Nathan Carr, Hailin Jin, R. Fonte, M. Sittig, D. Forsyth

Published January 1, 2014

Interactive Intrinsic Video Editing

ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia)

N. Bonneel, Kalyan Sunkavalli, J. Tompkin, D. Sun, Sylvain Paris, H. Pfister

Published January 1, 2014

Time-lapse Photometric Stereo and Applications

Computer Graphics Forum (Proc. Pacific Graphics 2014)

F. Shen, Kalyan Sunkavalli, N. Bonneel, S. Rusinkiewicz, H. Pfister, X. Tong

Published July 1, 2013

Example-based Video Color Grading

ACM Transactions on Graphics (Proceedings of SIGGRAPH), 32(4)

N. Bonneel, Kalyan Sunkavalli, Sylvain Paris, H. Pfister

Published November 1, 2012

Video Snapshots: Creating High-Quality Images from Video Clips

IEEE Transactions on Visualization and Computer Graphics (TVCG)

Kalyan Sunkavalli, N. Joshi, S. Kang, M. Cohen, H. Pfister

Published December 1, 2011

Video Face Replacement

ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia), 30(6).

K. Dale, Kalyan Sunkavalli, M. Johnson, D. Vlasic, W. Matusik, H. Pfister

Published July 1, 2010

Multi-scale Image Harmonization

ACM Transactions on Graphics (Proceedings of SIGGRAPH), 29(4)

Kalyan Sunkavalli, M. Johnson, W. Matusik, H. Pfister

Published January 1, 2010

Visibility Subspaces: Uncalibrated Photometric Stereo with Shadows

Proceedings of the European Conference on Computer Vision (2010)

Kalyan Sunkavalli, T. Zickler, H. Pfister

Published January 1, 2009

What do color changes reveal about an outdoor scene?

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition

Kalyan Sunkavalli, F. Romeiro, W. Matusik, T. Zickler, H. Pfister

Published January 1, 2009

Image Restoration using Online Photo Collections

Proceedings of the IEEE International Conference on Computer Vision (ICCV)

K. Dale, M. Johnson, Kalyan Sunkavalli, W. Matusik, H. Pfister

Published July 1, 2007

Factored Time-Lapse Video

ACM Transactions on Graphics (Proceedings of SIGGRAPH), 26(3).

Kalyan Sunkavalli, W. Matusik, H. Pfister, S. Rusinkiewicz

Published May 1, 2007

Time-Varying BRDFs

IEEE Transactions on Visualization and Computer Graphics (TVCG), 13(3)

B. Sun, Kalyan Sunkavalli, R. Ramamoorthi, P. Belhumeur, S. Nayar