Kalyan Sunkavalli

Principal Scientist

San Jose

I am a Principal Scientist at Adobe Research.

I received my Ph.D. from Harvard University in 2012 under the supervision of Hanspeter Pfister. I received my Masters in 2006 from Columbia University. I graduated from the Indian Institute of Technology, Delhi in 2003.

My research interests lie at the intersection of Computer Vision and Graphics; in particular, my work focuses on understanding different aspects of visual appearance in images and videos—illumination, geometry, reflectance, color, texture, motion, etc.—and building tools that enable users to reconstruct, edit and enhance them.

Publications

PhotoMat: A Material Generator Learned from Single Flash Photos

Zhou, X., Hašan, M., Deschaintre, V., Guerrero, P., Hold-Geoffroy, Y., Sunkavalli, K., Kalantari, N. (Aug. 1, 2023)

Siggraph 2023

A Semi-Procedural Convolutional Material Prior

Zhou, X., Hašan, M., Deschaintre, V., Guerrero, P., Sunkavalli, K., Kalantari, N. (Mar. 10, 2023)

CGF, Eurographics 2023

TileGen: Tileable, Controllable Material Generation and Capture

Zhou, X., Hašan, M., Deschaintre, V., Guerrero, P., Sunkavalli, K., Kalantari, N. (Dec. 1, 2022)

Siggraph Asia 2022

MatFormer: A Generative Model for Procedural Materials

Guerrero, P., Hašan, M., Sunkavalli, K., Měch, R., Boubekeur, T., Mitra, N. (Aug. 8, 2022)

ACM Transactions on Graphics (Proc. SIGGRAPH 2022)

Point-NeRF: Point-based Neural Radiance Fields

Xu, Q., Xu, Z., Philip, J., Bi, S., Shu, Z., Sunkavalli, K., Neumann, U. (Jun. 19, 2022)

Oral

Computer Vision and Pattern Recognition (CVPR'22)

MATch: Differentiable Material Graphs for Procedural Material Capture

Shi, L., Li, B., Hasan, M., Sunkavalli, K., Boubekeur, T., Měch, R., Matusik, W. (Nov. 26, 2020)

SIGGRAPH Asia 2020

Learning Monocular Face Reconstruction using Multi-View Supervision

Shu, Z., Ceylan, D., Sunkavalli, K., Shechtman, E., Hadap, S., Samaras, D. (Nov. 1, 2020)

Best Paper Runner Up award

Face and Gesture (FG'20)

State of the Art on Neural Rendering

Tewari, A., Fried, O., Thies, J., Sitzmann, V., Lombardi, S., Sunkavalli, K., Martin-Brualla, R., Simon, T., Saragih, J., Niessner, M., Pandey, R., Fanello, S., Wetzstein, G., Zhu, J., Theobalt, C., Agrawala, M., Shechtman, E., Goldman, D., Zollhoefer, M. (Apr. 8, 2020)

Computer Graphics Forum (EG STAR 2020)

Deep CG2Real: Synthetic-to-Real Translation via Image Disentanglement

Bi, S., Sunkavalli, K., Perazzi, F., Shechtman, E., Kim, V., Ramamoorthi, R. (Oct. 29, 2019)

International Conference on Computer Vision (ICCV'19)

Deep Parametric Indoor Lighting Estimation

Gardner, M., Hold-Geoffroy, Y., Sunkavalli, K., Gagné, C., Lalonde, J. (Oct. 27, 2019)

ICCV 2019

Deep Single-Image Portrait Relighting

Zhou, H., Hadap, S., Sunkavalli, K., Jacobs, D. (Oct. 27, 2019)

ICCV 2019

Deep View Synthesis from Sparse Photometric Images

Xu, Z., Bi, S., Sunkavalli, K., Hadap, S., Ramamoorthi, R. (Aug. 1, 2019)

SIGGRAPH 2019

Fast Spatially-Varying Indoor Lighting Estimation

Garon, M., Sunkavalli, K., Hadap, S., Carr, N., Lalonde, J. (Jun. 16, 2019)

Computer Vision and Pattern Recognition (CVPR)

Learning to Separate Multiple Illuminants in a Single Image

Hui, Z., Chakrabarti, A., Sunkavalli, K., Sankaranarayanan, A., Sunkavalli, K. (Jun. 1, 2019)

CVPR 2019

All-Weather Deep Outdoor Lighting Estimation

Zhang, J., Sunkavalli, K., Hold-Geoffroy, Y., Hadap, S., Lalonde, J. (Jun. 1, 2019)

CVPR 2019

Learning to Reconstruct Shape and Spatially-Varying Reflectance from a Single Image

Li, Z., Xu, Z., Ramamoorthi, R., Sunkavalli, K., Chandraker, M. (Nov. 22, 2018)

ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 2018

MT-VAE: Learning Motion Transformations to Generate Multimodal Human Dynamics

Yan, X., Rastogi, A., Villegas, R., Sunkavalli, K., Shechtman, E., Hadap, S., Yumer, E., Lee, H. (Sep. 10, 2018)

European Conference on Computer Vision (ECCV'18)

Materials for Masses: SVBRDF Acquisition with a Single Mobile Phone Image

Li, Z., Sunkavalli, K., Chandraker, M. (Sep. 8, 2018)

European Conference on Computer Vision (ECCV) 2018 (Oral)

Compositing-aware Image Search

Zhao, H., Shen, X., Lin, Z., Sunkavalli, K., Price, B., Jiaya, J. (Sep. 8, 2018)

European Conference on Computer Vision (ECCV) 2018

Deep Image-based Relighting using Optimal Sparse Samples

Xu, Z., Sunkavalli, K., Hadap, S., Ramamoorthi, R. (Aug. 12, 2018)

ACM Transactions on Graphics (Proc. SIGGRAPH) 2018

Illuminant Spectra-based Source Separation Using Flash Photography

Hui, Z., Sunkavalli, K., Hadap, S., Sankaranarayanan, A. (Jun. 18, 2018)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018 (Oral)

Fast Video Object Segmentation by Reference-Guided Mask Propagation

Oh, S., Lee, J., Sunkavalli, K., Kim, S. (Jun. 18, 2018)

Spotlight

IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

A Perceptual Measure for Deep Single Image Camera Calibration

Hold-Geoffroy, Y., Sunkavalli, K., Eisenmann, J., Fisher, M., Gambaretto, E., Hadap, S., Lalonde, J. (Jun. 18, 2018)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018

Learning to Predict Indoor Illumination from a Single Image

Gardner, M., Sunkavalli, K., Yumer, E., Shen, X., Gambaretto, E., Gagné, C., Lalonde, J. (Nov. 27, 2017)

ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 2017

Reflectance Capture using Univariate Sampling of BRDFs

Hui, Z., Sunkavalli, K., Lee, J., Hadap, S., Sankaranarayanan, A. (Oct. 22, 2017)

International Conference on Computer Vision 2017

Photometric Stabilization for Fast-forward Videos

Zhang, X., Lee, J., Sunkavalli, K., Wang, Z. (Oct. 15, 2017)

Pacific Graphics 2017

Nautilus: Recovering Regional Symmetry Transformations for Image Editing

Lukáč, M., Sykora, D., Sunkavalli, K., Shechtman, E., Jamriška, O., Carr, N., Pajdla, T. (Jul. 30, 2017)

ACM Transactions on Graphics (Proc. of SIGGRAPH 2017)

Portrait Lighting Transfer using a Mass Transport Approach

Shu, Z., Hadap, S., Shechtman, E., Sunkavalli, K., Paris, S., Samaras, D. (Jul. 29, 2017)

ACM Transactions on Graphics (TOG'17, presented at SIGGRAPH'17)

Deep Outdoor Illumination Estimation

Hold-Geoffroy, Y., Sunkavalli, K., Hadap, S., Gambaretto, E., Lalonde, J. (Jul. 21, 2017)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017 (Oral)

Deep Image Harmonization

Tsai, Y., Shen, X., Lin, Z., Sunkavalli, K., Lu, X., Yang, M. (Jul. 21, 2017)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017

Neural Face Editing with Intrinsic Image Disentangling

Shu, Z., Yumer, E., Hadap, S., Sunkavalli, K., Shechtman, E., Samaras, D. (Jul. 21, 2017)

(Oral)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR'17)

Consistent Video Filtering for Camera Arrays

Bonneel, N., Tompkin, J., Sun, D., Wang, O., Sunkavalli, K., Paris, S., Pfister, H. (Apr. 24, 2017)

Eurographics 2017

Removing Shadows from Images of Documents

Bako, S., Darabi, S., Shechtman, E., Wang, J., Sunkavalli, K., Sen, P. (Nov. 26, 2016)

Asian Conference on Computer Vision (ACCV) 2016

Single-image RGB Photometric Stereo With Spatially-varying Albedo

Chakrabarti, A., Sunkavalli, K. (Oct. 25, 2016)

International Conference on 3D Vision (3DV) 2016

Appearance Harmonization for Single Image Shadow Removal

Ma, L., Wang, J., Shechtman, E., Sunkavalli, K., Hu, S. (Oct. 10, 2016)

Computer Graphics Forum (Proc. Pacific Graphics 2016)

Shading-aware Multi-view Stereo

Langguth, F., Sunkavalli, K., Hadap, S., Goesele, M. (Oct. 8, 2016)

European Conference on Computer Vision 2016

Sky is Not the Limit: Semantic-Aware Sky Replacement

Tsai, Y., Shen, X., Lin, Z., Sunkavalli, K., Yang, M. (Jul. 1, 2016)

ACM Transactions on Graphics (Proc. of SIGGRAPH)

Automatic Content-Aware Color and Tone Stylization

Lee, J., Sunkavalli, K., Lin, Z., Shen, X., Kweon, I. (Jun. 26, 2016)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR)

White Balance under Mixed Illumination using Flash Photography

Hui, Z., Sankaranarayanan, A., Sunkavalli, K., Hadap, S. (May. 13, 2016)

International Conference on Computational Photography (ICCP) 2016

PatchMatch-based Automatic Lattice Detection for Near-Regular Textures

Liu, S., Sunkavalli, K., Carr, N., Shectman, E., Do, M., Ng, T. (Dec. 11, 2015)

ICCV

PatchMatch-based Automatic Lattice Detection for Near-Regular Textures

Liu, S., Ng, T., Sunkavalli, K., Do, M., Shechtman, E., Carr, N. (Dec. 7, 2015)

International Conference on Computer Vision (ICCV'15)

High-Quality Hair Modeling from a Single Portrait Photo

Chai, M., Luo, L., Sunkavalli, K., Carr, N., Hadap, S., Zhou, K. (Nov. 3, 2015)

ACM Transactions on Graphics (Proc. SIGGRAPH Asia 2015)

Blind Video Temporal Consistency

Bonneel, N., Tompkin, J., Sunkavalli, K., Sun, D., Paris, S., Pfister, H. (Nov. 2, 2015)

ACM Transactions on Graphics (Proc. SIGGRAPH Asia) 2015

Smooth Loops for Unconstrained Video

Sevilla, L., Wulff, J., Sunkavalli, K., Shechtman, E. (Jun. 24, 2015)

Computer Graphics Forum (Proc. of EGSR'15)

Automatic scene inference for 3D object compositing

Karsch, K., Sunkavalli, K., Hadap, S., Carr, N., Jin, H., Fonte, R., Sittig, M., Forsyth, D. (Apr. 1, 2014)

ACM Transactions on Graphics

Time-lapse Photometric Stereo and Applications

Shen, F., Sunkavalli, K., Bonneel, N., Rusinkiewicz, S., Pfister, H., Tong, X. (Jan. 1, 2014)

Computer Graphics Forum (Proc. Pacific Graphics 2014)

Interactive Intrinsic Video Editing

Bonneel, N., Sunkavalli, K., Tompkin, J., Sun, D., Paris, S., Pfister, H. (Jan. 1, 2014)

ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia)

Example-based Video Color Grading

Bonneel, N., Sunkavalli, K., Paris, S., Pfister, H. (Jul. 1, 2013)

ACM Transactions on Graphics (Proceedings of SIGGRAPH), 32(4)

Multi-scale Image Harmonization

Sunkavalli, K., Johnson, M., Matusik, W., Pfister, H. (Jul. 1, 2010)

ACM Transactions on Graphics (Proceedings of SIGGRAPH), 29(4)

What do color changes reveal about an outdoor scene?

Sunkavalli, K., Romeiro, F., Matusik, W., Zickler, T., Pfister, H. (Jan. 1, 2009)

Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition

Image Restoration using Online Photo Collections

Dale, K., Johnson, M., Sunkavalli, K., Matusik, W., Pfister, H. (Jan. 1, 2009)

Proceedings of the IEEE International Conference on Computer Vision (ICCV)

News