Jingwan (Cynthia) Lu

Principal Scientist

San Jose

Jingwan joined Adobe Research in 2014. She is currently leading a team of research scientists and engineers with the vision to disrupt visual content creation with big data and generative AI. Her research interests include generative image modeling (GANs, etc.), computational photography, digital human and data-driven artistic content creation. She has over 30 issued patents and over 40 publications in top vision, graphics and machine learning conferences. Some of them attracted lots of public attentions for example, Scribbler, VoCo, StyLit, FaceStyle, Playful Palette. Jingwan served as a program committee member for Siggraph, Siggraph Asia and Eurographics.

Jingwan is passionate about making real-world impacts with her research. She shipped RealBrush into Adobe Photoshop Sketch in 2016 and to Behance ios in 2018. RealBrush is a generic data-driven brush synthesis model that can be used to simulate natural media brushes, including but not limited to Soft Pastel, Thick Acrylic and Ink Brush. She contributed to the shipping of face stylization feature to Character Animator in 2018, Smooth Skin and Colorize Photo AI features to Photoshop Element in 2019. She and her team members are the main algorithm contributors to smart portrait, skin smoothing, makeup transfer, colorization and neural stylization neural filters in Photoshop in 2020.

Publications

Contrastive Learning for Diverse Disentangled Foreground Generation

Li, Y., Li, Y., Lu, J., Shechtman, E., Lee, Y., Singh, K. (Oct. 23, 2022)

European Conference on Computer Vision (ECCV'22)

CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Training

Zheng, H., Lin, Z., Lu, J., Cohen, S., Shechtman, E., Barnes, C., Zhang, J., Xu, N., Amirghodsi, S., Luo, J. (Oct. 23, 2022)

European Conference on Computer Vision (ECCV'22)

StylePortraitVideo: Editing Portrait Videos using StyleGAN

Seo, K., Oh, S., Lee, J., Lu, J., Kim, S., Noh, J. (Oct. 5, 2022)

Pacific Graphics 2022

Inverting and Editing Real Images with Spatially Varying and Automatic Latent Selection

Parmar, G., Li, Y., Lu, J., Zhang, R., Zhu, J., Singh, K. (Jun. 19, 2022)

CVPR2022

Learning Motion-Dependent Appearance for High-Fidelity Rendering of Dynamic Humans from a Single Camera

Yoon, J., Ceylan, D., Wang, T., Lu, J., Yang, J., Shu, Z., Park, H. (Jun. 19, 2022)

CVPR2022

InsetGAN for Full-Body Image Generation

Frühstück, A., Singh, K., Shechtman, E., Mitra, N., Wonka, P., Lu, J. (Jun. 19, 2022)

CVPR2022

Semantic Layout Manipulation with High-Resolution Sparse Attention

Zheng, H., Lin, Z., Lu, J., Cohen, S., Zhang, J., Xu, N., Luo, J. (Apr. 15, 2022)

TPAMI 2022

Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGAN

AlBahar, B., Lu, J., Yang, J., Shu, Z., Shechtman, E., Huang, J. (Dec. 14, 2021)

Siggraph Asia 2021

Collaging Class-specific GANs for Semantic Image Synthesis

Li, Y., Li, Y., Lu, J., Shechtman, E., Lee, Y., Singh, K., Lu, J. (Oct. 13, 2021)

International Conference on Computer Vision (ICCV'21)

Few-shot Image Generation via Cross-domain Correspondence

Ojha, U., Li, Y., Lu, J., Efros, A., Lee, Y., Shechtman, E., Zhang, R. (Jun. 23, 2021)

Computer Vision and Pattern Recognition (CVPR'21)

IMAGINE: Image Synthesis by Image-Guided Model Inversion

Wang, P., Li, Y., Singh, K., Lu, J., Vasconcelos, N. (Jun. 19, 2021)

CVPR2021

Swapping Autoencoder for Deep Image Manipulation

Park, T., Zhu, J., Wang, O., Lu, J., Shechtman, E., Efros, A., Zhang, R. (Dec. 6, 2020)

Neurips 2020

Few-shot Image Generation via Self-adaptation

Li, Y., Zhang, R., Lu, J., Shechtman, E. (Dec. 6, 2020)

Neurips 2020

Modeling Artistic Workflows for Image Generation and Editing

Tseng, H., Fisher, M., Lu, J., Li, Y., Kim, V., Yang, M., Lu, J. (Aug. 23, 2020)

16th European conference on computer vision (ECCV2020)

Unselfie: Translating Selfies to Neutral-pose Portraits in the Wild

Ma, L., Lin, Z., Barnes, C., Efros, A., Lu, J. (Aug. 23, 2020)

16th European conference on computer vision (ECCV2020)

Adaptive Photographic Composition Guidance

E, J., Fried, O., Lu, J., Zhang, J., Měch, R., Echevarria, J., Hanrahan, P., Landay, J. (Apr. 1, 2020)

ACM CHI 2020

AutoToon: Automatic Geometric Warping for Face Cartoon Generation

Gong, J., Hold-Geoffroy, Y., Lu, J., Lu, J. (Mar. 1, 2020)

The IEEE Winter Conference on Applications of Computer Vision (WACV2020)

Arbitrary Style Transfer Using Neurally-Guided Patch-Based Synthesis

Texler, O., Futschik, D., Fišer, J., Lukáč, M., Lu, J., Shechtman, E., Sýkora, D. (Jan. 1, 2020)

Computers & Graphics (CAG 2020)

HairBrush for Immersive Data-Driven Hair Modeling

Xing, J., Nagano, K., Chen, W., Xu, H., Wei, L., Zhao, Y., Lu, J., Kim, B., Li, H. (Oct. 20, 2019)

SIGGRAPH 2019 Real-time Live and UIST 2019

Stylizing Video by Example

Jamriška, O., Sochorová, S., Texler, O., Lukáč, M., Fišer, J., Lu, J., Shechtman, E., Sýkora, D. (Aug. 1, 2019)

ACM Transactions on Graphics (Proc. SIGGRAPH'19)

Learning to Generate Textures on 3D Meshes

Raj, A., Ham, C., Barnes, C., Hays, J., Kim, V., Lu, J. (Jun. 15, 2019)

Best paper award

CVPR 2019 Workshop on Deep Generative models for 3D understanding

On the Continuity of Rotation Representations in Neural Networks

Zhou, Y., Barnes, C., Lu, J., Yang, J., Li, H. (Jun. 15, 2019)

CVPR 2019

StyleBlit: Fast Example-Based Stylization with Local Guidance

Sýkora, D., Jamriska, O., Lu, J., Shechtman, E. (May. 6, 2019)

Eurographics 2019

Enhancing Neural Style Transfer using Patch-Based Synthesis

Texler, O., Fišer, J., Lukáč, M., Lu, J., Shechtman, E., Sýkora, D. (May. 6, 2019)

Expressive 2019

Generating Playful Palettes from Images

DiVerdi, S., Lu, J., Echevarria, J., Shugrina, M. (May. 6, 2019)

Expressive 2019

Multiplanes: Assisted Freehand VR Drawing

Machuca, M., Asente, P., Lu, J., Kim, B., Stuerzlinger, W. (Oct. 13, 2018)

6th ACM Symposium on Spatial User Interaction (SUI 2018)

SwapNet: Image Based Garment Transfer

Raj, A., Sankloy, P., Chang, H., Hays, J., Ceylan, D., Lu, J. (Sep. 12, 2018)

European Conference on Computer Vision (ECCV 2018)

Towards Virtual Reality Infinite Walking: Dynamic Saccadic Redirection

Sun, Q., Patney, A., Wei, L., Shapira, O., Lu, J., Asente, P., Zhu, S., McGuire, M., Luebke, D., Kaufman, A. (Aug. 12, 2018)

ACM Transactions on Graphics (Proceedings of SIGGRAPH) 2018

Pigmento: Pigment-Based Image Analysis and Editing

Tan, J., DiVerdi, S., Lu, J., Gingold, Y. (Aug. 1, 2018)

IEEE Transactions on Visualization and Computer Graphics (TVCG)

PairedCycleGAN: Asymmetric Style Transfer for Applying and Removing Makeup

Chang, H., Lu, J., Yu, F., Finkelstein, A. (Jun. 18, 2018)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2018

TextureGAN: Controlling Deep Image Synthesis with Texture Patches

Xian, W., Sankloy, P., Agrawal, V., Raj, A., Lu, J., Fang, C., Yu, F., Hays, J. (Jun. 17, 2018)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR Spotlight) , 2018

FFTNet: a Real-Time Speaker-Dependent Neural Vocoder

Jin, Z., Finkelstein, A., Mysore, G., Lu, J. (Apr. 15, 2018)

IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)

Playful Palette: An Interactive Parametric Color Mixer for Artists

Shugrina, M., Lu, J., DiVerdi, S. (Aug. 1, 2017)

ACM Transactions on Graphics (SIGGRAPH)

VoCo: text-based insertion and replacement in audio narration

Jin, Z., Mysore, G., DiVerdi, S., Lu, J., Finkelstein, A. (Jul. 31, 2017)

ACM Transactions on Graphics (SIGGRAPH)

Example-Based Synthesis of Stylized Facial Animations

Fišer, J., Jamriška, O., Simons, D., Shechtman, E., Lu, J., Asente, P., Lukáč, M., Sýkora, D. (Jul. 30, 2017)

ACM Transactions on Graphics (Proc. of SIGGRAPH 2017)

Organized order in ornamentation

Gieseke, L., Asente, P., Lu, J., Fuchs, M. (Jul. 29, 2017)

CAE '17 Proceedings of the Symposium on Computational Aesthetics

Scribbler: Controlling Deep Image Synthesis with Sketch and Color

Sangkloy, P., Lu, J., Fang, C., Yu, F., Hays, J. (Jul. 1, 2017)

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017.

StyLit: Illumination-Guided Example-Based Stylization of 3D Renderings

Fišer, J., Jamriška, O., Lukáč, M., Shechtman, E., Asente, P., Lu, J., Sýkora, D. (Aug. 1, 2016)

ACM Transactions on Graphics (Proc. of SIGGRAPH 2016)

Patternista: Learning Compatible Elements and Composition for Plate Decoration

Phan, Q., Asente, P., Lu, J., Fu, H., Chan, A. (May. 1, 2016)

International Symposium on Non-Photorealistic Animation and Rendering (NPAR)

Data-Driven Iconification

Liu, Y., Agarwala, A., Lu, J., Rusinkiewicz, S. (May. 1, 2016)

Best paper award.

International Symposium on Non-Photorealistic Animation and Rendering (NPAR)

CUTE: a Concatenative Method for Voice Conversion Using Exemplar-based Unit Selection

Jin, Z., Finkelstein, A., DiVerdi, S., Lu, J., Mysore, G. (Mar. 1, 2016)

The 41st IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)

Brushables: Example-based Edge-aware Directional Texture Painting

Lukáč, M., Fišer, J., Asente, P., Lu, J., Shechtman, E., Sýkora, D. (Oct. 8, 2015)

Computer Graphics Forum (Proc. Pacific Graphics 2015)

LazyFluids – Appearance Transfer for Fluid Animations

Jamriška, O., Fišer, J., Asente, P., Lu, J., Shechtman, E., Sýkora, D. (Aug. 1, 2015)

ACM Transactions on Graphics (Proc. SIGGRAPH'15), 34(4)

DecoBrush: Drawing Structured Decorative Patterns by Example

Lu, J., Barnes, C., Wan, C., Asente, P., Měch, R., Finkelstein, A. (Aug. 12, 2014)

ACM Transactions on Graphics (Proc. of SIGGRAPH 2014), 33(4), August 2014

RealPigment: Paint Compositing by Example

Lu, J., DiVerdi, S., Chen, W., Barnes, C., Finkelstein, A. (Jun. 1, 2014)

Best paper award

Non-Photorealistic Animation and Rendering (NPAR)

RealBrush: Painting with Examples of Physical Media

Lu, J., Barnes, C., DiVerdi, S., Finkelstein, A. (Jul. 1, 2013)

ACM Transactions on Graphics (SIGGRAPH)

HelpingHand: Example-based Stroke Stylization

Lu, J., Yu, F., Finkelstein, A., DiVerdi, S. (Jul. 1, 2012)

ACM Transactions on Graphics (SIGGRAPH)

Active Strokes: Coherent Line Stylization for Animated 3D Models

Bénard, P., Lu, J., Cole, F., Finkelstein, A., Thollot, J. (Jun. 1, 2012)

NPAR 2012 – Proceedings of the ACM/Eurographics Symposium on Non-Photorealistic Animation and Rendering

Perceptual Models of Viewpoint Preference

Secord, A., Lu, J., Finkelstein, A., Singh, M. (Oct. 1, 2011)

TOG 2011, ACM Transactions on Graphics, Volume 30 Issue 5

Interactive Painterly Stylization of Images, Videos and 3D Animations

Lu, J., Sander, P., Finkelstein, A. (Feb. 1, 2010)

I3D 2010, Proceedings of the 2010 ACM SIGGRAPH symposium on Interactive 3D Graphics and Games