Jingwan (Cynthia) Lu

Senior Research Scientist & Manager

Creative Intelligence Lab, San Jose

Jingwan joined Adobe Research in 2014. Her current research interests include deep-learning based image editing and generation, sketch-based search, creative applications for AR and VR, computational photography, data-driven artistic content creation, and other vision, graphics and machine learning topics.

Jingwan shipped RealBrush (collaborated with Stephen DiVerdi) into Adobe Photoshop Sketch in 2016. RealBrush is a generic data-driven brush synthesis model that can be used to simulate natural media brushes, including but not limited to Soft Pastel, Thick Acrylic and Ink Brush. She mentored over 20 interns and contributed to various research projects in graphics, vision and AI. Some of them attracted lots of public attentions for example, ScribblerVoCo, StyLit, FaceStyle, Playful Palette.

Jingwan received her Ph.D. in computer science from Princeton University. Her PhD work focused on designing algorithms and interfaces for data-driven painting applications, which was published in SIGGRAPH and other conferences. During her PhD, she was awarded Google Research Fellowship and Siebel Scholarship. Before attending Princeton, she received her B.S. in Computer Science and Mathematics from Hong Kong University of Science and Technology (HKUST).

My Publications

Multiplanes: Assisted Freehand VR Drawing

Machuca, M., Asente, P., Lu, J., Kim, B., Stuerzlinger, W. (Oct. 13, 2018)
6th ACM Symposium on Spatial User Interaction (SUI)

SwapNet: Image Based Garment Transfer

Raj, A., Sankloy, P., Chang, H., Hays, J., Ceylan, D., Lu, J. (Sep. 12, 2018)
European Conference on Computer Vision (ECCV)

Towards Virtual Reality Infinite Walking: Dynamic Saccadic Redirection

Sun, Q., Patney, A., Wei, L., Shapira, O., Lu, J., Asente, P., Zhu, S., McGuire, M., Luebke, D., Kaufman, A. (Aug. 12, 2018)
ACM Transactions on Graphics (Proceedings of SIGGRAPH) 2018

Pigmento: Pigment-Based Image Analysis and Editing

Tan, J., DiVerdi, S., Lu, J., Gingold, Y. (Aug. 1, 2018)
IEEE Transactions on Visualization and Computer Graphics (TVCG)

PairedCycleGAN: Asymmetric Style Transfer for Applying and Removing Makeup

Chang, H., Lu, J., Yu, F., Finkelstein, A. (Jun. 18, 2018)
IEEE Conference on Computer Vision and Pattern Recognition (CVPR Oral) , 2018

TextureGAN: Controlling Deep Image Synthesis with Texture Patches

Xian, W., Sankloy, P., Agrawal, V., Raj, A., Lu, J., Fang, C., Yu, F., Hays, J. (Jun. 17, 2018)
IEEE Conference on Computer Vision and Pattern Recognition (CVPR Spotlight) , 2018

FFTNet: a Real-Time Speaker-Dependent Neural Vocoder

Jin, Z., Finkelstein, A., Mysore, G., Lu, J. (Apr. 15, 2018)
The 43rd IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP oral)

Playful Palette: An Interactive Parametric Color Mixer for Artists

Shugrina, M., Lu, J., DiVerdi, S. (Aug. 1, 2017)
ACM Transactions on Graphics (Proc. of SIGGRAPH 2017)

VoCo: Text-based Insertion and Replacement in Audio Narration

Jin, Z., Mysore, G., DiVerdi, S., Lu, J., Finkelstein, A. (Aug. 1, 2017)
ACM Transactions on Graphics (Proc. of SIGGRAPH 2017)

VoCo: text-based insertion and replacement in audio narration

Jin, Z., Mysore, G., DiVerdi, S., Lu, J., Finkelstein, A. (Jul. 31, 2017)
ACM Transactions on Graphics (TOG) 36, no. 4 (2017): 96.

Example-Based Synthesis of Stylized Facial Animations

Fišer, J., Jamriška, O., Simons, D., Shechtman, E., Lu, J., Asente, P., Lukáč, M., Sýkora, D. (Jul. 30, 2017)
ACM Transactions on Graphics (Proc. of SIGGRAPH 2017)

Organized order in ornamentation

Gieseke, L., Asente, P., Lu, J., Fuchs, M. (Jul. 29, 2017)
Proceedings of the symposium on Computational Aesthetics 2017

Scribbler: Controlling Deep Image Synthesis with Sketch and Color

Sangkloy, P., Lu, J., Fang, C., Yu, F., Hays, J. (Jul. 1, 2017)
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) , 2017.

StyLit: Illumination-Guided Example-Based Stylization of 3D Renderings

Fišer, J., Jamriška, O., Lukáč, M., Shechtman, E., Asente, P., Lu, J., Sýkora, D. (Aug. 1, 2016)
ACM Transactions on Graphics (Proc. of SIGGRAPH 2016)

Data-Driven Iconification

Liu, Y., Agarwala, A., Lu, J., Rusinkiewicz, S. (May. 1, 2016)
Best paper award. International Symposium on Non-Photorealistic Animation and Rendering (NPAR)

Patternista: Learning Compatible Elements and Composition for Plate Decoration

Phan, Q., Asente, P., Lu, J., Fu, H., Chan, A. (May. 1, 2016)
International Symposium on Non-Photorealistic Animation and Rendering (NPAR)

CUTE: a Concatenative Method for Voice Conversion Using Exemplar-based Unit Selection

Jin, Z., Finkelstein, A., DiVerdi, S., Lu, J., Mysore, G. (Mar. 1, 2016)
The 41st IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP),

Brushables: Example-based Edge-aware Directional Texture Painting

Lukáč, M., Fišer, J., Asente, P., Lu, J., Shechtman, E., Sýkora, D. (Oct. 8, 2015)
Computer Graphics Forum (Proc. Pacific Graphics 2015)

LazyFluids – Appearance Transfer for Fluid Animations

Jamriška, O., Fišer, J., Asente, P., Lu, J., Shechtman, E., Sýkora, D. (Aug. 1, 2015)
ACM Transactions on Graphics (Proc. SIGGRAPH'15), 34(4)

DecoBrush: Drawing Structured Decorative Patterns by Example

Lu, J., Barnes, C., Wan, C., Asente, P., Měch, R., Finkelstein, A. (Aug. 12, 2014)
ACM Transactions on Graphics (Proc. of SIGGRAPH 2014), 33(4), August 2014

RealPigment: Paint Compositing by Example

Lu, J., DiVerdi, S., Chen, W., Barnes, C., Finkelstein, A. (Jun. 1, 2014)
Best paper award. NPAR 2014 – Proceedings of the ACM/Eurographics Symposium on Non-Photorealistic Animation and Rendering

RealBrush: Painting with Examples of Physical Media

Lu, J., Barnes, C., DiVerdi, S., Finkelstein, A. (Jul. 1, 2013)
ACM Transactions on Graphics (Proc. of SIGGRAPH 2014)

HelpingHand: Example-based Stroke Stylization

Lu, J., Yu, F., Finkelstein, A., DiVerdi, S. (Jul. 1, 2012)
ACM Transactions on Graphics (Proc. of SIGGRAPH 2012), 31(4), July 2012

Active Strokes: Coherent Line Stylization for Animated 3D Models

Bénard, P., Lu, J., Cole, F., Finkelstein, A., Thollot, J. (Jun. 1, 2012)
NPAR 2012 – Proceedings of the ACM/Eurographics Symposium on Non-Photorealistic Animation and Rendering

Perceptual Models of Viewpoint Preference

Secord, A., Lu, J., Finkelstein, A., Singh, M. (Oct. 1, 2011)
TOG 2011, ACM Transactions on Graphics, Volume 30 Issue 5

Interactive Painterly Stylization of Images, Videos and 3D Animations

Lu, J., Sander, P., Finkelstein, A. (Feb. 1, 2010)
I3D 2010, Proceedings of the 2010 ACM SIGGRAPH symposium on Interactive 3D Graphics and Games

A GPU-Based Approach for Real-Time Haptic Rendering of 3D Fluids

Yang, M., Lu, J., Safonova, A., Kuchenbecker, K. (Nov. 1, 2009)
IEEE International Workshop on Haptic Audio-Visual Environments and Games