Content-Aware Fill

Dan Goldman

Adobe Research

Eli Shechtman

Adobe Research

Connelly Barnes

Adobe Research

Ivan Belaunde

Adobe Research

Jeff Chien

Adobe Research


Content-Aware Fill and Content-Aware Spot Healing are new features in Photoshop CS5 that dramatically simplify the process of removing objects from an image or even expanding the boundaries of a cropped image. The hole filling method is based on Space-Time Video Completion that was developed externally at the Weizmann Institute. The speed of Content-Aware Fill comes from a new image search algorithm called PatchMatch that runs 20-100x faster than previous approaches. PatchMatch was developed as a joint research project with Princeton University. This technology is now also part of Photoshop Elements 9. In Photoshop CS6 we did some quality improvements as well as removed memory limitations for filling large images (e.g. panorama boundaries).

Content-Aware Fill was awarded a Technical Excellence Award for 2010 by the PC Magazine!

Here are some links to press and videos about this feature:

Related projects: Content-Aware Move and Patch tools in Photoshop CS6, PatchMatch

Project Publications

PatchMatch: A randomized correspondence algorithm for structural image editing

Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D. (Aug. 2, 2009)
ACM Transactions on Graphics (Proc. SIGGRAPH), 28(3), 2009.

Space-time completion of video

Wexler, Y., Shechtman, E., Irani, M. (Feb. 1, 2007)
In IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)