We address the problem of editing facial expression in
video, such as exaggerating, attenuating or replacing the
expression with a different one in some parts of the video.
To achieve this we develop a tensor-based 3D face geometry reconstruction method, which fits a 3D model for each
video frame, with the constraint that all models have the
same identity and requiring temporal continuity of pose and
expression. With the identity constraint, the differences between the underlying 3D shapes capture only changes in expression and pose. We show that various expression editing
tasks in video can be achieved by combining face reordering
with face warping, where the warp is induced by projecting
differences in 3D face shapes into the image plane. Analogously, we show how the identity can be manipulated while
fixing expression and pose. Experimental results show that
our method can effectively edit expressions and identity in
video in a temporally-coherent way with high fidelity