论文标题
逼真的面部皱纹清除
Photorealistic Facial Wrinkles Removal
论文作者
论文摘要
编辑和修饰面部属性是一项复杂的任务,通常需要人类艺术家获得光真实的结果。它的应用程序很多,可以在多种情况下找到,例如化妆品或数字媒体修饰,仅举几例。最近,有条件生成建模的进步显示了以现实方式修改面部属性的惊人结果。但是,当前的方法仍然容易产生工件,并专注于修改年龄和性别等全球属性,或者当地的中型属性(例如眼镜或胡须)。在这项工作中,我们重新审视了一种两阶段的方法,用于修饰面部皱纹,并以前所未有的现实主义获得结果。首先,使用最先进的皱纹细分网络来检测面部区域内的皱纹。然后,使用介入模块去除检测到的皱纹,使它们填充在统计学上与周围皮肤一致的质地。为了实现这一目标,我们介绍了一个新颖的损失术语,该损失术语重复了皱纹细分网络,以惩罚那些在介入后仍然含有皱纹的地区。我们在定性和定量上评估我们的方法,显示了清除皱纹的任务的最新结果。此外,我们介绍了第一个名为FFHQ-Wrinkles的高分辨率数据集,以评估皱纹检测方法。
Editing and retouching facial attributes is a complex task that usually requires human artists to obtain photo-realistic results. Its applications are numerous and can be found in several contexts such as cosmetics or digital media retouching, to name a few. Recently, advancements in conditional generative modeling have shown astonishing results at modifying facial attributes in a realistic manner. However, current methods are still prone to artifacts, and focus on modifying global attributes like age and gender, or local mid-sized attributes like glasses or moustaches. In this work, we revisit a two-stage approach for retouching facial wrinkles and obtain results with unprecedented realism. First, a state of the art wrinkle segmentation network is used to detect the wrinkles within the facial region. Then, an inpainting module is used to remove the detected wrinkles, filling them in with a texture that is statistically consistent with the surrounding skin. To achieve this, we introduce a novel loss term that reuses the wrinkle segmentation network to penalize those regions that still contain wrinkles after the inpainting. We evaluate our method qualitatively and quantitatively, showing state of the art results for the task of wrinkle removal. Moreover, we introduce the first high-resolution dataset, named FFHQ-Wrinkles, to evaluate wrinkle detection methods.