Hu, Rongrong Ji, Xu Chen, Yiyi Zhou, Jiangning Zhang, Chengjie Wang, Chengming Xu, Yuqi Liu, Junwei Zhu, Zhiyao Wang, Xiaobin †✧
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Face Restoration (FR) is a crucial area within image and video processing, focusing on reconstructing high-quality portraits from degraded inputs. Despite advancements in image FR, video FR remains relatively under-explored, primarily due to challenges related to temporal consistency, motion artifacts, and the limited availability of high-quality video data. Moreover, traditional face restoration typically prioritizes enhancing resolution and may not give as much consideration to related tasks such as facial colorization and inpainting. In this paper, we propose a novel approach for the Generalized Video Face Restoration (GVFR) task, which integrates video blind face restoration (BFR), inpainting, and colorization tasks that we empirically show to benefit each other. We present a unified framework, termed as stable video face restoration (SVFR), which leverages the generative and motion priors of Stable Video Diffusion (SVD) and incorporates task-specific information through a unified face restoration framework. A learnable task embedding is introduced to enhance task identification. Meanwhile, a novel Unified Latent Regularization (ULR) is employed to encourage the shared feature representation learning among different subtasks. To further enhance the restoration quality and temporal stability, we introduce the facial prior learning and the self-referred refinement as auxiliary strategies. The proposed framework effectively combines the complementary strengths of these tasks, enhancing temporal coherence and achieving superior restoration quality. This work advances the state-ofthe-art in video FR and establishes a new paradigm for generalized video face restoration. Code and video demo are available at https://github.com/wangzhiyaoo/ SVFR.git.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2501.01235")
get_code_for_paper("2501.01235")
have("2501.01235")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2501.01235.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2501.01235)
Connect an agent — have() is free.