Fan Yang, Linjie Li, Nan Duan, Jianfeng Wang, Lijuan Wang, Zicheng Liu, Zhengyuan Yang, Yuejian Fang, Xiaodong Wang, Chenfei Wu, Minheng Ni, Shengming Yin
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. We have no repository linked to it either. That is a statement about our graph, not about the paper.
3D photography renders a static image into a video with appealing 3D visual effects. Existing approaches typically first conduct monocular depth estimation, then render the input frame to subsequent frames with various viewpoints, and finally use an inpainting model to fill those missing/occluded regions. The inpainting model plays a crucial role in rendering quality, but it is normally trained on out-of-domain data. To reduce the training and inference gap, we propose a novel selfsupervised diffusion model as the inpainting module. Given a single input image, we automatically construct a training pair of the masked occluded image and the ground-truth image with random cycle rendering. The constructed training samples are closely aligned to the testing instances, without the need for data annotation. To make full use of the masked images, we designed a Masked Enhanced Block (MEB), which can be easily plugged into the UNet and enhance the semantic conditions. Towards real-world animation, we present a novel task: out-animation, which extends the space and time of input objects. Extensive experiments on real datasets show that our method achieves competitive results with existing SOTA methods.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2302.10781")
get_code_for_paper("2302.10781")
have("2302.10781")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2302.10781.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2302.10781)
Connect an agent — have() is free.