Jamie Wynn, Daniyar Turmukhambetov
We lifted 8 functions out of this paper's own repositories and ran 7 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.
| Repository | Role | Ran |
|---|---|---|
| nianticlabs/diffusionerf | canonical | 7 of 8 |
| Function | Status | Where it lives |
|---|---|---|
| convert_activation | Ran | nianticlabs/diffusionerf/ffmlp/ffmlp.py code served (permissive licence) · get_code("b2afea570d511657") |
| get_encoder | Ran | nianticlabs/diffusionerf/encoding.py code served (permissive licence) · get_code("5ca70dba4b451eee") |
| huber_loss | Ran | nianticlabs/diffusionerf/loss.py code served (permissive licence) · get_code("00979fadb02bf8df") |
| make_4x4_transform | Ran | nianticlabs/diffusionerf/nerf/circle_path.py code served (permissive licence) · get_code("b005da476fb7a4d2") |
| make_circle_path | Ran | nianticlabs/diffusionerf/nerf/circle_path.py code served (permissive licence) · get_code("882a796b52a505e5") |
| make_opt_for_scene | Ran | nianticlabs/diffusionerf/nerf/evaluate.py code served (permissive licence) · get_code("f393a4c3336141fb") |
| mape_loss | Ran | nianticlabs/diffusionerf/loss.py code served (permissive licence) · get_code("ddcd1a350d11a260") |
| apply_4x4_transform_to_3d_vec | Not yet run | nianticlabs/diffusionerf/nerf/circle_path.py code served (permissive licence) · get_code("c700c0222e7b80ba") |
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Under good conditions, Neural Radiance Fields (NeRFs) have shown impressive results on novel view synthesis tasks. NeRFs learn a scene's color and density fields by minimizing the photometric discrepancy between training views and differentiable renderings of the scene. Once trained from a sufficient set of views, NeRFs can generate novel views from arbitrary camera positions. However, the scene geometry and color fields are severely under-constrained, which can lead to artifacts, especially when trained with few input views. To alleviate this problem we learn a prior over scene geometry and color, using a denoising diffusion model (DDM). Our DDM is trained on RGBD patches of the synthetic Hypersim dataset and can be used to predict the gradient of the logarithm of a joint probability distribution of color and depth patches. We show that, these gradients of logarithms of RGBD patch priors serve to regularize geometry and color of a scene. During NeRF training, random RGBD patches are rendered and the estimated gradient of the log-likelihood is backpropagated to the color and density fields. Evaluations on LLFF, the most relevant dataset, show that our learned prior achieves improved quality in the reconstructed geometry and improved generalization to novel views. Evaluations on DTU show improved reconstruction quality among NeRF methods.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2302.12231")
get_code_for_paper("2302.12231")
have("2302.12231")
Connect an agent — have() is free.