SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2304.00341 · CVPR · 2023

JacobiNeRF: NeRF Shaping with Mutual Information Gradients

Kaichun Mo, Leonidas Guibas, Li Yi, Yanchao Yang, Boxiao Pan, Xiaomeng Xu

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

We propose a method that trains a neural radiance field (NeRF) to encode not only the appearance of the scene but also semantic correlations between scene points, regions, or entities -aiming to capture their mutual co-variation patterns. In contrast to the traditional first-order photometric reconstruction objective, our method explicitly regularizes the learning dynamics to align the Jacobians of highlycorrelated entities, which proves to maximize the mutual information between them under random scene perturbations. By paying attention to this second-order information, we can shape a NeRF to express semantically meaningful synergies when the network weights are changed by a delta along the gradient of a single entity, region, or even a point. To demonstrate the merit of this mutual information modeling, we leverage the coordinated behavior of scene entities

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2304.00341")
get_code_for_paper("2304.00341")
have("2304.00341")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2304.00341.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2304.00341.svg)](https://syntology.ai/paper/2304.00341)

Connect an agent — have() is free.