Sergey Levine, Michael Chang, Thomas Griffiths
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Iterative refinement -start with a random guess, then iteratively improve the guess -is a useful paradigm for representation learning because it offers a way to break symmetries among equally plausible explanations for the data. This property enables the application of such methods to infer representations of sets of entities, such as objects in physical scenes, structurally resembling clustering algorithms in latent space. However, most prior works differentiate through the unrolled refinement process, which can make optimization challenging. We observe that such methods can be made differentiable by means of the implicit function theorem, and develop an implicit differentiation approach that improves the stability and tractability of training by decoupling the forward and backward passes. This connection enables us to apply advances in optimizing implicit layers to not only improve the optimization of the slot attention module in SLATE, a state-of-the-art method for learning entity representations, but do so with constant space and time complexity in backpropagation and only one additional line of code. 1
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2207.00787")
get_code_for_paper("2207.00787")
have("2207.00787")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2207.00787.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2207.00787)
Connect an agent — have() is free.