Deepmind London, Shakir Mohamed, Marc Deisenroth, Suman Ravuri, Mélanie Rey
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Understanding how well a deep generative model captures a distribution of high-dimensional data remains an important open challenge. It is especially difficult for certain model classes, such as Generative Adversarial Networks and Diffusion Models, whose models do not admit exact likelihoods. In this work, we demonstrate that generalized empirical likelihood (GEL) methods offer a family of diagnostic tools that can identify many deficiencies of deep generative models (DGMs). We show, with appropriate specification of moment conditions, that the proposed method can identify which modes have been dropped, the degree to which DGMs are mode imbalanced, and whether DGMs sufficiently capture intra-class diversity. We show how to combine techniques from Maximum Mean Discrepancy and Generalized Empirical Likelihood to create not only distribution tests that retain per-sample interpretability, but also metrics that include label information. We find that such tests predict the degree of mode dropping and mode imbalance up to 60% better than metrics such as improved precision/recall.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2306.09780")
get_code_for_paper("2306.09780")
have("2306.09780")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2306.09780.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2306.09780)
Connect an agent — have() is free.