We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Topic models are in widespread use in natural language processing and beyond. Here, we propose a new framework for the evaluation of probabilistic topic modeling algorithms based on synthetic corpora containing an unambiguously defined ground truth topic structure. The major innovation of our approach is the ability to quantify the agreement between the planted and inferred topic structures by comparing the assigned topic labels at the level of the tokens. In experiments, our approach yields novel insights about the relative strengths of topic models as corpus characteristics vary, and the first evidence of an "undetectable phase" for topic models when the planted structure is weak. We also establish the practical relevance of the insights gained for synthetic corpora by predicting the performance of topic modeling algorithms in classification tasks in real-world corpora.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("1901.09848")
get_code_for_paper("1901.09848")
have("1901.09848")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/1901.09848.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/1901.09848)
Connect an agent — have() is free.