SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2203.01570 · ICLR · 2022

Representing Mixtures of Word Embeddings with Mixtures of Topic Embeddings

Mingyuan Zhou, He Zhao, Huangjie Zheng, Bo Chen, Korawat Tanwisuth, Dongsheng Wang, Dandan Guo

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 6 functions out of this paper's own repositories and ran 4 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
bochengroup/wete reimplementation 2 of 3
wds2014/wete — 1 of 2
BoChenGroup/WeTe — 1 of 1
FunctionStatusWhere it lives
Infer_Net Ran wds2014/wete/model.py
code served (permissive licence) · get_code("d81cf76f0aaa6877")
WeTe Ran BoChenGroup/WeTe/model.py
code served (permissive licence) · get_code("cafdd7fc481eccfd")
normalization Ran bochengroup/wete/cluster_clc.py
code served (permissive licence) · get_code("8e221d38153ae3cb")
standardization Ran bochengroup/wete/cluster_clc.py
code served (permissive licence) · get_code("a06b554c49675416")
WeTe Not yet run wds2014/wete/model.py
code served (permissive licence) · get_code("8766444242c5df71")
purity Not yet run bochengroup/wete/cluster_clc.py
code served (permissive licence) · get_code("621585535245758a")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

A topic model is often formulated as a generative model that explains how each word of a document is generated given a set of topics and document-specific topic proportions. It is focused on capturing the word co-occurrences in a document and hence often suffers from poor performance in analyzing short documents. In addition, its parameter estimation often relies on approximate posterior inference that is either not scalable or suffering from large approximation error. This paper introduces a new topic-modeling framework where each document is viewed as a set of word embedding vectors and each topic is modeled as an embedding vector in the same embedding space. Embedding the words and topics in the same vector space, we define a method to measure the semantic difference between the embedding vectors of the words of a document and these of the topics, and optimize the topic embeddings to minimize the expected difference over all documents. Experiments on text analysis demonstrate that the proposed method, which is amenable to mini-batch stochastic gradient descent based optimization and hence scalable to big corpora, provides competitive performance in discovering more coherent and diverse topics and extracting better document representations.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2203.01570")
get_code_for_paper("2203.01570")
have("2203.01570")

Connect an agent — have() is free.