SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 1610.02424 · 2016

Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models

arXiv · PDF · Open in the Atlas

Code that ran

7 of 14 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (0 of them constructed an object rather than computing a result; 0 honoured the contract we drafted, 1 violated it and 1 has no contract verdict; 5 failures of our instrument; 7 no recorded run), measured 2026-11-22; repository links from the Papers with Code archive attributed under CC BY-SA, no affiliation; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.

"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/1610.02424.json · badge: /api/ran/1610.02424.svg

Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.

RepositoryRoleRan
fairseq/fairseq community (classifier label)
classifier basis not recorded on the link
2 ran · 1 no recorded run
ahmetustun/fairseq community (classifier label)
classifier basis not recorded on the link
1 ran · 2 no recorded run
StatNLP/ada4asr community (classifier label)
classifier basis not recorded on the link
1 ran · 1 no recorded run
jungokasai/t2r community (classifier label)
classifier basis not recorded on the link
1 ran · 0 no recorded run
cindyxinyiwang/fairseq community (classifier label)
classifier basis not recorded on the link
1 ran · 0 no recorded run
copy not recorded community
not in the paper's declared repositories
1 ran · 0 no recorded run
stevezheng23/fairseq_extension community (classifier label)
classifier basis not recorded on the link
0 ran · 2 no recorded run
raymondhs/fairseq-extensible-mbart community (classifier label)
classifier basis not recorded on the link
0 ran · 1 no recorded run
FunctionStatusWhere it lives
distributed_init Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
fairseq/fairseq/fairseq/distributed_utils.py
pointer only (licence: MIT); the stored copy get_code serves, from agi-content-generation/EKD, is pointer only (licence: NOASSERTION) · get_code("2e69129bbcf930e7")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, fairseq/fairseq, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

distributed_init Ran
ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)
jungokasai/t2r/fairseq/distributed_utils.py
pointer only (licence: MIT); the stored copy get_code serves, from dashenzi721/csp, is pointer only (licence: NONE) · get_code("07969f7041022050")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, jungokasai/t2r, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

find_offsets Ran
ran on a synthesized input
cindyxinyiwang/fairseq/fairseq/file_chunker_utils.py
pointer only (licence: MIT); the stored copy get_code serves, from leililab/enzygen, is pointer only (licence: NONE) · get_code("840d9070e4fd8ba6")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, cindyxinyiwang/fairseq, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

is_master Ran
ran, violated the contract we drafted
fairseq/fairseq/fairseq/distributed_utils.py
pointer only (licence: MIT); the stored copy get_code serves, from agi-content-generation/EKD, is pointer only (licence: NOASSERTION) · get_code("90b79fe15491de83")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, fairseq/fairseq, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

label_smoothed_nll_loss Ran
ran; our contract draft was wrong, not the code
this paper's copy was not recorded; identical code first harvested from lsj2408/urpe
pointer only · get_code("26da4f92ba56e785")
How it ran

The body of this sample is withheld: this paper's copy of the code was not recorded (its link names no repository or source path), so no licence was read for it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

safe_readline Ran
ran; our contract draft was wrong, not the code
StatNLP/ada4asr/fairseq/binarizer.py
pointer only (licence: MIT); the stored copy get_code serves, from agi-content-generation/EKD, is pointer only (licence: NOASSERTION) · get_code("82bdf940665aeeb4")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, StatNLP/ada4asr, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

url_to_filename Ran
ran; our contract draft was wrong, not the code
ahmetustun/fairseq/fairseq/file_utils.py
pointer only (licence: MIT); the stored copy get_code serves, from agi-content-generation/EKD, is pointer only (licence: NOASSERTION) · get_code("9418b43048e4e4ec")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, ahmetustun/fairseq, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded.

all_reduce Not yet run
unverified (harvested, no recorded run)
StatNLP/ada4asr/fairseq/distributed_utils.py
pointer only (licence: MIT); the stored copy get_code serves, from agi-content-generation/EKD, is pointer only (licence: NOASSERTION) · get_code("199e96db5edd0edd")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, StatNLP/ada4asr, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

filename_to_url Not yet run
unverified (harvested, no recorded run)
ahmetustun/fairseq/fairseq/file_utils.py
pointer only (licence: MIT); the stored copy get_code serves, from agi-content-generation/EKD, is pointer only (licence: NOASSERTION) · get_code("aafdc12f01ab388f")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, ahmetustun/fairseq, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

filename_to_url Not yet run
unverified (harvested, no recorded run)
stevezheng23/fairseq_extension/fairseq/file_utils.py
pointer only (licence: MIT); the stored copy get_code serves, from dashenzi721/csp, is pointer only (licence: NONE) · get_code("b1a033619f614e17")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, stevezheng23/fairseq_extension, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

load_archive_file Not yet run
unverified (harvested, no recorded run)
fairseq/fairseq/fairseq/file_utils.py
pointer only (licence: MIT); the stored copy get_code serves, from agi-content-generation/EKD, is pointer only (licence: NOASSERTION) · get_code("bf870e076be41d5d")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, fairseq/fairseq, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

load_archive_file Not yet run
unverified (harvested, no recorded run)
ahmetustun/fairseq/fairseq/file_utils.py
pointer only (licence: MIT); the stored copy get_code serves, from BytedanceSpeech/seed-tts-eval, is pointer only (licence: NONE) · get_code("5603a04b6103554e")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, ahmetustun/fairseq, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

load_archive_file Not yet run
unverified (harvested, no recorded run)
stevezheng23/fairseq_extension/fairseq/file_utils.py
pointer only (licence: MIT); the stored copy get_code serves, from dashenzi721/csp, is pointer only (licence: NONE) · get_code("bd3fe80662b28bc7")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, stevezheng23/fairseq_extension, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

load_archive_file Not yet run
unverified (harvested, no recorded run)
raymondhs/fairseq-extensible-mbart/fairseq/file_utils.py
pointer only (licence: MIT) · get_code("0d372aa1e290a613")
How it ran

The body of this sample is withheld: MIT, as GitHub detects it on this paper's repository, raymondhs/fairseq-extensible-mbart, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. No invocation recorded.

Also present in other papers' code

Of 14 samples lifted from this paper's linked repositories, 14 carry a function identity and 0 do not. Of the 10 distinct functions with an identity, 10 are also present in other papers whose code we hold (0 with at least one paper dated earlier, 0 the same month, 10 later) and 0 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).

Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.

FunctionAlso present inEarliest-datedOthers named
safe_readline 66 other papers
66 later
1802.06901 (2018-02)
Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative Refinement
1904.01038 (2019-04)
FAIRSEQ: A Fast, Extensible Toolkit for Sequence Modeling
1904.11660 (2019-04)
Transformers with convolutional context for ASR
and 63 more not named here
url_to_filename 48 other papers
48 later · 8 only as an assembly brick
1809.11096 (2018-09)
Large Scale GAN Training for High Fidelity Natural Image Synthesis
1810.04805 (2018-10)
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
1901.02860 (2019-01)
Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context
and 45 more not named here
is_master 18 other papers
18 later
1902.01388 (2019-02)
Re-examination of the Role of Latent Variables in Sequence Modeling
2004.14524 (2020-04)
Simulated Multiple Reference Training Improves Low-Resource Machine Translation
2005.02354 (2020-05)
It's Easier to Translate out of English than into it: Measuring Neural Translation Difficulty by Cross-Mutual Information
and 15 more not named here
all_reduce 16 other papers
16 later
2021.findings-emnlp.366 (2021 (year only))
Rethinking Zero-shot Neural Machine Translation: From a Perspective of Latent Variables
2104.08771 (2021-04)
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation
2105.12967 (2021-05)
Selective Knowledge Distillation for Neural Machine Translation
and 13 more not named here
filename_to_url 12 other papers
12 later
2007.07691 (2020-07)
A Multilingual Parallel Corpora Collection Effort for Indian Languages
2021.findings-emnlp.366 (2021 (year only))
Rethinking Zero-shot Neural Machine Translation: From a Perspective of Latent Variables
2104.08771 (2021-04)
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation
and 9 more not named here
load_archive_file 12 other papers
12 later
2021.findings-emnlp.366 (2021 (year only))
Rethinking Zero-shot Neural Machine Translation: From a Perspective of Latent Variables
2104.08771 (2021-04)
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation
2106.01540 (2021-06)
Luna: Linear Unified Nested Attention
and 9 more not named here
distributed_init 7 other papers
7 later
2105.12967 (2021-05)
Selective Knowledge Distillation for Neural Machine Translation
2106.01540 (2021-06)
Luna: Linear Unified Nested Attention
2106.01597 (2021-06)
ZmBART: An Unsupervised Cross-lingual Transfer Framework for Language Generation
and 4 more not named here
distributed_init 6 other papers
6 later
2021.findings-emnlp.366 (2021 (year only))
Rethinking Zero-shot Neural Machine Translation: From a Perspective of Latent Variables
2104.08771 (2021-04)
Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translation
2109.11136 (2021-09)
Non-Parametric Online Learning from Human Feedback for Neural Machine Translation
and 3 more not named here
label_smoothed_nll_loss 6 other papers
6 later
2002.06714 (2020-02)
Multi-layer Representation Fusion for Neural Machine Translation
2106.02208 (2021-06)
BERTTune: Fine-Tuning Neural Machine Translation with BERTScore
2205.13401 (2022-05)
Your Transformer May Not be as Powerful as You Expect
and 3 more not named here
find_offsets 5 other papers
5 later
2203.10426 (2022-03)
STEMM: Self-learning with Speech-text Manifold Mixup for Speech Translation
2205.01068 (2022-05)
OPT: Open Pre-trained Transformer Language Models
2210.15379 (2022-10)
MorphTE: Injecting Morphology in Tensorized Embeddings
and 2 more not named here

Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Neural sequence models are widely used to model time-series data. Equally ubiquitous is the usage of beam search (BS) as an approximate inference algorithm to decode output sequences from these models. BS explores the search space in a greedy left-right fashion retaining only the top-B candidates - resulting in sequences that differ only slightly from each other. Producing lists of nearly identical sequences is not only computationally wasteful but also typically fails to capture the inherent ambiguity of complex AI tasks. To overcome this problem, we propose Diverse Beam Search (DBS), an alternative to BS that decodes a list of diverse outputs by optimizing for a diversity-augmented objective. We observe that our method finds better top-1 solutions by controlling for the exploration and exploitation of the search space - implying that DBS is a better search algorithm. Moreover, these gains are achieved with minimal computational or memory over- head as compared to beam search. To demonstrate the broad applicability of our method, we present results on image captioning, machine translation and visual question generation using both standard quantitative metrics and qualitative human studies. Further, we study the role of diversity for image-grounded language generation tasks as the complexity of the image changes. We observe that our method consistently outperforms BS and previously proposed techniques for diverse decoding from neural sequence models.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("1610.02424")
get_code_for_paper("1610.02424")
have("1610.02424")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/1610.02424.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/1610.02424.svg)](https://syntology.ai/paper/1610.02424)

Connect an agent — have() is free.