Ruslan Salakhutdinov, Yiming Yang, Quoc Le, Zihang Dai, Zhilin Yang, Jaime Carbonell
67 of 143 samples (functions and classes) lifted from this paper's linked repositories executed on a synthesized input in Syntology's jail (37 of them constructed an object rather than computing a result; 4 honoured the contract we drafted, 1 violated it and 44 have no contract verdict; 18 failures of our instrument; 76 no recorded run), measured 2026-11-22; repository links from the Papers with Code archive attributed under CC BY-SA, no affiliation; bodies inline only under a permissive licence as GitHub detects it. Not a reproduction of the paper's results.
"Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results. This record, dated, as JSON: /api/ran/1901.02860.json · badge: /api/ran/1901.02860.svg
Each repository's role is a label: a classifier's output recorded on the link, or, where no role is recorded, what the Papers with Code archive marked. The line under it names its basis. Neither says who wrote the code.
| Repository | Role | Ran |
|---|---|---|
| shanghai-digital-brain-laboratory/bdm-db1 | community Papers with Code archive |
10 ran · 4 no recorded run |
| kimiyoung/transformer-xl | marked official in Papers with Code Papers with Code archive |
8 ran · 5 no recorded run |
| Jmkernes/PAR-Transformer-XL | community Papers with Code archive |
7 ran · 4 no recorded run |
| facebookresearch/code-prediction-transformer | community Papers with Code archive |
6 ran · 2 no recorded run |
| cedrickchee/pytorch-pretrained-BERT | community Papers with Code archive |
4 ran · 13 no recorded run |
| huggingface/xlnet | community Papers with Code archive |
4 ran · 9 no recorded run |
| benkrause/dynamiceval-transformer | community Papers with Code archive |
4 ran · 8 no recorded run |
| NVIDIA/DeepLearningExamples | community Papers with Code archive |
4 ran · 7 no recorded run |
| mustafaaljadery/gemma-2b-10m | community Papers with Code archive |
4 ran · 3 no recorded run |
| opendilab/DI-engine | community not in the paper's declared repositories |
3 ran · 2 no recorded run |
| TimDettmers/transformer-xl | community (classifier label) classifier basis not recorded on the link |
2 ran · 10 no recorded run |
| AIResearchHub/transformergallery | community Papers with Code archive |
2 ran · 2 no recorded run |
| park-cheol/ASR-Conformer | community Papers with Code archive |
2 ran · 0 no recorded run |
| okkteam/Transformer-Transducer | community Papers with Code archive |
2 ran · 0 no recorded run |
| copy not recorded | community not in the paper's declared repositories |
2 ran · 0 no recorded run |
| Machine-Learning-Tokyo/Poetry-GAN | community (classifier label) classifier basis not recorded on the link |
1 ran · 2 no recorded run |
| inzva/fake-academic-paper-generation | community Papers with Code archive |
1 ran · 1 no recorded run |
| sooftware/Attention-Implementation | community Papers with Code archive |
1 ran · 0 no recorded run |
| jincan333/lot | community not in the paper's declared repositories |
0 ran · 2 no recorded run |
| sooftware/conformer | community Papers with Code archive |
0 ran · 1 no recorded run |
| listenviolet/XLNet | community Papers with Code archive |
0 ran · 1 no recorded run |
| Function | Status | Where it lives |
|---|---|---|
| AdaptiveEmbedding | Ran ran on a synthesized input · constructed an object; no result was computed |
cedrickchee/pytorch-pretrained-BERT/pytorch_pretrained_bert/modeling_transfo_xl.py code served (permissive licence) · get_code("e77541c1b4b15830") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, AdaptiveEmbedding: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| AdaptiveEmbedding | Ran ran on a synthesized input · constructed an object; no result was computed |
kimiyoung/transformer-xl/pytorch/mem_transformer.py code served (permissive licence) · get_code("1ae137f0cee15e33") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, AdaptiveEmbedding: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| AdaptiveEmbedding | Ran ran on a synthesized input · constructed an object; no result was computed |
NVIDIA/DeepLearningExamples/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py pointer only (licence: NONE) · get_code("8a8691f05cb1b5da") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| Attention | Ran ran on a synthesized input · constructed an object; no result was computed |
facebookresearch/code-prediction-transformer/model.py pointer only (licence: NOASSERTION) · get_code("e3217ee8bd314909") How it ranThe body of this sample is withheld: GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION). The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| Block | Ran ran on a synthesized input · constructed an object; no result was computed |
facebookresearch/code-prediction-transformer/model.py pointer only (licence: NOASSERTION) · get_code("548da299b3bc04e9") How it ranThe body of this sample is withheld: GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION). The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| DecoderLayer | Ran ran on a synthesized input · constructed an object; no result was computed |
kimiyoung/transformer-xl/pytorch/mem_transformer.py code served (permissive licence) · get_code("e8aac29a19d0c2e7") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, DecoderLayer: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| GEGLU | Ran ran on a synthesized input |
shanghai-digital-brain-laboratory/bdm-db1/src/model/transformer_xl.py code served (permissive licence) · get_code("845f84e3a319753d") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, class construct-then-call prompt, model not recorded) and returned Tensor, ndim 2, dtype family float, shape (2, 4) as a later run recorded it. The image it ran in was not recorded. If your copy returns the same type, ndim and shape on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| GPT2Model | Ran ran on a synthesized input · constructed an object; no result was computed |
facebookresearch/code-prediction-transformer/model.py pointer only (licence: NOASSERTION) · get_code("72ccb5501088c2b4") How it ranThe body of this sample is withheld: GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION). The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| GatoInputBase | Ran ran on a synthesized input · constructed an object; no result was computed |
shanghai-digital-brain-laboratory/bdm-db1/src/model/transformer_xl.py code served (permissive licence) · get_code("6a748d270690866b") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, GatoInputBase: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| GemmaConfig | Ran ran on a synthesized input · constructed an object; no result was computed |
mustafaaljadery/gemma-2b-10m/src/gemma.py pointer only (licence: NONE) · get_code("709b8a145b15f0ca") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, mustafaaljadery/gemma-2b-10m when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| GemmaRotaryEmbedding | Ran ran on a synthesized input · constructed an object; no result was computed |
mustafaaljadery/gemma-2b-10m/src/gemma.py pointer only (licence: NONE) · get_code("39c5be8f7b1c0490") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, mustafaaljadery/gemma-2b-10m when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| ICTaskInput | Ran ran on a synthesized input · constructed an object; no result was computed |
shanghai-digital-brain-laboratory/bdm-db1/src/model/transformer_xl.py code served (permissive licence) · get_code("ad41eff0feadfd69") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, ICTaskInput: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| LayerNorm | Ran ran on a synthesized input · constructed an object; no result was computed |
facebookresearch/code-prediction-transformer/model.py pointer only (licence: NOASSERTION) · get_code("39480331817170e8") How it ranThe body of this sample is withheld: GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION). The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| Linear | Ran ran on a synthesized input |
park-cheol/ASR-Conformer/model/attention.py pointer only (licence: NONE) · get_code("84585e9be4407fc4") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, park-cheol/ASR-Conformer when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| LogUniformSampler | Ran ran on a synthesized input · constructed an object; no result was computed |
kimiyoung/transformer-xl/pytorch/mem_transformer.py code served (permissive licence) · get_code("220657028509cfb1") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, LogUniformSampler: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| MLP | Ran ran on a synthesized input · constructed an object; no result was computed |
facebookresearch/code-prediction-transformer/model.py pointer only (licence: NOASSERTION) · get_code("df5a6cf54dd0aca6") How it ranThe body of this sample is withheld: GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION). The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| MultiHeadAttn | Ran ran on a synthesized input · constructed an object; no result was computed |
kimiyoung/transformer-xl/pytorch/mem_transformer.py code served (permissive licence) · get_code("d99c9cc9af9de483") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, MultiHeadAttn: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| MultiHeadAttn | Ran ran on a synthesized input · constructed an object; no result was computed |
NVIDIA/DeepLearningExamples/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py pointer only (licence: NONE) · get_code("e672e8a20905b62b") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| MultiHeadedAttention | Ran ran on a synthesized input · constructed an object; no result was computed |
okkteam/Transformer-Transducer/tt/transformer/attention.py pointer only (licence: NONE) · get_code("5597fd8e1219b866") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, okkteam/Transformer-Transducer when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| NLPTaskInput | Ran ran on a synthesized input · constructed an object; no result was computed |
shanghai-digital-brain-laboratory/bdm-db1/src/model/transformer_xl.py code served (permissive licence) · get_code("7eb33bec45fe09f3") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, NLPTaskInput: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| PatchEmbeddings | Ran ran on a synthesized input · constructed an object; no result was computed |
shanghai-digital-brain-laboratory/bdm-db1/src/model/transformer_xl.py code served (permissive licence) · get_code("b54068382071f8c8") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, PatchEmbeddings: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| PathLSTM | Ran ran on a synthesized input · constructed an object; no result was computed |
facebookresearch/code-prediction-transformer/model.py pointer only (licence: NOASSERTION) · get_code("5fb8aacfbced509d") How it ranThe body of this sample is withheld: GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION). The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| PositionalEmbedding | Ran ran on a synthesized input · constructed an object; no result was computed |
shanghai-digital-brain-laboratory/bdm-db1/src/model/transformer_xl.py code served (permissive licence) · get_code("142586d370dc7c1e") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, PositionalEmbedding: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| PositionalEmbedding | Ran ran on a synthesized input · constructed an object; no result was computed |
cedrickchee/pytorch-pretrained-BERT/pytorch_pretrained_bert/modeling_transfo_xl.py code served (permissive licence) · get_code("06ce2b899569db5b") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, PositionalEmbedding: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| PositionalEncoding | Ran ran on a synthesized input · constructed an object; no result was computed |
AIResearchHub/transformergallery/transformer/transformerxl.py code served (permissive licence) · get_code("07bf8cf6e731d1bc") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, PositionalEncoding: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| PositionwiseFF | Ran ran on a synthesized input · constructed an object; no result was computed |
shanghai-digital-brain-laboratory/bdm-db1/src/model/transformer_xl.py code served (permissive licence) · get_code("eed8c286b97219b7") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, PositionwiseFF: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| PositionwiseFF | Ran ran on a synthesized input · constructed an object; no result was computed |
kimiyoung/transformer-xl/pytorch/mem_transformer.py code served (permissive licence) · get_code("c96fba039a607703") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, PositionwiseFF: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| ProjectedAdaptiveLogSoftmax | Ran ran on a synthesized input · constructed an object; no result was computed |
kimiyoung/transformer-xl/pytorch/mem_transformer.py code served (permissive licence) · get_code("338c39719307318d") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, ProjectedAdaptiveLogSoftmax: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| ProjectedAdaptiveLogSoftmax | Ran ran on a synthesized input · constructed an object; no result was computed |
NVIDIA/DeepLearningExamples/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py pointer only (licence: NONE) · get_code("4088ee884194d7c4") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| ProjectedAdaptiveLogSoftmax | Ran ran on a synthesized input · constructed an object; no result was computed |
inzva/fake-academic-paper-generation/transformer-xl/pytorch/mem_transformer.py code served (permissive licence) · get_code("7d9e9736e6c57d11") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, ProjectedAdaptiveLogSoftmax: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| RLTaskInput | Ran ran on a synthesized input · constructed an object; no result was computed |
shanghai-digital-brain-laboratory/bdm-db1/src/model/transformer_xl.py code served (permissive licence) · get_code("2e57dbd19f63d3f4") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, RLTaskInput: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| RelMultiHeadAttention | Ran ran on a synthesized input · constructed an object; no result was computed |
Jmkernes/PAR-Transformer-XL/par_model.py pointer only (licence: NONE) · get_code("4c8b264bb79a35a1") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| RelMultiHeadAttn | Ran ran on a synthesized input · constructed an object; no result was computed |
kimiyoung/transformer-xl/pytorch/mem_transformer.py code served (permissive licence) · get_code("fe28ba867add05c0") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, RelMultiHeadAttn: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| RelMultiHeadAttn | Ran ran on a synthesized input · constructed an object; no result was computed |
NVIDIA/DeepLearningExamples/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py pointer only (licence: NONE) · get_code("8fa37260188b5fd8") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| RelPositionMultiHeadedAttention | Ran ran on a synthesized input · constructed an object; no result was computed |
okkteam/Transformer-Transducer/tt/transformer/attention.py pointer only (licence: NONE) · get_code("4977fa89216a56fa") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, okkteam/Transformer-Transducer when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| RelativeMultiHeadAttention | Ran ran on a synthesized input |
sooftware/Attention-Implementation/attentions.py code served (permissive licence) · get_code("c018d465b6253b94") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, class construct-then-call prompt, model not recorded) and returned Tensor, ndim 3, dtype family float; no output shape is stated. The image it ran in was not recorded. If your copy returns the same type and ndim on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| RelativeMultiHeadAttention | Ran ran on a synthesized input |
park-cheol/ASR-Conformer/model/attention.py pointer only (licence: NONE) · get_code("032b78da6979837c") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, park-cheol/ASR-Conformer when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| TransfoXLConfig | Ran ran on a synthesized input · constructed an object; no result was computed |
cedrickchee/pytorch-pretrained-BERT/pytorch_pretrained_bert/modeling_transfo_xl.py code served (permissive licence) · get_code("a97a22ac6fb31922") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, TransfoXLConfig: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| TransformerEmbedding | Ran ran on a synthesized input · constructed an object; no result was computed |
AIResearchHub/transformergallery/transformer/transformerxl.py code served (permissive licence) · get_code("c7b5eb55f15a37de") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, TransformerEmbedding: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| VQATaskInput | Ran ran on a synthesized input · constructed an object; no result was computed |
shanghai-digital-brain-laboratory/bdm-db1/src/model/transformer_xl.py code served (permissive licence) · get_code("2a023fc4bac8d229") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, VQATaskInput: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| VisionEmbedding | Ran ran on a synthesized input · constructed an object; no result was computed |
shanghai-digital-brain-laboratory/bdm-db1/src/model/transformer_xl.py code served (permissive licence) · get_code("2a5f4bac2414eb0f") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned an instance of its own class, VisionEmbedding: the run constructed the object and did not call it, so no result was computed. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| _cache_mem | Ran ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT) |
benkrause/dynamiceval-transformer/tf/model.py code served (permissive licence) · get_code("773651748c9618d6") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned EagerTensor, ndim 2, dtype family float, shape (5, 4) as a later run recorded it. The image it ran in was not recorded. If your copy returns the same type, ndim and shape on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| _cache_mem | Ran ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT) |
huggingface/xlnet/modeling.py code served (permissive licence) · get_code("9d5e914b24b8911a") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned EagerTensor, ndim 2, dtype family float, shape (5, 4) as a later run recorded it. The image it ran in was not recorded. If your copy returns the same type, ndim and shape on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| add_and_scale | Ran ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT) |
this paper's copy was not recorded; identical code first harvested from owos/flexitokens pointer only; the stored copy get_code serves, from owos/flexitokens, is pointer only (licence: NONE) · get_code("78d91efd74e4d12a") How it ranThe body of this sample is withheld: this paper's copy of the code was not recorded (its link names no repository or source path), so no licence was read for it. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| assign_to_gpu | Ran ran on a synthesized input |
TimDettmers/transformer-xl/tf/gpu_utils.py code served (permissive licence) · get_code("6b2a8f1c93d0b071") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned function. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| batchify | Ran ran on a synthesized input |
TimDettmers/transformer-xl/tf/data_utils.py code served (permissive licence) · get_code("36eed0b265968be7") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned ndarray, ndim 2, dtype family int, shape (10, 20) as a later run recorded it. The image it ran in was not recorded. If your copy returns the same type, ndim and shape on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| build_normalization | Ran ran; our contract draft was wrong, not the code |
opendilab/DI-engine/ding/torch_utils/network/transformer.py code served (permissive licence) · get_code("c92e4fc990bba2fe") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1) and returned type. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| build_tf_to_pytorch_map | Ran ran; our contract draft was wrong, not the code |
cedrickchee/pytorch-pretrained-BERT/pytorch_pretrained_bert/modeling_transfo_xl.py code served (permissive licence) · get_code("35ef111fc00c21b4") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned dict. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| create_lookahead_mask | Ran ran, honoured the contract we drafted |
Jmkernes/PAR-Transformer-XL/par_model.py pointer only (licence: NONE) · get_code("499bf5fee7915c78") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| embedding_lookup | Ran ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT) |
benkrause/dynamiceval-transformer/tf/model.py code served (permissive licence) · get_code("9109ba9791e44324") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned EagerTensor, ndim 3, dtype family float, shape (2, 3, 4) as a later run recorded it. The image it ran in was not recorded. If your copy returns the same type, ndim and shape on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| fc_block | Ran ran; our contract draft was wrong, not the code |
opendilab/DI-engine/ding/torch_utils/network/transformer.py code served (permissive licence) · get_code("c1184d27672a7461") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1) and returned Sequential. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| left_shift | Ran ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT) |
Jmkernes/PAR-Transformer-XL/par_model.py pointer only (licence: NONE) · get_code("8d59a6d5900428f5") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| positional_embedding | Ran ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT) |
benkrause/dynamiceval-transformer/tf/model.py code served (permissive licence) · get_code("d50e8679cde3a927") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned EagerTensor, ndim 3, dtype family float, shape (5, 2, 8) as a later run recorded it. The image it ran in was not recorded. If your copy returns the same type, ndim and shape on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| positional_embedding | Ran ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT) |
huggingface/xlnet/modeling.py code served (permissive licence) · get_code("9bf0f6e6298f3fbe") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned EagerTensor, ndim 3, dtype family float, shape (5, 2, 8) as a later run recorded it. The image it ran in was not recorded. If your copy returns the same type, ndim and shape on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| positional_encoding | Ran ran, honoured the contract we drafted |
Jmkernes/PAR-Transformer-XL/par_model.py pointer only (licence: NONE) · get_code("2398c4a5c285bdc4") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| positionwise_ffn | Ran ran; our contract draft was wrong, not the code |
Jmkernes/PAR-Transformer-XL/par_model.py pointer only (licence: NONE) · get_code("f7a746d73ab2f28c") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
| post_process | Ran ran on a synthesized input |
Machine-Learning-Tokyo/Poetry-GAN/lang_model.py code served (permissive licence) · get_code("9d6735f22035b700") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned str. The image it ran in was not recorded. If your copy returns the same type on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| rel_shift | Ran ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT) |
benkrause/dynamiceval-transformer/tf/model.py code served (permissive licence) · get_code("d37883dc58ff9b69") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned EagerTensor, ndim 4, dtype family float, shape (2, 3, 4, 5) as a later run recorded it. The image it ran in was not recorded. If your copy returns the same type, ndim and shape on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| rel_shift | Ran ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT) |
huggingface/xlnet/modeling.py code served (permissive licence) · get_code("5f7c5b38aeb29bf5") How it ranRan in Syntology's sandbox on this synthesized input (drafted by a language model, Claude Haiku 4.5, prompt python_fixture_v1, through the batch API) and returned EagerTensor, ndim 4, dtype family float, shape (2, 4, 3, 4) as a later run recorded it. The image it ran in was not recorded. If your copy returns the same type, ndim and shape on these inputs, it matched what we observed; nothing here checks that. It does NOT mean the output is correct: nothing has compared it to the paper.
|
| relative_position_logits | Ran ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT) |
Jmkernes/PAR-Transformer-XL/par_model.py pointer only (licence: NONE) · get_code("edeef97857b7cdca") How it ranThe body of this sample is withheld: GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked. The setup block that called it is withheld with it, because it is written against that body. source_path and origin say where the code lives, to read under the repository's own terms. A run is recorded. |
Showing the first 60. An agent gets every one from get_harvested_code_for_paper("1901.02860").
Of 143 samples lifted from this paper's linked repositories, 143 carry a function identity and 0 do not. Of the 137 distinct functions with an identity, 41 are also present in other papers whose code we hold (5 with at least one paper dated earlier, 0 the same month, 40 later) and 96 are only here among the 52,977 papers whose code Syntology holds (as of 2026-09-26).
Only here means: among the 52,977 papers whose code Syntology holds (51,887 with lifted samples, 1,090 through their assemblies only), as of 2026-09-26, no other paper's lifted samples or current assembly bricks contain an identical function body after normalisation.
| Function | Also present in | Earliest-dated | Others named |
|---|---|---|---|
| rotate_half brick of this paper's assembly: helper |
360 other papers 357 later, 3 undated · 30 only as an assembly brick |
2203.08913 (2022-03) Memorizing Transformers |
2302.13971 (2023-02) LLaMA: Open and Efficient Foundation Language Models 2305.14167 (2023-05) DetGPT: Detect What You Need via Reasoning and 357 more not named here |
| repeat_kv brick of this paper's assembly: helper |
243 other papers 241 later, 2 undated · 22 only as an assembly brick |
2203.08913 (2022-03) Memorizing Transformers |
2305.17888 (2023-05) LLM-QAT: Data-Free Quantization Aware Training for Large Language Models 2307.06945 (2023-07) In-context Autoencoder for Context Compression in a Large Language Model and 240 more not named here |
| apply_rotary_pos_emb brick of this paper's assembly: helper |
94 other papers 91 later, 3 undated · 6 only as an assembly brick |
2305.17888 (2023-05) LLM-QAT: Data-Free Quantization Aware Training for Large Language Models |
2309.11674 (2023-09) A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models 2024.findings-emnlp.22 (2024 (year only)) XRec: Large Language Models for Explainable Recommendation and 91 more not named here |
| cached_path brick of this paper's assembly: helper |
27 other papers 1 dated earlier, 26 later · 5 only as an assembly brick |
1810.04805 (2018-10) BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding |
1908.02265 (2019-08) ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks 1908.03557 (2019-08) VisualBERT: A Simple and Performant Baseline for Vision and Language and 24 more not named here |
| sample_logits brick of this paper's assembly: helper |
14 other papers 14 later · 2 only as an assembly brick |
1906.08237 (2019-06) XLNet: Generalized Autoregressive Pretraining for Language Understanding |
1908.09355 (2019-08) Patient Knowledge Distillation for BERT Model Compression 1909.05311 (2019-09) Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question Answering and 11 more not named here |
| scatter_kwargs | 11 other papers 11 later |
2106.06295 (2021-06) Going Beyond Linear Transformers with Recurrent Fast Weight Programmers |
2204.03883 (2022-04) Vision Transformers for Single Image Dehazing 2207.00735 (2022-07) Can Language Models Make Fun? A Case Study in Chinese Comical Crosstalk and 8 more not named here |
| build_tf_to_pytorch_map brick of this paper's assembly: helper |
10 other papers 10 later |
1906.08237 (2019-06) XLNet: Generalized Autoregressive Pretraining for Language Understanding |
1908.09355 (2019-08) Patient Knowledge Distillation for BERT Model Compression 1909.05311 (2019-09) Graph-Based Reasoning over Heterogeneous External Knowledge for Commonsense Question Answering and 7 more not named here |
| scatter | 8 other papers 8 later |
2106.06295 (2021-06) Going Beyond Linear Transformers with Recurrent Fast Weight Programmers |
2204.03883 (2022-04) Vision Transformers for Single Image Dehazing 2207.00735 (2022-07) Can Language Models Make Fun? A Case Study in Chinese Comical Crosstalk and 5 more not named here |
| PositionalEmbedding brick of this paper's assembly: helper, model |
4 other papers 4 later · 3 only as an assembly brick |
2004.08178 (2020-04) Highway Transformer: Self-Gating Enhanced Self-Attentive Networks |
2101.02402 (2021-01) Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs 2207.06881 (2022-07) Recurrent Memory Transformer and 1 more not named here |
| PositionwiseFF brick of this paper's assembly: helper, model |
3 other papers 3 later · 2 only as an assembly brick |
2101.02402 (2021-01) Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs |
2207.06881 (2022-07) Recurrent Memory Transformer 2605.15562 (2026-05) GiLT: Augmenting Transformer Language Models with Dependency Graphs |
| assign_to_gpu | 3 other papers 2 dated earlier, 1 later |
1602.02410 (2016-02) Exploring the Limits of Language Modeling |
1606.04934 (2016-06) Improving Variational Inference with Inverse Autoregressive Flow 2004.13922 (2020-04) Revisiting Pre-trained Models for Chinese Natural Language Processing |
| load_tf_weights_in_transfo_xl brick of this paper's assembly: helper |
3 other papers 3 later |
1908.09355 (2019-08) Patient Knowledge Distillation for BERT Model Compression |
1911.00720 (2019-11) ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representations 2005.02439 (2020-05) Contextualizing Hate Speech Classifiers with Post-hoc Explanation |
| to_2tuple brick of this paper's assembly: helper |
3 other papers 3 later |
2103.14030 (2021-03) Swin Transformer: Hierarchical Vision Transformer using Shifted Windows |
2203.15350 (2022-03) End-to-End Transformer Based Model for Image Captioning 2404.10710 (2024-04) Autoregressive Pre-Training on Pixels and Texts |
| DecoderLayer brick of this paper's assembly: helper, model |
2 other papers 2 later · 1 only as an assembly brick |
2101.02402 (2021-01) Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs |
2207.06881 (2022-07) Recurrent Memory Transformer |
| LogUniformSampler brick of this paper's assembly: helper |
2 other papers 2 later · 2 only as an assembly brick |
2004.08178 (2020-04) Highway Transformer: Self-Gating Enhanced Self-Attentive Networks |
2207.06881 (2022-07) Recurrent Memory Transformer |
| PositionalEncoding brick of this paper's assembly: helper |
2 other papers 2 later · 1 only as an assembly brick |
2004.05150 (2020-04) Longformer: The Long-Document Transformer |
2203.08913 (2022-03) Memorizing Transformers |
| RelLearnableDecoderLayer brick of this paper's assembly: model |
2 other papers 2 later |
2101.02402 (2021-01) Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphs |
2207.06881 (2022-07) Recurrent Memory Transformer |
| TransformerEmbedding brick of this paper's assembly: helper |
2 other papers 2 later · 1 only as an assembly brick |
2004.05150 (2020-04) Longformer: The Long-Document Transformer |
2203.08913 (2022-03) Memorizing Transformers |
| embedding_lookup brick of this paper's assembly: helper |
2 other papers 2 later · 1 only as an assembly brick |
1906.08237 (2019-06) XLNet: Generalized Autoregressive Pretraining for Language Understanding |
2004.13922 (2020-04) Revisiting Pre-trained Models for Chinese Natural Language Processing |
| get_from_cache brick of this paper's assembly: helper |
2 other papers 1 dated earlier, 1 later · 1 only as an assembly brick |
1810.04805 (2018-10) BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding |
2101.08106 (2021-01) Learning to Augment for Data-Scarce Domain BERT Knowledge Distillation |
Shown: the 20 functions present in the most other papers. 21 more shared functions are not listed here.
Presence, not direction: an identical function body in two papers' repositories does not say who wrote it, which came from which, or that either paper's method rests on it. Matching is exact after normalisation, so a renamed or edited function is not matched. Dates are when papers appeared, not when code was written. Only .py files the harvester lifted are covered; notebooks are not read. A new-style arXiv id YYMM.NNNN dates a paper to the month 20YY-MM; otherwise Paper.year dates it to the year; otherwise it is undated. Dates are when the paper appeared, not when the code was written. Read 2026-11-22.
More are linked than shown here.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Transformers have a potential of learning longer-term dependency, but are limited by a fixed-length context in the setting of language modeling. We propose a novel neural architecture Transformer-XL that enables learning dependency beyond a fixed length without disrupting temporal coherence. It consists of a segment-level recurrence mechanism and a novel positional encoding scheme. Our method not only enables capturing longer-term dependency, but also resolves the context fragmentation problem. As a result, Transformer-XL learns dependency that is 80% longer than RNNs and 450% longer than vanilla Transformers, achieves better performance on both short and long sequences, and is up to 1,800+ times faster than vanilla Transformers during evaluation. Notably, we improve the state-ofthe-art results of bpc/perplexity to 0.99 on en-wiki8, 1.08 on text8, 18.3 on WikiText-103, 21.8 on One Billion Word, and 54.5 on Penn Treebank (without finetuning). When trained only on WikiText-103, Transformer-XL manages to generate reasonably coherent, novel text articles with thousands of tokens. Our code, pretrained models, and hyperparameters are available in both Tensorflow and PyTorch 1 . * Equal contribution. Order determined by swapping the one in Yang et al. (2017).
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("1901.02860")
get_code_for_paper("1901.02860")
have("1901.02860")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/1901.02860.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/1901.02860)
Connect an agent — have() is free.