Lucia Specia, Pranava Madhyastha, Ozan Caglayan, Faidon Mitzalis
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
We present BERTGEN, a novel generative, decoder-only model which extends BERT by fusing multimodal and multilingual pretrained models VL-BERT and M-BERT, respectively. BERTGEN is auto-regressively trained for language generation tasks, namely image captioning, machine translation and multimodal machine translation, under a multitask setting. With a comprehensive set of evaluations, we show that BERTGEN outperforms many strong baselines across the tasks explored. We also show BERTGEN's ability for zero-shot language generation, where it exhibits competitive performance to supervised counterparts. Finally, we conduct ablation studies which demonstrate that BERTGEN substantially benefits from multi-tasking and effectively transfers relevant inductive biases from the pre-trained models.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2106.03484")
get_code_for_paper("2106.03484")
have("2106.03484")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2106.03484.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2106.03484)
Connect an agent — have() is free.