SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2210.13700 · EMNLP · 2022

Does Joint Training Really Help Cascaded Speech Translation?

Viet Anh, Khoa Tran, Christian Herold, Yingbo Gao, Hermann Ney, David Thulke

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Currently, in speech translation, the straightforward approach -cascading a recognition system with a translation system -delivers state-of-theart results. However, fundamental challenges such as error propagation from the automatic speech recognition system still remain. To mitigate these problems, recently, people turn their attention to direct data and propose various joint training methods. In this work, we seek to answer the question of whether joint training really helps cascaded speech translation. We review recent papers on the topic and also investigate a joint training criterion by marginalizing the transcription posterior probabilities. Our findings show that a strong cascaded baseline can diminish any improvements obtained using joint training, and we suggest alternatives to joint training. We hope this work can serve as a refresher of the current speech translation landscape, and motivate research in finding more efficient and creative ways to utilize the direct data for speech translation.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2210.13700")
get_code_for_paper("2210.13700")
have("2210.13700")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2210.13700.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2210.13700.svg)](https://syntology.ai/paper/2210.13700)

Connect an agent — have() is free.