Malihe Alikhani, Yang Zhong, Mert İnan, Sabit Hassan, Lorna Quandt
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
End-to-end sign language generation models do not accurately represent the prosody in sign language. A lack of temporal and spatial variations leads to poor-quality generated presentations that confuse human interpreters. In this paper, we aim to improve the prosody in generated sign languages by modeling intensification in a data-driven manner. We present different strategies grounded in linguistics of sign language that inform how intensity modifiers can be represented in gloss annotations. To employ our strategies, we first annotate a subset of the benchmark PHOENIX-14T, a German Sign Language dataset, with different levels of intensification. We then use a supervised intensity tagger to extend the annotated dataset and obtain labels for the remaining portion of it. This enhanced dataset is then used to train state-of-the-art transformer models for sign language generation. We find that our efforts in intensification modeling yield better results when evaluated with automatic metrics. Human evaluation also indicates a higher preference of the videos generated using our model.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2203.09679")
get_code_for_paper("2203.09679")
have("2203.09679")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2203.09679.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2203.09679)
Connect an agent — have() is free.