We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Machine translation often suffers from biased data and algorithms that can lead to unacceptable errors in system output. While bias in gender norms has been investigated, less is known about whether MT systems encode bias about social relationships, e.g., "the lawyer kissed her wife." We investigate the degree of bias against same-gender relationships in MT systems, using generated template sentences drawn from several noun-gender languages (e.g., Spanish) and comprised of popular occupation nouns. We find that three popular MT services consistently fail to accurately translate sentences concerning relationships between entities of the same gender. The error rate varies considerably based on the context, and same-gender sentences referencing high female-representation occupations are translated with lower accuracy. We provide this work as a case study in the evaluation of intrinsic bias in NLP systems with respect to social relationships.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2401.04972")
get_code_for_paper("2401.04972")
have("2401.04972")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2401.04972.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2401.04972)
Connect an agent — have() is free.