Model-Agnostic Gender Debiased Image Captioning

Yuta Nakashima, Yusuke Hirota, Noa Garcia

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 1 functions out of this paper's own repositories and ran 0 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

Repositories linked to this paper

• rebnej/libra — marked official in Papers with Code; named in the paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

baseline a man wearing a suit holding a banana +LIBRA a man in a jacket holding a banana (a) context → gender bias mitigation (b) gender → context bias mitigation baseline a young boy holding a baseball bat +LIBRA a young boy holding a plastic frisbee baseline a young boy riding a skateboard +LIBRA a young girl riding a skateboard baseline a man riding a wave on a surfboard +LIBRA a woman catching a wave on a surfboard Figure 1. Generated captions by a baseline captioning model (UpDn [2]) and LIBRA. We show the baseline suffers from context → gender/gender → context biases, predicting incorrect gender or incorrect word (e.g., in the left example, skateboard highly co-occurs with men in the training set, and the baseline incorrectly predicts boy). Our proposed framework successfully modifies those incorrect words.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2304.03693")
get_code_for_paper("2304.03693")
have("2304.03693")

Connect an agent — have() is free.