We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Visual attention plays an important role to understand images and demonstrates its effectiveness in generating natural language descriptions of images. On the other hand, recent studies show that language associated with an image can steer visual attention in the scene during our cognitive process. Inspired by this, we introduce a text-guided attention model for image captioning, which learns to drive visual attention using associated captions. For this model, we propose an exemplar-based learning approach that retrieves from training data associated captions with each image, and use them to learn attention on visual features. Our attention model enables to describe a detailed state of scenes by distinguishing small or confusable objects effectively. We validate our model on MS-COCO Captioning benchmark and achieve the state-of-the-art performance in standard metrics.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("1612.03557")
get_code_for_paper("1612.03557")
have("1612.03557")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/1612.03557.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/1612.03557)
Connect an agent — have() is free.