SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 1410.0210 · 2014

A Multi-World Approach to Question Answering about Real-World Scenes based on Uncertain Input

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. We have no repository linked to it either. That is a statement about our graph, not about the paper.

Abstract

We propose a method for automatically answering questions about images by bringing together recent advances from natural language processing and computer vision. We combine discrete reasoning with uncertain predictions by a multi-world approach that represents uncertainty about the perceived world in a bayesian framework. Our approach can handle human questions of high complexity about realistic scenes and replies with range of answer like counts, object classes, instances and lists of them. The system is directly trained from question-answer pairs. We establish a first benchmark for this task that can be seen as a modern attempt at a visual turing test.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("1410.0210")
get_code_for_paper("1410.0210")
have("1410.0210")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/1410.0210.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/1410.0210.svg)](https://syntology.ai/paper/1410.0210)

Connect an agent — have() is free.