SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 1803.06092 · 2018

A Dataset and Architecture for Visual Reasoning with a Working Memory

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 5 functions out of this paper's own repositories and ran 5 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
google/cog canonical 2 of 2
bashivanlab/iwisdm extension 3 of 3
FunctionStatusWhere it lives
create_task Ran bashivanlab/iwisdm/benchmarking/create_bench.py
code served (permissive licence) · get_code("51e7b042a9982d7d")
duplicate_check Ran bashivanlab/iwisdm/benchmarking/create_bench.py
code served (permissive licence) · get_code("628d9212033b209a")
generate_trial Ran bashivanlab/iwisdm/benchmarking/create_bench.py
code served (permissive licence) · get_code("ac137256a6442b8e")
get_target_value Ran google/cog/cognitive/generate_dataset.py
code served (permissive licence) · get_code("9cdd1174742166f2")
log_exceptions Ran google/cog/cognitive/generate_dataset.py
code served (permissive licence) · get_code("278fb3b11efe0d35")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

A vexing problem in artificial intelligence is reasoning about events that occur in complex, changing visual stimuli such as in video analysis or game play. Inspired by a rich tradition of visual reasoning and memory in cognitive psychology and neuroscience, we developed an artificial, configurable visual question and answer dataset (COG) to parallel experiments in humans and animals. COG is much simpler than the general problem of video analysis, yet it addresses many of the problems relating to visual and logical reasoning and memory -- problems that remain challenging for modern deep learning architectures. We additionally propose a deep learning architecture that performs competitively on other diagnostic VQA datasets (i.e. CLEVR) as well as easy settings of the COG dataset. However, several settings of COG result in datasets that are progressively more challenging to learn. After training, the network can zero-shot generalize to many new tasks. Preliminary analyses of the network architectures trained on COG demonstrate that the network accomplishes the task in a manner interpretable to humans.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("1803.06092")
get_code_for_paper("1803.06092")
have("1803.06092")

Connect an agent — have() is free.