SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 1908.07129 · 2019

Zero-Shot Grounding of Objects from Natural Language Queries

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 18 functions out of this paper's own repositories and ran 16 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
TheShadow29/zsgnet-pytorch canonical 16 of 18
FunctionStatusWhere it lives
add_extras Ran TheShadow29/zsgnet-pytorch/code/ssd_vgg.py
code served (permissive licence) · get_code("2a8545e480332b47")
conv2d Ran TheShadow29/zsgnet-pytorch/code/mdl.py
code served (permissive licence) · get_code("4b907a406f06ace0")
conv2d_relu Ran TheShadow29/zsgnet-pytorch/code/mdl.py
code served (permissive licence) · get_code("7af4e486b4c60709")
conv3x3 Ran TheShadow29/zsgnet-pytorch/code/fpn_resnet.py
code served (permissive licence) · get_code("fac5364e2f53c6db")
cthw2tlbr Ran TheShadow29/zsgnet-pytorch/code/anchors.py
code served (permissive licence) · get_code("a7dcff4207ca66bf")
exec_func_if_main_proc Ran TheShadow29/zsgnet-pytorch/code/utils.py
code served (permissive licence) · get_code("609205821f10988e")
make_data_sampler Ran TheShadow29/zsgnet-pytorch/code/dat_loader.py
code served (permissive licence) · get_code("daf082e9921b6a03")
multibox Ran TheShadow29/zsgnet-pytorch/code/ssd_vgg.py
code served (permissive licence) · get_code("b490ac8699f5a7ad")
pad_out Ran TheShadow29/zsgnet-pytorch/code/fpn_resnet.py
code served (permissive licence) · get_code("ad11ef6d39eb2ff3")
pil2tensor Ran TheShadow29/zsgnet-pytorch/code/dat_loader.py
code served (permissive licence) · get_code("dfeaf11b09c7a0bc")
reduce_dict Ran TheShadow29/zsgnet-pytorch/code/utils.py
code served (permissive licence) · get_code("b7654b7006fe061d")
reduce_dict_corr Ran TheShadow29/zsgnet-pytorch/code/utils.py
code served (permissive licence) · get_code("75e6e3f3c795ee43")
reshape Ran TheShadow29/zsgnet-pytorch/code/evaluator.py
code served (permissive licence) · get_code("fdb481756a08ea1e")
tlbr2cthw Ran TheShadow29/zsgnet-pytorch/code/anchors.py
code served (permissive licence) · get_code("345cb82041ecd304")
tlbr2tlhw Ran TheShadow29/zsgnet-pytorch/code/anchors.py
code served (permissive licence) · get_code("6206186edff240f5")
vgg Ran TheShadow29/zsgnet-pytorch/code/ssd_vgg.py
code served (permissive licence) · get_code("6921f7ed00595a4f")
collater Not yet run TheShadow29/zsgnet-pytorch/code/dat_loader.py
code served (permissive licence) · get_code("13ae5809344e4f05")
resnet50 Not yet run TheShadow29/zsgnet-pytorch/code/fpn_resnet.py
code served (permissive licence) · get_code("fe0212a6c494a57f")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

A phrase grounding system localizes a particular object in an image referred to by a natural language query. In previous work, the phrases were restricted to have nouns that were encountered in training, we extend the task to Zero-Shot Grounding(ZSG) which can include novel, "unseen" nouns. Current phrase grounding systems use an explicit object detection network in a 2-stage framework where one stage generates sparse proposals and the other stage evaluates them. In the ZSG setting, generating appropriate proposals itself becomes an obstacle as the proposal generator is trained on the entities common in the detection and grounding datasets. We propose a new single-stage model called ZSGNet which combines the detector network and the grounding system and predicts classification scores and regression parameters. Evaluation of ZSG system brings additional subtleties due to the influence of the relationship between the query and learned categories; we define four distinct conditions that incorporate different levels of difficulty. We also introduce new datasets, sub-sampled from Flickr30k Entities and Visual Genome, that enable evaluations for the four conditions. Our experiments show that ZSGNet achieves state-of-the-art performance on Flickr30k and ReferIt under the usual "seen" settings and performs significantly better than baseline in the zero-shot setting.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("1908.07129")
get_code_for_paper("1908.07129")
have("1908.07129")

Connect an agent — have() is free.