Rajat Koner, Volker Tresp, Georgios Kaissis, Johannes Paetzold, Ivan Ezhov, Bjoern Menze, Suprosanna Shit, Hongwei Li, Bastian Wittmann, Jiazhen Pan, Sharifzadeh Sahand
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
A comprehensive representation of an image requires understanding objects and their mutual relationship, especially in image-tograph generation, e.g., road network extraction, blood-vessel network extraction, or scene graph generation. Traditionally, image-to-graph generation is addressed with a two-stage approach consisting of object detection followed by a separate relation prediction, which prevents simultaneous object-relation interaction. This work proposes a unified one-stage transformer-based framework, namely Relationformer that jointly predicts objects and their relations. We leverage direct set-based object prediction and incorporate the interaction among the objects to learn an object-relation representation jointly. In addition to existing [obj]tokens, we propose a novel learnable token, namely [rln]-token. Together with [obj]-tokens, [rln]-token exploits local and global semantic reasoning in an image through a series of mutual associations. In combination with the pair-wise [obj]-token, the [rln]-token contributes to a computationally efficient relation prediction. We achieve state-of-the-art performance on multiple, diverse and multi-domain datasets that demonstrate our approach's effectiveness and generalizability. 4
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2203.10202")
get_code_for_paper("2203.10202")
have("2203.10202")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2203.10202.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2203.10202)
Connect an agent — have() is free.