Byoung-Tak Zhang, Eun-Sol Kim, Yu-Jung Heo, Woo Choi
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Knowledge-based visual question answering (QA) aims to answer a question which requires visually-grounded external knowledge beyond image content itself. Answering complex questions that require multi-hop reasoning under weak supervision is considered as a challenging problem since i) no supervision is given to the reasoning process and ii) highorder semantics of multi-hop knowledge facts need to be captured. In this paper, we introduce a concept of hypergraph to encode highlevel semantics of a question and a knowledge base, and to learn high-order associations between them. The proposed model, Hypergraph Transformer, constructs a question hypergraph and a query-aware knowledge hypergraph, and infers an answer by encoding inter-associations between two hypergraphs and intra-associations in both hypergraph itself. Extensive experiments on two knowledgebased visual QA and two knowledge-based textual QA demonstrate the effectiveness of our method, especially for multi-hop reasoning problem. Our source code is available at https://github.com/yujungheo/ kbvqa-public.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2204.10448")
get_code_for_paper("2204.10448")
have("2204.10448")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2204.10448.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2204.10448)
Connect an agent — have() is free.