We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. We have no repository linked to it either. That is a statement about our graph, not about the paper.
We present HEAD-QA, a multi-choice question answering testbed to encourage research on complex reasoning. The questions come from exams to access a specialized position in the Spanish healthcare system, and are challenging even for highly specialized humans. We then consider monolingual (Spanish) and cross-lingual (to English) experiments with information retrieval and neural techniques. We show that: (i) HEAD-QA challenges current methods, and (ii) the results lag well behind human performance, demonstrating its usefulness as a benchmark for future work.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("1906.04701")
get_code_for_paper("1906.04701")
have("1906.04701")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/1906.04701.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/1906.04701)
Connect an agent — have() is free.