We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Causal reasoning, the ability to identify cause-and-effect relationship, is crucial in human thinking. Although large language models (LLMs) succeed in many NLP tasks, it is still challenging for them to conduct complex causal reasoning like abductive reasoning and counterfactual reasoning. Given the fact that programming code may express causal relations more often and explicitly with conditional statements like ``if``, we want to explore whether Code-LLMs acquire better causal reasoning abilities. Our experiments show that compared to text-only LLMs, Code-LLMs with code prompts are significantly better in causal reasoning. We further intervene on the prompts from different aspects, and discover that the programming structure is crucial in code prompt design, while Code-LLMs are robust towards format perturbations.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2305.19213")
get_code_for_paper("2305.19213")
have("2305.19213")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2305.19213.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2305.19213)
Connect an agent — have() is free.