We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
In-context learning (ICL) is a powerful paradigm emerged from large language models (LLMs). Despite its promises, ICL performance is known to be highly sensitive to input examples. In this work, we use $\textit{in-context influences}$ to analyze few-shot ICL performance directly from the in-context examples. Our proposed influence-based example selection method can identify both positive and negative examples, outperforming several baselines when evaluated on 9 SuperGLUE tasks. Our analysis uncovers up to a $16.3\%$ performance gap between using the most negative in-context examples compared to the most positive. In a case study, we apply our influence-based framework to quantify the phenomena of recency bias in example ordering for few-shot ICL.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2302.11042")
get_code_for_paper("2302.11042")
have("2302.11042")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2302.11042.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2302.11042)
Connect an agent — have() is free.