Sayan Ghosh, Shashank Srivastava, Rakesh Menon
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. We have no repository linked to it either. That is a statement about our graph, not about the paper.
Supervised learning has traditionally focused on inductive learning by observing labeled examples of a task. In contrast, humans have the ability to learn new concepts from language. Here, we explore learning zero-shot classifiers for structured data 1 purely from language from natural language explanations as supervision. For this, we introduce CLUES, a benchmark for Classifier Learning Using natural language ExplanationS, consisting of a range of classification tasks over structured data along with natural language supervision in the form of explanations. CLUES consists of 36 real-world and 144 synthetic classification tasks. It contains crowdsourced explanations describing real-world tasks from multiple teachers and programmatically generated explanations for the synthetic tasks. We also introduce ExEnt, an entailment-based method for training classifiers from language explanations, which explicitly models the influence of individual explanations in making a prediction. ExEnt generalizes up to 18% better (relative) on novel tasks than a baseline that does not use explanations. We identify key challenges in learning from explanations, addressing which can lead to progress on CLUES in the future. Our code and datasets are available at: https: //clues-benchmark.github.io.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2204.07142")
get_code_for_paper("2204.07142")
have("2204.07142")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2204.07142.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2204.07142)
Connect an agent — have() is free.