We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Pre-trained Transformer-based models were reported to be robust in intent classification. In this work, we first point out the importance of in-domain out-of-scope detection in few-shot intent recognition tasks and then illustrate the vulnerability of pre-trained Transformer-based models against samples that are in-domain but out-of-scope (ID-OOS). We construct two new datasets, and empirically show that pre-trained models do not perform well on both ID-OOS examples and general out-of-scope examples, especially on fine-grained few-shot intent detection tasks. To figure out how the models mistakenly classify ID-OOS intents as in-scope intents, we further conduct analysis on confidence scores and the overlapping keywords, as well as point out several prospective directions for future work. Resources are available on https://github.com/jianguoz/Few-Shot-Intent-Detection.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2106.04564")
get_code_for_paper("2106.04564")
have("2106.04564")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2106.04564.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2106.04564)
Connect an agent — have() is free.