Stefano Teso, Andrea Passerini, Andrea Bontempelli, Fausto Giunchiglia
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
The ability to learn from human supervision is fundamental for personal assistants and other interactive applications of AI. Two central challenges for deploying interactive learners in the wild are the unreliable nature of the supervision and the varying complexity of the prediction task. We address a simple but representative setting, incremental classification in the wild, where the supervision is noisy and the number of classes grows over time. In order to tackle this task, we propose a redesign of skeptical learning centered around Gaussian Processes (GPs). Skeptical learning is a recent interactive strategy in which, if the machine is sufficiently confident that an example is mislabeled, it asks the annotator to reconsider her feedback. In many cases, this is often enough to obtain clean supervision. Our redesign, dubbed ISGP, leverages the uncertainty estimates supplied by GPs to better allocate labeling and contradiction queries, especially in the presence of noise. Our experiments on synthetic and real-world data show that, as a result, while the original formulation of skeptical learning produces over-confident models that can fail completely in the wild, ISGP works well at varying levels of noise and as new classes are observed.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2011.00928")
get_code_for_paper("2011.00928")
have("2011.00928")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2011.00928.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2011.00928)
Connect an agent — have() is free.