SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2101.11214 · ICLR · 2021

Towards Robustness to Label Noise in Text Classification via Noise Modeling

Siddhant Garg, Goutham Ramakrishnan, Varun Thumbe

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 4 functions out of this paper's own repositories and ran 4 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

RepositoryRoleRan
thumbe3/label-noise-nlp canonical 4 of 4
FunctionStatusWhere it lives
contain_how_what Ran thumbe3/label-noise-nlp/add_noise.py
pointer only (licence: NONE) · get_code("f352c136b669e21e")
contain_reuter Ran thumbe3/label-noise-nlp/add_noise.py
pointer only (licence: NONE) · get_code("379639ccd50948f7")
eval_model Ran thumbe3/label-noise-nlp/train_classifier.py
pointer only (licence: NONE) · get_code("2e0740f9258c4c0c")
eval_model_noisy Ran thumbe3/label-noise-nlp/train_classifier.py
pointer only (licence: NONE) · get_code("958b1db10ac8c6a6")

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Large datasets in NLP tend to suffer from noisy labels due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over the classifier. We first assign a probability score to each training sample of having a clean or noisy label, using a two-component beta mixture model fitted on the training losses at an early epoch. Using this, we jointly train the classifier and the noise model through a novel de-noising loss having two components: (i) cross-entropy of the noise model prediction with the input label, and (ii) cross-entropy of the classifier prediction with the input label, weighted by the probability of the sample having a clean label. Our empirical evaluation on two text classification tasks and two types of label noise: random and input-conditional, shows that our approach can improve classification accuracy, and prevent over-fitting to the noise. • Computing methodologies → Natural language processing.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2101.11214")
get_code_for_paper("2101.11214")
have("2101.11214")

Connect an agent — have() is free.