SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2305.02459 · ACL · 2023

Transfer and Active Learning for Dissonance Detection: Addressing the Rare-Class Challenge

Xiaoran Liu, H Andrew Schwartz, Vasudha Varadarajan, Syeda Mahwish, Swanie Juhng, Jonah Luby, Christian Luhmann

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

While transformer-based systems have enabled greater accuracies with fewer training examples, data acquisition obstacles still persist for rare-class tasks -when the class label is very infrequent (e.g., < 5% of samples). Active learning has in general been proposed to alleviate such challenges, but choice of selection strategy, the criteria by which rare-class examples are chosen, has not been systematically evaluated. Further, transformers enable iterative transfer-learning approaches. We propose and investigate transfer-and active learning solutions to the rare class problem of dissonance detection through utilizing models trained on closely related tasks and the evaluation of acquisition strategies, including a proposed probability-of-rare-class (PRC) approach. We perform these experiments for a specific rare class problem: collecting language samples of cognitive dissonance from social media. We find that PRC is a simple and effective strategy to guide annotations and ultimately improve model accuracy, and while transferlearning in a specific order can improve the cold-start performance of the learner but does not benefit iterations of active learning.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2305.02459")
get_code_for_paper("2305.02459")
have("2305.02459")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2305.02459.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2305.02459.svg)](https://syntology.ai/paper/2305.02459)

Connect an agent — have() is free.