SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2201.02026 · AAAI · 2022

Fortunately, Discourse Markers Can Enhance Language Models for Sentiment Analysis

Noam Slonim, Ranit Aharonov, Artem Spector, Ilya Shnayderman, Lena Dankin, Liat Ein-Dor

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

In recent years, pretrained language models have revolutionized the NLP world, while achieving state-of-the-art performance in various downstream tasks. However, in many cases, these models do not perform well when labeled data is scarce and the model is expected to perform in the zero or few shot setting. Recently, several works have shown that continual pretraining or performing a second phase of pretraining (inter-training), which is better aligned with the downstream task, can lead to improved results, especially in the scarce data setting. Here, we propose to leverage sentiment-carrying discoursemarkers to generate large-scale weakly-labeled data, which in turn can be used to adapt general-purpose language models to the task of sentiment classification. In addition, we propose a new method for adapting sentiment classification models to new domains. This method is based on automatic identification of domain-specific sentiment-carrying discourse markers. Extensive experimental results show the value of our approach on various benchmark datasets. Code, models and data are available at https://github.com/ibm/tslm-discourse-markers.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2201.02026")
get_code_for_paper("2201.02026")
have("2201.02026")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2201.02026.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2201.02026.svg)](https://syntology.ai/paper/2201.02026)

Connect an agent — have() is free.