SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2407.17624 · 2024

Forecasting Credit Ratings: A Case Study where Traditional Methods Outperform Generative LLMs

Janet Pierrehumbert, Felix Drinkall, Stefan Zohren

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.

Repositories linked to this paper

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Large Language Models (LLMs) have been shown to perform well for many downstream tasks. Transfer learning can enable LLMs to acquire skills that were not targeted during pretraining. In financial contexts, LLMs can sometimes beat well-established benchmarks. This paper investigates how well LLMs perform at forecasting corporate credit ratings. We show that while LLMs are very good at encoding textual information, traditional methods are still very competitive when it comes to encoding numeric and multimodal data. For our task, current LLMs perform worse than a more traditional XGBoost architecture that combines fundamental and macroeconomic data with highdensity text-based embedding features. We investigate the degree to which the text encoding methodology affects performance and interpretability. The dataset reconstruction and model code from this paper is provided 1 .

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2407.17624")
get_code_for_paper("2407.17624")
have("2407.17624")

The run record, dated, one paper per request, free:

curl https://syntology.ai/api/ran/2407.17624.json

A badge for a README (the split and the date, never a ratio):

[![Syntology run record](https://syntology.ai/api/ran/2407.17624.svg)](https://syntology.ai/paper/2407.17624)

Connect an agent — have() is free.