SYNTOLOGY HomeExplorerAtlasCodeMethodologyAboutDevelopersFeedPricing
Paper · 2502.04564 · NAACL · 2025

My LLM might Mimic AAE -But When Should it?

Hal Daumé, Sandra Sandoval, Christabel Acquaye, Kwesi Cobbina, Mohammad Teli

arXiv · PDF · Open in the Atlas

Code that ran

We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. If it links a repository, it is listed below.

Abstract

We examine the representation of African American English (AAE) in large language models (LLMs), exploring (a) the perceptions Black Americans have of how effective these technologies are at producing authentic AAE, and (b) in what contexts Black Americans find this desirable. Through both a survey of Black Americans (n = 104) and annotation of LLMproduced AAE by Black Americans (n = 228), we find that Black Americans favor choice and autonomy in determining when AAE is appropriate in LLM output. They tend to prefer that LLMs default to communicating in Mainstream U.S. English in formal settings, with greater interest in AAE production in less formal settings. When LLMs were appropriately prompted and provided in context examples, our participants found their outputs to have a level of AAE authenticity on par with transcripts of Black American speech. Select code and data for our project can be found here: https://github. com/smelliecat/AAEMime.git * Asterisks (*) indicate similar levels of contribution. 1 We use Black Americans to describe those who identify as American with ancestral roots to Black African ethnic groups.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2502.04564")
get_code_for_paper("2502.04564")
have("2502.04564")

Connect an agent — have() is free.