CulFiT: A Fine-grained Cultural-aware LLM Training Paradigm via Multilingual Critique Data Synthesis

Xiuying Chen, Shuo Shang, Shen Gao, Lisi Chen, Ruixiang Feng

arXiv · PDF · Open in the Atlas

Code that ran

We lifted 1 functions out of this paper's own repositories and ran 0 of them in a sandbox. "Ran" means the function executed on a synthesized input and returned a value. It is not a reproduction of the paper's results.

Repositories linked to this paper

• mmadmax/culfit — marked official in Papers with Code; named in the paper
• MMadmax/CulFiT

Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.

Abstract

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks, yet they often exhibit a specific cultural biases, neglecting the values and linguistic diversity of low-resource regions. This cultural bias not only undermines universal equality, but also risks reinforcing stereotypes and perpetuating discrimination. To address this, we propose CulFiT, a novel culturally-aware training paradigm that leverages multilingual data and fine-grained reward modeling to enhance cultural sensitivity and inclusivity. Our approach synthesizes diverse cultural-related questions, constructs critique data in culturally relevant languages, and employs fine-grained rewards to decompose cultural texts into verifiable knowledge units for interpretable evaluation. We also introduce GlobalCultureQA, a multilingual open-ended question-answering dataset designed to evaluate culturally-aware responses in a global context. Extensive experiments on three existing benchmarks and our GlobalCul-tureQA demonstrate that CulFiT achieves stateof-the-art open-source model performance in cultural alignment and general reasoning. 1 * Corresponding authors 1 Code is available at https://github.com/MMadmax/CulFiT 阴阳家，他们认为世界是由阴阳两大 基本原则构成的。这些原则在自然界 中是相互矛盾、相互转化的对立面。 The Yin-Yang school, who believes that the world is composed of two fundamental principles: Yin and Yang. These principles are opposing forces in nature that contradict and transform into each other. (Translated) Which Chinese philosophical system emphasizes natural change and is associated with naturalism? 中国哪个哲学体系强调自 然变化并与自然主义相关？ Daoism, as it is a philosophy that emphasizes living in harmony with natural elements and processes.

For agents

The same record, over MCP at https://syntology.ai/mcp:

get_harvested_code_for_paper("2505.19484")
get_code_for_paper("2505.19484")
have("2505.19484")

Connect an agent — have() is free.