In plain words: A test of 450 role-play situations checks whether chatbots grasp taarof, Iran's ritual politeness where people refuse offers and show modesty. Top chatbots fell 40-48% below native speakers when it was called for, and standard politeness ratings often praised replies that broke the custom.
Abstract
Large language models (LLMs) struggle to navigate culturally specific communication norms, limiting their effectiveness in global contexts. We focus on Persian taarof, a social norm in Iranian interactions, which is a sophisticated system of ritual politeness that emphasizes deference, modesty, and indirectness, yet remains absent from existing cultural benchmarks. We introduce TaarofBench, the first benchmark for evaluating LLM understanding of taarof, comprising 450 role-play scenarios covering 12 common social interaction topics, validated by native speakers. Our evaluation of five frontier LLMs reveals substantial gaps in cultural competence, with accuracy rates 40-48% below native speakers when taarof is culturally appropriate. Performance varies between interaction topics, improves with Persian-language prompts, and exhibits gender-based asymmetries. We also show that responses rated "polite" by standard metrics often violate taarof norms, indicating the limitations of Western politeness frameworks. Through supervised fine-tuning and Direct Preference Optimization, we achieve 21.8% and 42.3% improvement in model alignment with cultural expectations. Our human study with 33 participants (11 native Persian, 11 heritage, and 11 non-Iranian speakers) forms baselines in varying degrees of familiarity with Persian norms. This work lays the foundation for developing diverse and culturally aware LLMs, enabling applications that better navigate complex social interactions.
Nikta Gohari Sadr, Sahar Heidariasl, Karine Megerdoomian, Laleh Seyyed-Kalantari, Ali Emami
arXiv:2509.01035 · cs.CL · submitted Sep 1, 2025
abstract · pdf · html · Accepted to EMNLP 2025 Main Conference
The entire of the Middle East operates on a principle of magnanimous hospitality. The Arabs call this karam, for example, which is considered to even be a religious obligation.
So if you're a stranger passing through a town and chat with some locals, you can expect for someone to invite you for tea and maybe even dinner!
Do you take them up on the offer?
Most people in the West would ask themselves "do I have the time", but a middle easterner would think "do they have the time?" Remember, you as a guest are also magnanimously hospitable--in this case, the least possible burden. Unfortunately, the guest must navigate whether they are being considerate or insulting by refusing hospitality.
Now to address taarof specifically. Persian's have pathologized hosptiality to the point of psychosis. The behavior is often mechanically choreographed (e.g. you should refuse at least twice before accepting a cucumber.) In other cases, it's insane.
Story time:
My mom and aunt had not seen each other for 3 years and met for lunch at a cafe. They went back and forth over who would pay at the register until it erupted into a fight. They sat at separate tables for lunch.
A close family friend--with no provocation from my sister--offered to house her for a weekend she was visiting. My sister accepted. That friend later complained to my mother.
A friend of mine went to a mechanic who offered to fix a small issue for free. My friend knowing better paid him anyway, but the mechanic was still upset since he didn't pay enough!
Edit: Just to address some of the comments. Abroad, the degree of hospitality is warped for foreigners (for what I hope are obvious reasons). Middle easterners in the West are far more inclusive.