DIA-HARM
“Cross-dialectal transfer analysis across 2,450 dialect pairs shows that multilingual models (mDeBERTa: 97.2% average F1) generalize effectively, while monolingual models like RoBERTa and XLM-RoBERTa fail on dialectal inputs.”
The authors, in the abstract
Dialectal Disparities in Harmful Content Detection Across 50 English Dialects