Study introduces 'Missed-in-Urdu' scores to measure LLM hate speech detection gaps
A new arXiv paper examines how large language models detect hate speech in Urdu, a language with roughly 246 million speakers that the authors say has been largely overlooked in mainstream AI safety evaluation, including nine years of the Workshop on Online Abuse and Harms. The researchers propose 'Missed-in-Urdu' scores to quantify inconsistencies in how safety systems treat equivalent content across scripts and languages. The preprint appears in both the AI and computational linguistics categories on arXiv.