Sympathetic Framing: Evaluating AI Alignment across Sociodemographic Groups
Researchers evaluated how well seven LLMs align with human emotional perception regarding news headlines about political and geopolitical conflicts.
The study compared responses from 3,011 UK participants against seven LLMs to determine if models accurately identify sympathy-evoking language in news. The findings highlight the challenges of AI alignment in subjective areas like emotional nuance and political framing.