FairStress: A deeper evaluation of fairness in LLM decision-making

Hugging Face has introduced FairStress, a benchmark designed to measure demographic fairness in large language models (LLMs) beyond final decision outputs. The benchmark includes 300 realistic decision scenarios across 29 domains and aims to evaluate how models respond to adversarial arguments based on demographic identity.