UPDF AI

BeaverTails-IT: Towards a Safety Benchmark for Evaluating Italian Large Language Models

Giuseppe Magazzù,Alberto Sormani,7 Authors,Elisabetta Fersini

2025 · DBLP: conf/clic-it/MagazzuSRPSCMPSF25
Italian Conference on Computational Linguistics · 1 Citations

TLDR

The findings demonstrate the need for a dedicated, culturally grounded Italian safety benchmark to ensure effective and contextually appropriate evaluations, and enable the preliminary evaluation of Italian LLMs across key safety dimensions such as toxicity, bias, and ethical compliance.