Italian

Do Large Language Models understand how to be judges?

Twenty-four language models score Italian news summaries against an editorial rubric, and most of them rate the summaries higher than a human expert does.

Nicolò Donati, Paolo Torroni, Giuseppe Savino

Do Large Language Models understand how to be judges?

Detecting Vague Clauses in Italian Privacy Policies Using Transformers, LLMs, and Cross-Lingual Techniques

A new corpus of 30 Italian privacy policies shows that BERT models beat LLMs at flagging vague data clauses and that resources transfer across languages.

Giulia Grundler, Mariaceleste Musicco, Andrea Galassi, Francesca Lagioia, Rūta Liepiņa, Giorgio Resta, Sara Roccu, Giovanni Sartor, Paolo Torroni

Detecting Vague Clauses in Italian Privacy Policies Using Transformers, LLMs, and Cross-Lingual Techniques

AMELIA - Argument Mining Evaluation on Legal documents in ItAlian: A CALAMITA Challenge

AMELIA tests whether language models can classify legal arguments in Italian, with three tasks built on 225 expert-annotated decisions on Value Added Tax.

Giulia Grundler, Andrea Galassi, Piera Santin, Alessia Fidelangeli, Federico Galli, Elena Palmieri, Francesca Lagioia, Giovanni Sartor, Paolo Torroni

AMELIA - Argument Mining Evaluation on Legal documents in ItAlian: A CALAMITA Challenge

Language is Scary when Over-Analyzed: Unpacking Implied Misogynistic Reasoning with Argumentation Theory-Driven Prompts

Prompting LLMs to rebuild the hidden reasoning of implicit misogyny shows that they often reach the right label for the wrong reasons.

Arianna Muti, Federico Ruggeri, Khalid Al Khatib, Alberto Barrón-Cedeño, Tommaso Caselli

SubjectivITA: An Italian Corpus for Subjectivity Detection in Newspapers

Francesco Antici, Luca Bolognini, Matteo Antonio Inajetovic, Bogdan Ivasiuk, Andrea Galassi, Federico Ruggeri