|  | Vol-2765 urn:nbn:de:0074-2765-4 Copyright © 2020 for the individual papers by the papers' authors. Copyright © 2020 for the volume as a collection by its editors. This volume and its papers are published under the Creative Commons License Attribution 4.0 International (CC BY 4.0).

# EVALITA 2020
Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian

### Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2020)

### Online event, December 17th, 2020.

Edited by

### Valerio Basile *
Danilo Croce **
Maria Di Maro ***
Lucia C. Passaro ****

* University of Turin, Italy
** University of Rome "Tor Vergata", Italy
*** University of Naples "Federico II", Italy
**** University of Pisa, Italy

## Table of Contents

- Preface
  Summary: There were 73 papers submitted for peer-review to this workshop. Out of these, 72 papers were accepted for this volume, 33 as regular papers and 39 as short papers.
- EVALITA 2020: Overview of the 7th Evaluation Campaign of Natural Language Processing and Sspeech Tools for Italian
  Valerio Basile, Danilo Croce, Maria Di Maro, Lucia C. Passaro

### Keynote Talk

- Flattening the Curve of the COVID-19 Infodemic: These Evaluation Campaigns Can Help!
  Preslav Nakov

### Track "Affect, Hate, and Stance"

### AMI: Automatic Misogyny Identification

- AMI @ EVALITA2020: Automatic Misogyny Identification
  Elisabetta Fersini, Debora Nozza and Paolo Rosso
- UniBO @ AMI: A Multi-Class Approach to Misogyny and Aggressiveness Identification on Twitter Posts Using AlBERTo
  Arianna Muti and Alberto Barrón-Cedeño
- fabsam @ AMI: A Convolutional Neural Network Approach (short paper)
  Samuel Fabrizi
- Jigsaw @ AMI and HaSpeeDe2: Fine-Tuning a Pre-Trained Comment-Domain BERT Model
  Alyssa Lees, Jeffrey Sorensen and Ian Kivlichan
- PoliTeam @ AMI: Improving Sentence Embedding Similarity with Misogyny Lexicons for Automatic Misogyny Identification in Italian Tweets
  Giuseppe Attanasio and Eliana Pastor
- MDD @ AMI: Vanilla Classifiers for Misogyny Identification (short paper)
  Samer El Abassi and Sergiu Nisioi
- No Place For Hate Speech @ AMI: Convolutional Neural Network and Word Embedding for the Identification of Misogyny in Italian (short paper)
  Adriano dos S. R. da Silva and Norton T. Roman

### ATE_ABSITA: Aspect Term Extraction and Aspect-Based Sentiment Analysis

- ATE_ABSITA @ EVALITA2020: Overview of the Aspect Term Extraction and Aspect-based Sentiment Analysis Task
  Lorenzo de Mattei, Graziella De Martino, Andrea Iovine, Alessio Miaschi, Marco Polignano and Giulia Rambelli
- SentNA @ ATE_ABSITA: Sentiment Analysis of Customer Reviews Using Boosted Trees with Lexical and Lexicon-based Features (short paper)
  Francesco Mele, Antonio Sorgente and Giuseppe Vettigli
- ghostwriter19 @ ATE_ABSITA: Zero-Shot and ONNX to Speed up BERT on Sentiment Analysis Tasks at EVALITA 2020 (short paper)
  Mauro Bennici
- App2Check @ ATE_ABSITA 2020: Aspect Term Extraction and Aspect-based Sentiment Analysis (short paper)
  Emanuele Di Rosa and Alberto Durante

### HaSpeeDe: Hate Speech Detection

- HaSpeeDe 2 @ EVALITA2020: Overview of the EVALITA 2020 Hate Speech Detection Task
  Manuela Sanguinetti, Gloria Comandini, Elisa Di Nuovo, Simona Frenda, Marco Stranisci, Cristina Bosco, Tommaso Caselli, Viviana Patti and Irene Russo
- YNU_OXZ @ HaSpeeDe 2 and AMI : XLM-RoBERTa with Ordered Neurons LSTM for Classification Task at EVALITA 2020
  Xiaozhi Ou and Hongling Li
- DH-FBK @ HaSpeeDe2: Italian Hate Speech Detection via Self-Training and Oversampling
  Elisa Leonardelli, Stefano Menini and Sara Tonelli
- By1510 @ HaSpeeDe 2: Identification of Hate Speech for Italian Language in Social Media Data (short paper)
  Tao Deng, Yang Bai and Hongbing Dai
- Venses @ HaSpeeDe2 & SardiStance: Multilevel Deep Linguistically Based Supervised Approach to Classification
  Rodolfo Delmonte
- UR NLP @ HaSpeeDe 2 at EVALITA 2020: Towards Robust Hate Speech Detection with Contextual Embeddings
  Julia Hoffmann and Udo Kruschwitz
- Fontana-Unipi @ HaSpeeDe2: Ensemble of transformers for the Hate Speech task at Evalita (short paper)
  Michele Fontana and Giuseppe Attardi
- TheNorth @ HaSpeeDe 2: BERT-based Language Model Fine-tuning for Italian Hate Speech Detection (short paper)
  Eric Lavergne, Rajkumar Saini, György Kovács and Killian Murphy
- UO @ HaSpeeDe2: Ensemble Model for Italian Hate Speech Detection (short paper)
  Mariano Jason Rodriguez Cisnero and Reynier Ortega Bueno
- No Place For Hate Speech @ HaSpeeDe 2: Ensemble to Identify Hate Speech in Italian (short paper)
  Adriano dos S. R. da Silva and Norton T. Roman
- Svandiela @ HaSpeeDe: Detecting Hate Speech in Italian Twitter Data with BERT (short paper)
  Svea Klaus, Anna-Sophie Bartle and Daniela Rossmann
- CHILab @ HaSpeeDe 2: Enhancing Hate Speech Detection with Part-of-Speech Tagging (short paper)
  Giuseppe Gambino and Roberto Pirrone
- Montanti @ HaSpeeDe2 EVALITA 2020: Hate Speech Detection in online contents (short paper)
  Elia Bisconti, Matteo Montagnani

### SardiStance: Stance Detection

- SardiStance @ EVALITA2020: Overview of the Task on Stance Detection in Italian Tweets
  Alessandra Teresa Cignarella, Mirko Lai, Cristina Bosco, Viviana Patti and Paolo Rosso
- UNITOR @ Sardistance2020: Combining Transformer-based Architectures and Transfer Learning for Robust Stance Detection
  Simone Giorgioni, Marcello Politi, Samir Salman, Roberto Basili and Danilo Croce
- ghostwriter19 @ SardiStance: Generating New Tweets to Classify SardiStance EVALITA 2020 Political Tweets (short paper)
  Mauro Bennici
- QMUL-SDS @ SardiStance: Leveraging Network Interactions to Boost Performance on Stance Detection using Knowledge Graphs (short paper)
  Rabab Alkhalifa and Arkaitz Zubiaga
- DeepReading @ SardiStance 2020: Combining Textual, Social and Emotional Features
  Maria S. Espinosa, Rodrigo Agerri, Alvaro Rodrigo and Roberto Centeno
- TextWiller @ SardiStance, HaSpeede2: Text or Con-text? A Smart Use of Social Network Data in Predicting Polarization (short paper)
  Federico Ferraccioli, Andrea Sciandra, Mattia Da Pont, Paolo Girardi, Dario Solari and Livio Finos
- UninaStudents @ SardiStance: Stance Detection in Italian Tweets - Task A (short paper)
  Maurizio Moraca, Gianluca Sabella and Simone Morra
- SSN NLP @ SardiStance : Stance Detection from Italian Tweets using RNN and Transformers (short paper)
  Kayalvizhi S, Thenmozhi D and Aravindan Chandrabose
- SSNCSE-NLP @ EVALITA2020: Textual and Contextual Stance Detection from Tweets Using Machine Learning Approach (short paper)
  Bharathi B, Bhuvana J and Nitin Nikamanth Appiah Balaji

### Track "Creativity and Style"

### CHANGE-IT: Style Transfer

- CHANGE-IT @ EVALITA 2020: Change Headlines, Adapt News, GEnerate (short paper)
  Lorenzo De Mattei, Michele Cafagna, Felice Dell'Orletta, Malvina Nissim and Albert Gatt

### TAG-it: Topic, Age and Gender Prediction

- TAG-it @ EVALITA2020: Overview of the Topic, Age, and Gender Prediction Task for Italian
  Andrea Cimino, Felice Dell'Orletta and Malvina Nissim
- UO_4to @ TAG-it 2020: Ensemble of Machine Learning Methods (short paper)
  Maria Fernanda Artigas Herold and Daniel Castro Castro
- UOBIT @ TAG-it: Exploring a Multi-faceted Representation for Profiling Age, Topic and Gender in Italian Texts.
  Roberto Labadie Tamayo, Daniel Castro Castro and Reynier Ortega Bueno
- ItaliaNLP @ TAG-IT: UmBERTo for Author Profiling at TAG-it 2020 (short paper)
  Daniela Occhipinti, Andrea Tesei, Maria Iacono, Carlo Aliprandi and Lorenzo De Mattei

### Track "Semantics and Multimodality"

### DANKMEMES: Multimodal Artefacts Recognition

- DANKMEMES @ EVALITA 2020: The Memeing of Life: Memes, Multimodality and Politics
  Martina Miliani, Giulia Giorgi, Ilir Rama, Guido Anselmi and Gianluca E. Lebani
- SNK @ DANKMEMES: Leveraging Pretrained Embeddings for Multimodal Meme Detection (short paper)
  Stefano Fiorucci
- UPB @ DANKMEMES: Italian Memes Analysis - Employing Visual Models and Graph Convolutional Networks for Meme Identification and Hate Speech Detection (short paper)
  George-Alexandru Vlad, George-Eduard Zaharia, Dumitru-Clementin Cercel and Mihai Dascalu
- ArchiMeDe @ DANKMEMES: A New Model Architecture for Meme Detection
  Jinen Setpal and Gabriele Sarti
- UNITOR @ DANKMEME: Combining Convolutional Models and Transformer-based architectures for accurate MEME management
  Claudia Breazzano, Edoardo Rubino, Danilo Croce and Roberto Basili

### CONcreTEXT: Concreteness in Context

- CONcreTEXT @ EVALITA2020: The Concreteness in Context Task
  Lorenzo Gregori, Maria Montefinese, Daniele P. Radicioni, Andrea Amelio Ravelli and Rossella Varvara
- ANDI @ CONcreTEXT: Predicting Concreteness in Context for English and Italian using Distributional Models and Behavioural Norms (short paper)
  Armand Stefan Rotaru
- CAPISCO @ CONcreTEXT 2020: (Un)supervised Systems to Contextualize Concreteness with Norming Data
  Alessandro Bondielli, Gianluca E. Lebani, Lucia C. Passaro and Alessandro Lenci
- KonKretiKa @ CONcreTEXT: Computing Concreteness Indexes with Sigmoid Transformation and Adjustment for Context
  Yulia Badryzlova

### Ghigliottin-AI: Evaluating Artificial Players for the Language Game “La Ghigliottina”

- Ghigliottin-AI@EVALITA2020: Evaluating Artificial Players for the Language Game ``La Ghigliottina'' (short paper)
  Pierpaolo Basile, Marco Lovetere, Johanna Monti, Antonio Pascucci, Federico Sangati and Lucia Siciliani
- “Il Mago della Ghigliottina” @ GhigliottinAI: When Linguistics meets Artificial Intelligence
  Federico Sangati, Antonio Pascucci and Johanna Monti
- GUL.LE.VER @ GhigliottinAI: A Glove based Artificial Player to Solve the Language Game “La Ghigliottina” (short paper)
  Nazareno de Francesco

### PRELEARN: Prerequisite Relation Learning

- PRELEARN @ EVALITA 2020: Overview of the Prerequisite Relation Learning Task for Italian
  Chiara Alzetta, Alessio Miaschi, Felice Dell'Orletta, Frosina Koceva and Ilaria Torre
- B4DS @ PRELEARN: Ensemble Method for Prerequisite Learning (short paper)
  Giovanni Puccetti, Luis Bolanos, Filippo Chiarello and Gualtiero Fantoni
- UNIGE_SE @ PRELEARN: Utility for Automatic Prerequisite Learning from Italian Wikipedia (short paper)
  Alessio Moggio and Andrea Parizzi
- NLP-CIC @ PRELEARN: Mastering Prerequisites Relations, from Handcrafted Features to Embeddings (short paper)
  Jason Angel and Segun Aroyehun

### Track "Time and Diachrony"

### DaDoEval: Dating Documents

- DaDoEval @ EVALITA 2020: Same-Genre and Cross-Genre Dating of Historical Documents
  Stefano Menini, Giovanni Moretti, Rachele Sprugnoli and Sara Tonelli
- matteo-brv @ DaDoEval: An SVM-based Approach for Automatic Document Dating (short paper)
  Matteo Brivio
- rmassidda @ DaDoEval: Document Dating Using Sentence Embeddings at EVALITA 2020
  Riccardo Massidda

### DIACR-Ita: Diachronic Lexical Semantics

- DIACR-Ita @ EVALITA2020: Overview of the EVALITA2020 Diachronic Lexical Semantics (DIACR-Ita) Task
  Pierpaolo Basile, Annalina Caputo, Tommaso Caselli, Pierluigi Cassotti and Rossella Varvara
- University of Padova @ DIACR-Ita (short paper)
  Benyou Wang, Emanuele Di Buccio and Massimo Melucci
- UWB @ DIACR-Ita: Lexical Semantic Change Detection with CCA and Orthogonal Transformation
  Ondřej Pražák, Pavel Přibáň, Stephen Taylor
- QMUL-SDS @ DIACR-Ita: Evaluating Unsupervised Diachronic Lexical Semantics Classification in Italian (short paper)
  Rabab Alkhalifa, Adam Tsakalidis, Arkaitz Zubiaga and Maria Liakata
- CL-IMS @ DIACR-Ita: Volente o Nolente: BERT is still not Outperforming SGNS on Semantic Change Detection
  Severin Laicher, Gioia Baldissin, Enrique Castaneda, Dominik Schlechtweg and Sabine Schulte Im Walde
- OP-IMS @ DIACR-Ita: Back to the Roots: SGNS+OP+CD still Rocks Semantic Change Detection
  Jens Kaiser, Dominik Schlechtweg and Sabine Schulte Im Walde
- UNIMIB @ DIACR-Ita: Aligning Distributional Embeddings with a Compass for Semantic Change Detection in the Italian Language (short paper)
  Federico Belotti, Federico Bianchi and Matteo Palmonari
- NLP-CIC @ DIACR-Ita: POS and Neighbor Based Distributional Models for Lexical Semantic Change in Diachronic Italian Corpora (short paper)
  Jason Angel

### Track "New Challenges in Long-standing Tasks"

### AcCompl-it: Acceptability & Complexity evaluation

- AcCompl-it @ EVALITA2020: Overview of the Acceptability & Complexity Evaluation Task for Italian
  Dominique Brunato, Cristiano Chesi, Felice Dell'Orletta, Simonetta Montemagni, Giulia Venturi and Roberto Zamparelli
- UmBERTo-MTSA @ AcCompl-It: Improving Complexity and Acceptability Prediction with Multi-task Learning on Self-Supervised Annotations (short paper)
  Gabriele Sarti
- Venses @ AcCompl-It: Computing Complexity vs Acceptability with a Constituent Trigram Model and Semantics
  Rodolfo Delmonte

### KIPoS: Part-of-speech Tagging on Spoken Language

- KIPoS @ EVALITA2020: Overview of the Task on KIParla Part of Speech Tagging
  Cristina Bosco, Silvia Ballarè, Massimo Cerruti, Eugenio Goria and Caterina Mauri
- UniBO @ KIPoS: Fine-tuning the Italian “BERTology” for PoS-tagging Spoken Data (short paper)
  Fabio Tamburini
- UniBA @ KIPoS: A Hybrid Approach for Part-of-Speech Tagging (short paper)
  Giovanni Luca Izzi and Stefano Ferilli
- KLUMSy @ KIPoS: Experiments on Part-of-Speech Tagging of Spoken Italian
  Thomas Proisl and Gabriella Lapesa

2020-12-07: submitted by Valerio Basile, metadata incl. bibliographic data published under Creative Commons CC0
2020-12-09: published on CEUR Workshop Proceedings (CEUR-WS.org, ISSN 1613-0073) |valid HTML5|