| Vol-3772 urn:nbn:de:0074-3772-0 Copyright © 2024 for the individual papers by the papers' authors. Copyright © 2024 for the volume as a collection by its editors. This volume and its papers are published under the Creative Commons License Attribution 4.0 International (CC BY 4.0).

# EvalLAC 2024
Automated Evaluation of Learning and Assessment Content

### Proceedings of the First Workshop on Automated Evaluation of Learning and Assessment Content
co-located with the 25th International Conference on Artificial Intelligence in Education (AIED 2024)

### Recife, Brazil, July 08, 2024.

Edited by

### Luca Benedetto *
Andrew Caines *
George Dueñas **
Diana Galvan-Sosa *
Anastassia Loukina ***
Shiva Taslimipoor *
Torsten Zesch ****

* University of Cambridge
** National Pedagogical University of Colombia
*** Grammarly Inc.
**** FernUniversität in Hagen

## Table of Contents

- Preface
  Summary: There were 10 papers submitted for peer-review to this workshop. Out of these, 10 papers were accepted for this volume, 7 as regular papers and 3 as short papers.

### Technical papers

- Question Difficulty Prediction Based on Virtual Test-Takers and Item Response Theory
  Masaki Uto, Yuto Tomikawa, Ayaka Suzuki
- Can LLMs Evaluate Items Measuring Collaborative Problem-Solving?
  Ella Anghel, Yu Wang, Madhumitha Gopalakrishnan, Pranali Mansukhani, Yoav Bergner
- Enhancing Cross-prompt Automated Essay Scoring by Selecting Training Data Based on Reinforcement Learning
  Takumi Shibata, Masaki Uto
- Exploring Large Language Models for Evaluating Automatically Generated Questions
  Jeffrey S. Dittel, Michelle W. Clark, Rachel Van Campenhout, Benny G. Johnson
- Large Language Models for Learner Assistance in Massive Open Online Courses: Challenges, Tools, and Approaches
  Jesus-Angel del-Hoyo-Gabaldon, Eva Garcia-Lopez, Antonio Garcia-Cabot, David de-Fitero-Dominguez, Mary-Ellen Wiltrout, Jessica Sandland, Ana Bell
- Evaluation with Language Models in Non-formal Education: Understanding Student’s Persuasion Style in Competitive Debating
  Ali Al-Zawqari, Mohamed Ahmed, Gerd Vandersteen
- Towards Automatic Evaluation of Questions Generated from Ontologies
  Samah Alkhuzaey, Floriana Grasso, Terry R. Payne, Valentina Tamma
- Difficulty of Items – Predictions on Linguistic Features
  Anna Winklerová
- Evaluating LLMs’ Performance At Automatic Short-Answer Grading
  Rositsa V. Ivanova, Siegfried Handschuh

2024-09-05: submitted by Luca Benedetto, metadata incl. bibliographic data published under Creative Commons CC0
2024-10-01: published on CEUR Workshop Proceedings (CEUR-WS.org, ISSN 1613-0073) |valid HTML5|