Publications

Convergence and Divergence of Language Models under Different Random Seeds

Finlay Fehlauer, Kyle Mahowald, Tiago Pimentel
In: Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing , 2025

The Non-Linear Representation Dilemma: Is Causal Abstraction Enough for Mechanistic Interpretability?

Denis Sutter, Julian Minder, Thomas Hofmann, Tiago Pimentel
In: Advances in Neural Information Processing Systems, 2025

Using Information Theory to Characterize Prosodic Typology: The Case of Tone, Pitch-Accent and Stress-Accent

Ethan Wilcox, Cui Ding, Giovanni Acampa, Tiago Pimentel, Alex Warstadt, Tamar I Regev
In: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025
★: Won a senior area chair highlights award

The time scale of redundancy between prosody and linguistic context

Tamar I Regev, Chiebuka Ohams, Shaylee Xie, Lukas Wolf, Evelina Fedorenko, Alex Warstadt, Ethan Wilcox, Tiago Pimentel
In: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

Causal Estimation of Tokenisation Bias

Pietro Lesci, Clara Meister, Thomas Hofmann, Andreas Vlachos, Tiago Pimentel
In: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

Tokenisation is NP-Complete

Philip Whittington, Gregor Bachmann, Tiago Pimentel
In: Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025
★: Won a senior area chair highlights award

Investigating Critical Period Eﬀects in Language Acquisition through Neural Language Models

Ionut Constantinescu, Tiago Pimentel, Ryan Cotterell, Alex Warstadt
In: Transactions of the Association for Computational Linguistics, 2025

Local and Global Decoding in Text Generation

Daniel Gareev, Thomas Hofmann, Ezhilmathi Krishnasamy, Tiago Pimentel
In: Findings of the Association for Computational Linguistics: EMNLP 2024 , 2024

Towards a Similarity-adjusted Surprisal Theory

Clara Meister, Mario Giulianelli, Tiago Pimentel
In: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , 2024

How to Compute the Probability of a Word

Tiago Pimentel, Clara Meister
In: Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , 2024

The Role of Language Imbalance in Cross-lingual Generalisation: Insights from Cloned Language Experiments

Anton Schäfer, Shauli Ravfogel, Thomas Hofmann, Tiago Pimentel*, Imanol Schlag*
In: arXiv, 2024

Causal Estimation of Memorisation Profiles

Pietro Lesci, Clara Meister, Thomas Hofmann, Andreas Vlachos, Tiago Pimentel
In: Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2024
★: Won the best paper award

On the Effect of (Near) Subword Duplication in Language Modelling

Anton Schäfer, Thomas Hofmann, Imanol Schlag, Tiago Pimentel
In: Findings of the Association for Computational Linguistics: ACL 2024, 2024

An Information-theoretic Analysis of Regressions in Naturalistic Reading

Ethan G. Wilcox, Tiago Pimentel, Clara Meister, Ryan Cotterell
In: Cognition, 2024

Large-scale evidence for logarithmic effects of word predictability on reading time

Cory Shain, Clara Meister, Tiago Pimentel, Ryan Cotterell, Roger Levy
In: Proceedings of the National Academy of Sciences, 2024

Revisiting the Optimality of Word Lengths

Tiago Pimentel, Ethan G. Wilcox, Clara Meister, Kyle Mahowald, Ryan Cotterell
In: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023
★: Won an outstanding paper award in the Linguistic Theories, Cognitive Modeling, and Psycholinguistics track

Language Model Quality Correlates with Psychometric Predictive Power in Multiple Languages

Ethan G. Wilcox, Clara Meister, Ryan Cotterell, Tiago Pimentel
In: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023
★: Won an outstanding paper award in the Linguistic Theories, Cognitive Modeling, and Psycholinguistics track

Quantifying the redundancy between prosody and text

Lukas Wolf, Tiago Pimentel, Evelina Fedorenko, Ryan Cotterell, Alex Warstadt, Ethan G. Wilcox, Tamar Regev
In: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

An Exploration of Left-Corner Transformations

Andreas Opedal, Eleftheria Tsipidi, Tiago Pimentel, Ryan Cotterell, Tim Vieira
In: Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

A taxonomy and review of generalisation research in NLP

Dieuwke Hupkes, Mario Giulianelli, Verna Dankers, Mikel Artetxe, Yanai Elazar, Tiago Pimentel, Christos Christodoulopoulos, Karim Lasri, Naomi Saphra, Arabella Sinclair, Dennis Ulmer, Florian Schottmann, Khuyagbaatar Batsuren, Kaiser Sun, Koustuv Sinha, Leila Khalatbari, Maria Ryskina, Rita Frieske, Ryan Cotterell, Zhijing Jin
In: Nature Machine Intelligence, 2023

On the Effect of Anticipation on Reading Times

Tiago Pimentel, Clara Meister, Ethan G. Wilcox, Roger Levy, Ryan Cotterell
In: Transactions of the Association for Computational Linguistics, 2023

Testing the Predictions of Surprisal Theory in 11 Languages

Ethan G. Wilcox, Tiago Pimentel, Clara Meister, Ryan Cotterell, Roger P. Levy
In: Transactions of the Association for Computational Linguistics, 2023

A Cross-Linguistic Pressure for Uniform Information Density in Word Order

Thomas Hikaru Clark, Clara Meister, Tiago Pimentel, Michael Hahn, Ryan Cotterell, Richard Futrell, Roger Levy
In: Transactions of the Association for Computational Linguistics, 2023

On the Efficacy of Sampling Adapters

Clara Meister, Tiago Pimentel, Luca Malagutti, Ethan G. Wilcox, Ryan Cotterell
In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

Few-shot Fine-tuning vs. In-context Learning: A Fair Comparison and Evaluation

Marius Mosbach, Tiago Pimentel, Shauli Ravfogel, Dietrich Klakow, Yanai Elazar
In: Findings of the Association for Computational Linguistics: ACL 2023, 2023

A Measure-Theoretic Characterization of Tight Language Models

Li Du, Lucas Torroba Hennigen, Tiago Pimentel, Clara Meister, Jason Eisner, Ryan Cotterell
In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

A Natural Bias for Language Generation Models

Clara Meister, Wojciech Stokowiec, Tiago Pimentel, Lei Yu, Laura Rimell, Adhiguna Kuncoro
In: Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2023

Quantifying Gender Bias Towards Politicians in Cross-Lingual Language Models

Karolina Stańczak, Sagnik Ray Choudhury, Tiago Pimentel, Ryan Cotterell, Isabelle Augenstein
In: PLOS One, 2023

On the Usefulness of Embeddings, Clusters and Strings for Text Generation Evaluation

Tiago Pimentel, Clara Meister, Ryan Cotterell
In: The Eleventh International Conference on Learning Representations, 2023

On the Intersection of Context-Free and Regular Languages

Clemente Pasti, Andreas Opedal, Tiago Pimentel, Tim Vieira, Jason Eisner, Ryan Cotterell
In: Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023

Naturalistic Causal Probing for Morpho-Syntax

Afra Amini, Tiago Pimentel, Clara Meister, Ryan Cotterell
In: Transactions of the Association for Computational Linguistics, Volume 11, 2023

Locally Typical Sampling

Clara Meister, Tiago Pimentel, Gian Wiher, Ryan Cotterell
In: Transactions of the Association for Computational Linguistics, Volume 11, 2023

The Architectural Bottleneck Principle

Tiago Pimentel, Josef Valvoda, Niklas Stoehr, Ryan Cotterell
In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

Rethinking Reinforcement Learning for Recommendation: A Prompt Perspective

Xin Xin, Tiago Pimentel, Alexandros Karatzoglou, Pengjie Ren, Konstantina Christakopoulou, Zhaochun Ren
In: Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, 2022

UniMorph 4.0: Universal Morphology

Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, Nizar Habash, Witold Kieraś, Gábor Bella, Brian Leonard, Garrett Nicolai, Kyle Gorman, Yustinus Ghanggo Ate, Maria Ryskina, Sabrina Mielke, Elena Budianskaya, Charbel El-Khaissi, Tiago Pimentel, Michael Gasser, William Abbott Lane, Mohit Raj, Matt Coler, Jaime Rafael Montoya Samame, Delio Siticonatzi Camaiteri, Esaú Zumaeta Rojas, Didier López Francis, Arturo Oncevay, Juan López Bautista, Gema Celeste Silva Villegas, Lucas Torroba Hennigen, Adam Ek, David Guriel, Peter Dirix, Jean-Philippe Bernardy, Andrey Scherbakov, Aziyana Bayyr-ool, Antonios Anastasopoulos, Roberto Zariquiey, Karina Sheifer, Sofya Ganieva, Hilaria Cruz, Ritván Karahóǧa, Stella Markantonatou, George Pavlidis, Matvey Plugaryov, Elena Klyachko, Ali Salehi, Candy Angulo, Jatayu Baxi, Andrew Krizhanovsky, Natalia Krizhanovskaya, Elizabeth Salesky, Clara Vania, Sardana Ivanova, Jennifer White, Rowan Hall Maudslay, Josef Valvoda, Ran Zmigrod, Paula Czarnowska, Irene Nikkarinen, Aelita Salchak, Brijesh Bhatt, Christopher Straughn, Zoey Liu, Jonathan North Washington, Yuval Pinter, Duygu Ataman, Marcin Wolinski, Totok Suhardijanto, Anna Yablonskaya, Niklas Stoehr, Hossep Dolatian, Zahroh Nuriah, Shyam Ratan, Francis M. Tyers, Edoardo M. Ponti, Grant Aiton, Aryaman Arora, Richard J. Hatcher, Ritesh Kumar, Jeremiah Young, Daria Rodionova, Anastasia Yemelina, Taras Andrushko, Igor Marchenko, Polina Mashkovtseva, Alexandra Serova, Emily Prud’hommeaux, Maria Nepomniashchaya, Fausto Giunchiglia, Eleanor Chodroff, Mans Hulden, Miikka Silfverberg, Arya D. McCarthy, David Yarowsky, Ryan Cotterell, Reut Tsarfaty, Ekaterina Vylomova
In: Proceedings of the Thirteenth Language Resources and Evaluation Conference, 2022

Probing for the Usage of Grammatical Number

Karim Lasri, Tiago Pimentel, Alessandro Lenci, Thierry Poibeau, Ryan Cotterell
In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2022

Analyzing Wrap-Up Effects through an Information-Theoretic Lens

Clara Meister, Tiago Pimentel, Thomas Clark, Ryan Cotterell, Roger Levy
In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2022

On the probability–quality paradox in language generation

Clara Meister, Gian Wiher, Tiago Pimentel, Ryan Cotterell
In: Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), 2022

A Bayesian Framework for Information-Theoretic Probing

Tiago Pimentel, Ryan Cotterell
In: Empirical Methods in Natural Language Processing (EMNLP), 2021

On Homophony and Rényi Entropy

Tiago Pimentel, Clara Meister, Simone Teufel, Ryan Cotterell
In: Empirical Methods in Natural Language Processing (EMNLP), 2021

A surprisal–duration trade-off across and within the world’s languages

Tiago Pimentel, Clara Meister, Elizabeth Salesky, Simone Teufel, Damián Blasi, Ryan Cotterell
In: Empirical Methods in Natural Language Processing (EMNLP), 2021

Revisiting the Uniform Information Density Hypothesis

Clara Meister, Tiago Pimentel, Patrick Haller, Lena Jäger, Ryan Cotterell, Roger Levy
In: Empirical Methods in Natural Language Processing (EMNLP), 2021

Modeling the Unigram Distribution

Irene Nikkarinen, Tiago Pimentel, Damián Blasi, Ryan Cotterell
In: Findings of the Association for Computational Linguistics, 2021

How (Non-)Optimal is the Lexicon?

Tiago Pimentel, Irene Nikkarinen, Kyle Mahowald, Ryan Cotterell, Damián Blasi
In: North American Chapter of the Association for Computational Linguistics, 2021

Finding Concept-specific Biases in Form–Meaning Associations

Tiago Pimentel, Brian Roark, Søren Wichmann, Ryan Cotterell, Damián Blasi
In: North American Chapter of the Association for Computational Linguistics, 2021

A Non-Linear Structural Probe

Jennifer C. White, Tiago Pimentel, Naomi Saphra, and Ryan Cotterell
In: North American Chapter of the Association for Computational Linguistics, 2021

What About the Precedent: An Information-Theoretic Analysis of Common Law

Josef Valvoda, Tiago Pimentel, Niklas Stoehr, Ryan Cotterell, and Simone Teufel
In: North American Chapter of the Association for Computational Linguistics, 2021

Disambiguatory Signals are Stronger in Word-initial Positions

Tiago Pimentel, Ryan Cotterell, and Brian Roark
In: European Chapter of the Association for Computational Linguistics, 2021

Speakers Fill Lexical Semantic Gaps with Context

Tiago Pimentel, Rowan Hall Maudslay, Damián Blasi, and Ryan Cotterell
In: Empirical Methods in Natural Language Processing (EMNLP), 2020

Pareto Probing: Trading-Off Accuracy and Complexity

Tiago Pimentel, Naomi Saphra, Adina Williams, and Ryan Cotterell
In: Empirical Methods in Natural Language Processing (EMNLP), 2020

Information-Theoretic Probing for Linguistic Structure

Tiago Pimentel, Josef Valvoda, Rowan Hall Maudslay, Ran Zmigrod, Adina Williams, and Ryan Cotterell
In: Association for Computational Linguistics (ACL), 2020

A Tale of a Probe and a Parser

Rowan Hall Maudslay, Josef Valvoda, Tiago Pimentel, Adina Williams, and Ryan Cotterell
In: Association for Computational Linguistics (ACL), 2020

Predicting Declension Class from Form and Meaning

Adina Williams, Tiago Pimentel, Hagen Blix, Arya D. McCarthy, Eleanor Chodroff, and Ryan Cotterell
In: Association for Computational Linguistics (ACL), 2020

A Corpus for Large-Scale Phonetic Typology

Elizabeth Salesky, Eleanor Chodroff, Tiago Pimentel, Matthew Wiesner, Ryan Cotterell, Alan W. Black, and Jason Eisner
In: Association for Computational Linguistics (ACL), 2020

Deep Active Learning for Anomaly Detection

Tiago Pimentel, Marianne Monteiro, Adriano Veloso, and Nivio Ziviani
In: International Joint Conference on Neural Networks (IJCNN), 2020

Assessing the Reliability of Visual Explanations of Deep Models with Adversarial Perturbations

Dan Valle, Tiago Pimentel, and Adriano Veloso
In: International Joint Conference on Neural Networks (IJCNN), 2020

Phonotactic Complexity and Its Trade-offs

Tiago Pimentel, Brian Roark, and Ryan Cotterell
In: Transactions of the Association for Computational Linguistics (TACL), 2020

Meaning to Form: Measuring Systematicity as Information

Tiago Pimentel, Arya D. McCarthy, Damián Blasi, Brian Roark, Ryan Cotterell
In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019
★: Nominated for the best paper award

Efficient estimation of node representations in large graphs using linear contexts

Tiago Pimentel, Rafael Castro, Adriano Veloso, and Nivio Ziviani
In: International Joint Conference on Neural Networks (IJCNN), 2019

Fast and effective neural networks for translating natural language into denotations

Tiago Pimentel, Juliano Viana, Adriano Veloso, and Nivio Ziviani
In: String Processing and Information Retrieval (SPIRE), 2018

Detection of bimanual gestures everywhere: Why it matters, what we need and what is missing

Divya Shah, Ernesto Denicia, Tiago Pimentel, Barbara Bruno, Fulvio Mastrogiovanni
In: Robotics and Autonomous Systems, 2018

Mapping planetary caves with an autonomous, heterogeneous robot team

Ammar Husain, Heather Jones, Balajee Kannan, Uland Wong, Tiago Pimentel, Sarah Tang, Shreyansh Daftry, Steven Huber, William L. Whittaker
In: IEEE Aerospace Conference, 2013