| 1 |
Sep 23, Tuesday |
Introduction to Human Centered NLP [slides] |
|
| 1 |
Sep 25, Thursday |
The Ultimate Crash into LLMs [slides] |
Readings:
- Khattab, Omar, Arnav Singhvi, Paridhi Maheshwari, Zhiyuan Zhang, Keshav Santhanam, Sri Vardhamanan, Saiful Haq et al. "Dspy: Compiling declarative language model calls into self-improving pipelines." arXiv preprint arXiv:2310.03714 (2023).
- Schulhoff, Sander, Michael Ilie, Nishant Balepur, Konstantine Kahadze, Amanda Liu, Chenglei Si, Yinheng Li et al. "The Prompt Report: A Systematic Survey of Prompting Techniques." arXiv preprint arXiv:2406.06608 (2024).
|
| 2 |
Sep 30, Tuesday |
Learning from Human Preferences [slides] |
Readings:
- Ouyang, Long, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang et al. "Training language models to follow instructions with human feedback." arXiv preprint arXiv:2203.02155 (2022).
- Rafailov, Rafael, Archit Sharma, Eric Mitchell, Christopher D. Manning, Stefano Ermon, and Chelsea Finn. "Direct preference optimization: Your language model is secretly a reward model." Advances in Neural Information Processing Systems 36 (2024).
|
| 2 |
Oct 2, Thursday |
Collective Opinions and Pluralistic Alignment [slides] |
Readings:
- Bai, Yuntao, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen et al. "Constitutional AI: Harmlessness from AI feedback." arXiv preprint arXiv:2212.08073 (2022).
- Sorensen, Taylor, Jared Moore, Jillian Fisher, Mitchell L. Gordon, Niloofar Mireshghallah, Christopher Michael Rytting, Andre Ye et al. "Position: A Roadmap to Pluralistic Alignment." In Forty-first International Conference on Machine Learning (2024).
|
| 3 |
Oct 7, Tuesday |
📺 Guest Lecture: Will Held: Data, Data, and Data [slides] |
Readings:
- Zhou, Chunting, Pengfei Liu, Puxin Xu, Srinivasan Iyer, Jiao Sun, Yuning Mao, Xuezhe Ma et al. "Lima: Less is more for alignment." Advances in Neural Information Processing Systems 36 (2023): 55006-55021.
- Penedo, Guilherme, Hynek Kydlíček, Anton Lozhkov, Margaret Mitchell, Colin A. Raffel, Leandro Von Werra, and Thomas Wolf. "The fineweb datasets: Decanting the web for the finest text data at scale." Advances in Neural Information Processing Systems 37 (2024): 30811-30849.
- Longpre, Shayne, Robert Mahari, Naana Obeng-Marnu, William Brannon, Tobin South, Jad Kabbara, and Sandy Pentland. "Data Authenticity, Consent, and Provenance for AI Are All Broken: What Will It Take to Fix Them?." (2024).
|
| 3 |
Oct 9, Thursday |
📺 Guest Lecture: Omar Shaikh and Taylor Sorensen: Personalization [slides - Omar, slides - Taylor] |
|
| 4 |
Oct 14, Tuesday |
Human-AI Interaction [slides] |
Readings:
- Petridis, Savvas, Ben Wedin, James Wexler, Aaron Donsbach, Mahima Pushkarna, Nitesh Goyal, Carrie J. Cai, and Michael Terry. "ConstitutionMaker: Interactively Critiquing Large Language Models by Converting Feedback into Principles." arXiv preprint arXiv:2310.15428 (2023).
- Shaikh, Omar, Valentino Chai, Michele J. Gelfand, Diyi Yang, and Michael S. Bernstein. "Rehearsal: Simulating conflict to teach conflict resolution." arXiv preprint arXiv:2309.12309 (2023).
- Wu, Shirley, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, Jure Leskovec, and Jianfeng Gao. "CollabLLM: From Passive Responders to Active Collaborators." In Forty-second International Conference on Machine Learning (2025).
- Shao, Yijia, Vinay Samuel, Yucheng Jiang, John Yang, and Diyi Yang. "Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaboration." arXiv preprint arXiv:2412.15701 (2025).
|
| 4 |
Oct 16, Thursday |
Evaluating Human-AI interaction [slides] |
Readings:
- Mozannar, Hussein, Valerie Chen, Mohammed Alsobay, Subhro Das, Sebastian Zhao, Dennis Wei, Manish Nagireddy, Prasanna Sattigeri, Ameet Talwalkar, and David Sontag. "The RealHumanEval: Evaluating Large Language Models' Abilities to Support Programmers." arXiv preprint arXiv:2404.02806 (2024).
- Long, Tao, Katy Ilonka Gero, and Lydia B. Chilton. "Not Just Novelty: A Longitudinal Study on Utility and Customization of AI Workflows." arXiv preprint arXiv:2402.09894 (2024).
- Lee, Mina, Megha Srivastava, Amelia Hardy, John Thickstun, Esin Durmus, Ashwin Paranjape, Ines Gerard-Ursin et al. "Evaluating Human-Language Model Interaction." Transactions on Machine Learning Research.
|
| 5 |
Oct 21, Tuesday |
Design Thinking + New User Interface [slides] |
Readings:
- Pea, Roy D. "User centered system design: new perspectives on human-computer interaction" Journal educational computing research 3, no. 1 (1987): 129-134.
- Friedman, Batya, David G. Hendry, and Alan Borning. "A survey of value sensitive design methods." Foundations and Trends in Human–Computer Interaction 11, no. 2 (2017): 63-125.
- Birhane, Abeba, William Isaac, Vinodkumar Prabhakaran, Mark Díaz, Madeleine Clare Elish, Iason Gabriel, and Shakir Mohamed. "Power to the People? Opportunities and Challenges for Participatory AI." Equity and Access in Algorithms, Mechanisms, and Optimization (2022).
|
| 5 |
Oct 23, Thursday |
📺 Guest Lecture: Eric Zelikman |
|
| 6 |
Oct 28, Tuesday |
Midway Project Showcase |
|
| 6 |
Oct 30, Thursday |
New Frontiers in Generative Interaction [slides] |
Readings:
- Cao, Yining, Peiling Jiang, and Haijun Xia. "Generative and Malleable User Interfaces with Generative and Evolving Task-Driven Data Model." In Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems, pp. 1-20. (2025).
- Chen, Jiaqi, Yanzhe Zhang, Yutong Zhang, Yijia Shao, and Diyi Yang. "Generative Interfaces for Language Models." arXiv preprint arXiv:2508.19227 (2025).
- Chen, Yunnong, Chengwei Shi, and Liuqing Chen. "SpecifyUI: Supporting Iterative UI Design Intent Expression through Structured Specifications and Generative AI." arXiv preprint arXiv:2509.07334 (2025).
|
| 7 |
Nov 4, Tuesday |
Democracy Day - No Class |
|
| 7 |
Nov 6, Thursday |
Culture and Values in LLMs [slides] |
Readings:
- Hershcovich, Daniel, Stella Frank, Heather Lent, Miryam de Lhoneux, Mostafa Abdou, Stephanie Brandl, Emanuele Bugliarello et al. "Challenges and Strategies in Cross-Cultural NLP." ACL 2022.
- Kirk, Hannah Rose, Alexander Whitefield, Paul Röttger, Andrew Bean, Katerina Margatina, Juan Ciro, Rafael Mosquera et al. "The PRISM Alignment Project: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models." arXiv preprint arXiv:2404.16019 (2024).
- Naous, Tarek, Michael J. Ryan, Alan Ritter, and Wei Xu. "Having beer after prayer? Measuring Cultural Bias in Large Language Models." arXiv preprint arXiv:2305.14456 (2023).
|
| 8 |
Nov 11, Tuesday |
Anthropomorphism [slides] and 📺 Guest Lecture: Alice Oh [slides] |
Readings:
- Cheng, Myra, Kristina Gligoric, Tiziano Piccardi, and Dan Jurafsky. "AnthroScore: A Computational Linguistic Measure of Anthropomorphism." arXiv preprint arXiv:2402.02056 (2024).
- Reeves, Byron, and Clifford Nass. "The media equation: How people treat computers, television, and new media like real people." Cambridge, UK 10, no. 10 (1996): 19-36.
- Don, Abbe, Susan Brennan, Brenda Laurel, and Ben Shneiderman. "Anthropomorphism: from ELIZA to Terminator 2." In Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 67-70. 1992.
|
| 8 |
Nov 13, Thursday |
📺 Guest Lecture: Niloofar Mireshghallah [slides] |
Readings:
- Carlini, Nicholas, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts et al. "Extracting training data from large language models." In 30th USENIX security symposium (USENIX Security 21), pp. 2633-2650. 2021.
- Shao, Yijia, Tianshi Li, Weiyan Shi, Yanchen Liu, and Diyi Yang. "Privacylens: Evaluating privacy norm awareness of language models in action." Advances in Neural Information Processing Systems 37 (2024): 89373-89407.
- Mireshghallah, Niloofar, Hyunwoo Kim, Xuhui Zhou, Yulia Tsvetkov, Maarten Sap, Reza Shokri, and Yejin Choi. "Can llms keep a secret? testing privacy implications of language models via contextual integrity theory." arXiv preprint arXiv:2310.17884 (2023).
- Zhang, Yanzhe, and Diyi Yang. "Searching for Privacy Risks in LLM Agents via Simulation." arXiv preprint arXiv:2508.10880 (2025).
|
| 9 |
Nov 18, Tuesday |
The Rise of AI Companions [slides] and 📺 Guest Lecture: Myra Cheng [slides] |
Readings:
- Zhang, Yutong, Dora Zhao, Jeffrey T. Hancock, Robert Kraut, and Diyi Yang. "The Rise of AI Companions: How Human-Chatbot Relationships Influence Well-Being." arXiv preprint arXiv:2506.12605 (2025).
- Pataranutaporn, Pat, Sheer Karny, Chayapatr Archiwaranguprok, Constanze Albrecht, Auren R. Liu, and Pattie Maes. “My Boyfriend Is AI: A Computational Analysis of Human-AI Companionship in Reddit's AI Community.” arXiv preprint arXiv:2509.11391, September 14, 2025.
- Kaffee, Lucie-Aimée, Giada Pistilli, and Yacine Jernite. "INTIMA: A Benchmark for Human-AI Companionship Behavior." arXiv preprint arXiv:2508.09998 (2025).
|
| 9 |
Nov 20, Thursday |
LLMs and the Future of Work [slides] |
Readings:
- Eloundou, Tyna, Sam Manning, Pamela Mishkin, and Daniel Rock. "Gpts are gpts: An early look at the labor market impact potential of large language models." arXiv preprint arXiv:2303.10130 (2023).
- Shao, Yijia, Humishka Zope, Yucheng Jiang, Jiaxin Pei, David Nguyen, Erik Brynjolfsson, and Diyi Yang. "Future of Work with AI Agents: Auditing Automation and Augmentation Potential across the US Workforce." arXiv preprint arXiv:2506.06576 (2025).
- Tomlinson, Kiran, Sonia Jaffe, Will Wang, Scott Counts, and Siddharth Suri. "Working with AI: Measuring the Occupational Implications of Generative AI." arXiv preprint arXiv:2507.07935 (2025).
- Appel, Ruth, Peter McCrory, Alex Tamkin, Michael Stern, Miles McCain, and Tyler Neylon. "Anthropic Economic Index report: Uneven geographic and enterprise AI adoption" Anthropic (2025).
|
| 10 |
Nov 25, Tuesday |
Thanksgiving Holiday - No Class |
|
| 10 |
Nov 27, Thursday |
Thanksgiving Holiday - No Class |
|
| 11 |
Dec 2, Tuesday |
Open Questions in Human-Centered LLMs [slides] |
|
| 11 |
Dec 4, Thursday |
Project Feedback & Emergency Assistance (No Lecture) |
|
| | | |
