1/ 🗞️🚨 Do great minds really think alike? 🧠🤖👨🏽‍🦱 We investigate Human-AI Complementarity in Question Answering using CAIMIRA, our item response theory based neural framework! w/ Hal Daumé III Tianyi Zhou Jordan Boyd-Graber Paper Link: arxiv.org/abs/2410.06524 #nlp #human #ai #irt #qa

I'll be presenting two papers NAACL HLT 2025! 1. Why LLMs can't write a question with the answer "468" 🤔🙅 2. A multi-agent LLM that balances opinions on "is pineapple good on pizza?" 🎭🍕 Let's also chat about: 📍 Helpfulness 📍 Why MCQA sucks 📍 Generating cute paper titles 👀

🏆ADVSCORE won an Outstanding Paper Award at #NAACL2025 NAACL HLT 2025!! If you want to learn how to make your benchmark *actually* adversarial, come find me: 📍Poster Session 5 - HC: Human-centered NLP 📅May 1 @ 2PM Hiring for human-focused AI dev/LLM eval? Let’s talk! 💼

Are you tired of using traditional stance detection to measure the polarity of text? Our #NAACL25 paper proposes an approach that uses pairwise comparisons to order texts on a continuous scale, capturing both implicit and explicit content. 📍Today @ Hall 3 from 4-5:30pm.

Linguistic theory tells us that common ground is essential to conversational success. But to what extent is it essential? Can LLMs detect when humans lose common ground in conversation? Our ACL 2025 (Oral) paper explores these questions on real-world data. #ACL2025NLP #ACL2025

I'm really excited about this new line of work with my collaborators at UMD and ARL on detecting common ground misalignments (basically, misunderstandings) in human goal-oriented conversations. Great summary below, or come to Philip Resnik's talk today at #ACL2025NLP! 2pm Hall N.1