Chaining LLM calls can improve output quality, but navigating the massive space of task decompositions is challenging. Revisiting the established field of crowdsourcing, we distill strategies for effective LLM chain design and identify opportunities for future research. [1/11]

Tired of your language model 'delving' into things? Or maybe you like delving! We're working on a new interaction & method to customize language models, and we're looking for participants! If you're interested, please fill out the Google Form below.

forms.gle/6hyPgvSsqRSYHp…

It's been great working with the folks from AI Vulnerability Database to launch a public version of IndieLabel, our prototype end-user auditing system (from our CSCW22 paper)! We hope this demo can seed further discussion and future work on user-driven AI audits ✨

Before taking it out on your roommate for leaving dirty dishes out, you probably want to practice your conflict resolution skills first. Expert conflict resolution trainers, however, are EXPENSIVE. What if we practiced with an angry LLM instead? 😈 #CHI24

arxiv.org/abs/2309.12309

How should we correct the mistakes of ML models?

Can we just _tell_ them what they’re doing wrong?

Paper: arxiv.org/abs/2402.03715

10 days from the deadline! See you in Hawaii

📢 Working on the evaluation crisis of #LLMs ? Join our #CHI2024 workshop on Human-centered Evaluation and Auditing of Language models (HEAL)!

Submission is now open!
CfP: heal-workshop.github.io

Wesley Hanwen Deng Michelle Lam Motahhare Eslami Juho Kim Mina Lee Vera Liao
#HCI #NLProc

Though LLM chaining is powerful, the design process is often difficult and unstructured—but we don't have to start from scratch! This work synthesizes over a decade of crowdsourcing work into a design space that elucidates lessons that transfer and open challenges unique to LLMs.

With so many open questions about how we ought to evaluate and audit LLMs, the HCI community has an exciting opportunity to lead the discussion with creative, human-centered approaches. Come join our workshop (HEAL) at #CHI2024 — submissions are due Feb 23!

📣 I’m recruiting 1-2 PhD students interested in #HCI , #AR , and Spatial Computing. More information: parastooabtahi.com

If you’re interested, apply to Princeton CS (cs.princeton.edu/grad) by Dec 15 and mention my name in your application ✨

I’m recruiting PhD students and there are still a few days left to apply! If you’re excited about working at the intersection of HCI and AI, come join my new group MIT EECS. Please submit at gradapply.mit.edu/eecs by 12/15!

Today's social media AIs encode values—can we mitigate societal harms by making these values explicit and tuneable? Excited to share our #CSCW24 paper introducing societal objective functions, which translate social science constructs into algorithmic objectives for social media!