Congrats to our 2nd ever PhD, the soon-to-be-minted Doctor Danish, who defended his dissertation this week. Danish joined this lab before it was a lab and helped build it from the ground up. We're proud of all you've accomplished and excited to see your future unfold. 👨‍🎓📜💻

New work by Saurabh Garg (ICLR 2022) shows that in general, OOD accuracy is identified only when the optimal predictor is identified. Thus, any guarantee requires assumptions on nature of shift. Also discovers a simple method that works surprisingly well on many benchmarks.

Congrats to our nephew-turned-son Riccardo Fogliato on a great thesis proposal. Riccardo's tackles deep questions re (i) the performance and fairness properties of criminal risk assessment instruments; and (ii) {human+model} hybrid decision-making systems. acmilab.org/people/riccard…

New work by ACMI Lab (CMU) PhD student Divyansh Kaushik tackles the thorny issue of when to designate ML crowdworkers as human subjects. Our analysis reveals nuances, ambiguities, a loophole, & practical guidance authors: DK, Zachary Lipton & Alex John London paper: arxiv.org/abs/2206.04039

Is flatness indicative of generalization? Not necessarily. Our experimental study calls the relationship between flatness (as measured by the max Hessian eigenvalue) and generalization into question. arxiv.org/abs/2206.10654

New paper "Domain Adaptation under Open Set Label Shift" by ACMI Lab (CMU) PhD student Saurabh Garg w coadvisors Zachary Lipton & Siva Balakrishnan. Lays out theoretical foundations & practical algorithm, for one scenario where open set adaptation can work. arxiv.org/abs/2207.13048

An ACMI Lab (CMU) reunion at ICML Conference! #ICML2023

Yesterday, I had the honor of speaking in the US Senate AI Insight Forum on privacy & liability, moderated by Chuck Schumer Senator Mike Rounds Martin Heinrich & Senator Todd Young. Each panelist submitted a written statement for Chuck Schumer's website. Here’s mine: abridge.com/blog/ai-policy…