Thank you VA Patient Safety and Ci2i Fellowships (VAPAHCS) for supporting this work! Paul Heidenreich

Robert Gallo, a postdoc at Stanford, presents at the 2023 NLM T15 Conference hosted by Stanford DBDS on Friday morning.

Wonderful Hospital Medicine Grand Rounds today with Drs. Stephen Ma and Robert Gallo presenting on Design and Evaluation of Machine Learning Interventions in Clinical Contexts! Neera Ahuja

Rob Gallo, MD using regression discontinuity causal Inference methods to determine whether Epic deterioration models actually improved patient outcomes. #AMIA2023

Is General Internal Medicine as well funded as other IM subspecialties when it comes to early career development grant awards? Look at this paper by Rob Gallo, MD et al to find out! #internalmedicine #grantfunding buff.ly/411sduu

Mitigating the 'black box' of AI: LLMs can imitate diagnostic reasoning strategies when solving clinical cases & provide an interpretable means to assess if the generated answer is true/false based on the diagnostic reasoning's factual & logical accuracy. nature.com/articles/s4174…

In this quasi-experimental study, a deterioration model intervention was found to be associated with a decreased risk of escalations in care during hospitalization. ja.ma/4aqjG7V

Fascinating regression discontinuity study in JAMA Internal Medicine of Epic's deterioration index (EDI) by Rob Gallo, MD EDI alerts reduced rapid response & ICU transfers Though sensitive to bandwidth choice below & above the EDI threshold when the alert fires jamanetwork.com/journals/jamai…

Increase your sample size by asking LLM chatbot the same question 100 times. Wait, maybe not? Rob Gallo, MD diving in on evaluating generative #AI. Repeated prompting like asking the same person a question or like random sampling from a population of people?jamanetwork.com/journals/jama/…

Excited to share our insights on recent research uncovering racial disparities in readmission rates from Medicare data! Stanford Division of Hospital Medicine jamanetwork.com/journals/jama/…

Bottom line is, a more complex model isn't neccesarily more accurate or more like "causal effects" or more interpretable. Thanks to intermediates in the causal chain, colliders, Table 2 fallacy, bias-variance trade-off, model misspecification, etcetera

Great point! Although, I reviewed a manuscript not so long ago where the authors of a cluster randomized study didn't incorporate clustering in their statistical model, so I worry that even in that setting it is often ignored

World's fastest 🏃‍♀️‍➡️ will be crowned tomorrow. How fast should you send stroke patients for PEG? Rob Gallo, MD et al. suggest 🛑 and assess dysphagia risk in this #TWDFNR 🔗 …mpublications.onlinelibrary.wiley.com/doi/10.1002/jh… #VisualAbstract by Patricia Tran, MD, MS, FAAP (she/her)

🧐 Is early PEG after stroke a #TWDFNR ? Maybe observing with NG tube is a viable option. Rob Gallo, MD and coauthors review the pros and cons. 🔗 …mpublications.onlinelibrary.wiley.com/doi/10.1002/jh… #VisualAbstract by Patricia Tran, MD, MS, FAAP (she/her)

Ethan Mollick Provocative result we did NOT expect. We fully expected the Doctor + GPT4 arm to do better than Doctor + "conventional" Internet resources. Flies in the face of the Fundamental Theorem of Informatics (Human + Computer is Better than Either Alone).

A small randomized trial of generative #AI for diagnosis again (as seen in a few previous studies) shows higher performance for #AI than physicians + AI. May indicate that physicians need to be trained on how to incorporate AI. jamanetwork.com/journals/jaman…

Our first RCT on using an LLM on diagnostic reasoning is out! And the results are 🔥🌶️... adding ChatGPT did NOT improve diagnostic accuracy or reasoning, and the AI alone outperformed ALL the humans. What does this mean? A 🧵⬇️ x.com/EricTopol/stat…

Only a fraction of the doctors realized they could literally copy-paste in an entire case history into the chatbot and ask it for a surprisingly smart and comprehensive answer. nytimes.com/2024/11/17/hea…

Excited to join the JAMA Editorial Fellowship Program!

Excited to join UCSF Division of Hospital Medicine at SFGH!