We train T5-Base and T5-Large models from scratch on MIMIC-III and IV notes. We find that these models perform better than their general and biomedical counterpoints across clinical NLP tasks. We thank xyla.com for funding these models! (1/3)

📢 New Clinical LLM alert! T5-Base & T5-Large models trained from ✨scratch✨ on MIMIC III + IV notes Check out physionet for access: physionet.org/content/clinic…

Want to develop new ML tools for healthcare? Want to solve clinical problems in oncology, hepatology, & internal medicine using ideas from ML and causal inference? Join us as a postdoc at Vector: tinyurl.com/vectorpostdoc [Feb 28] Email: rahulgk at cs dot toronto dot edu RT pls!

Recent results have suggested that LLMs encode a surprising amount of clinical knowledge. These results raise an important question about the role of smaller specialized clinical models: do we still need clinical LMs? We explore this question in our paper: arxiv.org/abs/2302.08091

1/ I'm excited to introduce Event Stream GPT (ESGPT), a new software library dedicated to advancing the development of foundation models over "event stream" datasets, particularly Electronic Health Record (EHR) datasets, accessible here: github.com/mmcdermott/Eve…

Excited to unveil the first pip-installable benchmark of flu detection from wearables at chilconference 14M hours of Fitbit data, 5k+ participants, 206 with PCR-confirmed flu. Collected by Evidation Health, shared on Sage Bionetworks’s Synapse, funded by BARDA Gates Foundation. #CHIL2023

I'm going on the academic job market this fall, focused on research into knowledge and structure-augmented representation learning for health and biomedical data. Please reach out if there's a possible match with your departments or with other opportunities!

🩺 Launching the SNOMED CT Challenge in collaboration with SNOMED International, Veratai, and PhysioNet! Build models to link text in clinical notes to #snomedct clinical terminology. Help #healthcare get more from unstructured data and compete to win $25,000! snomed.drivendata.org