Mathew Koretsky (@mkoretsky1) 's Twitter Profile
Mathew Koretsky

@mkoretsky1

Data and software engineer | @DataTecnica | @NIH | @uvmvermont alum

ID: 1599820231249215494

calendar_today05-12-2022 17:37:46

12 Tweet

21 Takipçi

67 Takip Edilen

Mathew Koretsky (@mkoretsky1) 's Twitter Profile Photo
Mathew Koretsky
@mkoretsky1

3 months ago

Can LLMs perform reliably as biomedical data analysts? TL;DR: We created the first benchmark designed to challenge LLMs ability to apply scientific reasoning in text-to-SQL generation over biomedical databases, revealing a 30-40% gap between SOTA models and expert performance