Jennifer Hu (@_jennhu) 's Twitter Profile
Jennifer Hu

@_jennhu

Research Fellow at @Harvard and incoming Asst Prof at @JohnsHopkins interested in language, cognition, and AI. Formerly: PhD @MIT.

ID: 47353971

linkhttp://jennhu.github.io calendar_today15-06-2009 14:59:16

122 Tweet

2,2K Takipçi

119 Takip Edilen

Jennifer Hu (@_jennhu) 's Twitter Profile Photo

New preprint w/ Michael C. Frank: bit.ly/3VMdl2u How can we ascribe cognitive abilities to language models? We evaluate them! But evals impose challenges separate from the underlying ability of interest. These "task demands" affect LM performance, esp. for smaller models! 1/8

New preprint w/ <a href="/mcxfrank/">Michael C. Frank</a>: bit.ly/3VMdl2u 

How can we ascribe cognitive abilities to language models? We evaluate them! But evals impose challenges separate from the underlying ability of interest. These "task demands" affect LM performance, esp. for smaller models! 1/8