Liam Carroll
@lemmykc
Mathemusician that constantly finds himself on mountains, working on Developmental Interpretability
ID: 1626966720
28-07-2013 04:05:57
9 Tweet
44 Followers
57 Following
1/8 How do transformers learn? In our new work, we find that transformers develop in-context learning in discrete stages that can be automatically discovered. 🧵 arxiv.org/abs/2402.02364 Joint work w/ george, Matthew Farrugia-Roberts, Liam Carroll, Susan Wei, Daniel Murfet