Wenting Zhao (@wzhao_nlp) 's Twitter Profile
Wenting Zhao

@wzhao_nlp

PhD student @cornell_tech
NLP + AI

ID: 1473829704

linkhttps://wenting-zhao.github.io/ calendar_today01-06-2013 05:18:16

343 Tweet

1,1K Followers

495 Following

Wenting Zhao (@wzhao_nlp) 's Twitter Profile Photo
Wenting Zhao
@wzhao_nlp

5 months ago

The more I dive into LM training, the more I feel pretraining is just starting. Some questions I’m particularly interested in: * what data unlocks what capabilities? * do we train on capabilities sequentially or in parallel? * how many synthetic examples is a human example worth?