Sulin Liu (@su_lin_liu) 's Twitter Profile
Sulin Liu

@su_lin_liu

Postdoc @MIT Ex: Machine Learning PhD @Princeton @Meta @NTUsg @NUSingapore

ID: 264576956

linkhttps://liusulin.github.io/ calendar_today12-03-2011 03:48:27

216 Tweet

592 Takipçi

1,1K Takip Edilen

Sulin Liu (@su_lin_liu) 's Twitter Profile Photo
Sulin Liu
@su_lin_liu

7 months ago

Discrete diffusion (including masked language model) deserves more investment in terms of research and compute, especially when we are running out of pre-training data for autoregressive LLMs. You can get a lot more data for free by just masking data or perturbing them with