Alex Nichol (@unixpickle) 's Twitter Profile
Alex Nichol

@unixpickle

Code, AI, and 3D printing. Opinions are mostly my own, sometimes my computer's. Husband of @thesamnichol. Co-creator of DALL-E 2. Researcher @openai.

ID: 376494033

linkhttps://aqnichol.com calendar_today20-09-2011 00:13:54

6,6K Tweet

9,9K Takipçi

403 Takip Edilen

Alex Nichol (@unixpickle) 's Twitter Profile Photo
Alex Nichol
@unixpickle

2 days ago

A Markov model and a transformer can both achieve the same loss on the training set. But only the transformer is smart enough to be useful for other tasks. This invalidates the claim that "all transformers are doing is memorizing their training data".