Dmitry Kobak (@hippopedoid) 's Twitter Profile
Dmitry Kobak

@hippopedoid

Researcher at @uni_tue. Manifold learning, contrastive learning, scRNAseq data. Excess mortality. Born but to die and reas'ning but to err.

ID: 1204182046521864192

linkhttp://dkobak.github.io calendar_today09-12-2019 23:32:48

2,2K Tweet

7,7K Takipçi

238 Takip Edilen

Dmitry Kobak (@hippopedoid) 's Twitter Profile Photo

We held a reading group on Transformers (watched videos / read blog posts / studied papers by Lucas Beyer (bl16) Andrej Karpathy Chris Olah Aman Arora Jay Alammar Sasha Rush et al.), and now I _finally_ roughly understand what attention does. Here is my take on it. A summary thread. 1/n

We held a reading group on Transformers (watched videos / read blog posts / studied papers by <a href="/giffmana/">Lucas Beyer (bl16)</a> <a href="/karpathy/">Andrej Karpathy</a> <a href="/ch402/">Chris Olah</a> <a href="/amaarora/">Aman Arora</a> <a href="/JayAlammar/">Jay Alammar</a> <a href="/srush_nlp/">Sasha Rush</a> et al.), and now I _finally_ roughly understand what attention does.

Here is my take on it. A summary thread. 1/n