Tan Minh Nguyen (@tannguyen689) 's Twitter Profile
Tan Minh Nguyen

@tannguyen689

Assistant Professor of Mathematics (Presidential Young Professor) at the National University of Singapore (@NUSingapore). #DeepLearning, #RobustAI, #ScalableAI

ID: 705500312778309632

linkhttps://tanmnguyen89.github.io/ calendar_today03-03-2016 21:09:16

253 Tweet

1,1K Takipçi

733 Takip Edilen

Tan Minh Nguyen (@tannguyen689) 's Twitter Profile Photo

In our recent paper accepted at NeurIPS 2024, my student, Rachel Si Yan Teo (rachtsy), uncovered a link between self-attention in transformers and kernel PCA. Specifically, Rachel demonstrates that self-attention projects its query vectors onto the principal component axes of

In our recent paper accepted at NeurIPS 2024, my student, Rachel Si Yan Teo (<a href="/rachtsy_/">rachtsy</a>), uncovered a link between self-attention in transformers and kernel PCA.

Specifically, Rachel demonstrates that self-attention projects its query vectors onto the principal component axes of