tensorqt (@tensorqt) 's Twitter Profile
tensorqt

@tensorqt

chaos dancing star

ID: 1496062602253942784

calendar_today22-02-2022 10:01:49

4,4K Tweet

1,1K Takipçi

300 Takip Edilen

tensorqt (@tensorqt) 's Twitter Profile Photo
tensorqt
@tensorqt

10 days ago

attention sinks may be a bias in causal transformers. as some of you know, i've been writing a long blogpost on attention and its properties as a message-passing operation on graphs. while doing so, i figured i might have found an explanation for which attention sinks may be an

attention sinks may be a bias in causal transformers. as some of you know, i've been writing a long blogpost on attention and its properties as a message-passing operation on graphs. while doing so, i figured i might have found an explanation for which attention sinks may be an