Christos Perivolaropoulos (@cperivol_) 's Twitter Profile
Christos Perivolaropoulos

@cperivol_

Contact @ccperivol instead

ID: 1757067879667707904

calendar_today12-02-2024 15:43:47

1 Tweet

15 Takipçi

9 Takip Edilen

Petar Veličković (@petarv_93) 's Twitter Profile Photo
Petar Veličković
@petarv_93

a year ago

"Energy continuously flows from being concentrated, to becoming dispersed, spread out, wasted and useless." ⚡➡️🌬️ Sharing our work on the inability of softmax in Transformers to _robustly_ learn sharp functions out-of-distribution. Together w/ Christos Perivolaropoulos Federico Barbero & Razvan!

"Energy continuously flows from being concentrated, to becoming dispersed, spread out, wasted and useless." ⚡➡️🌬️ Sharing our work on the inability of softmax in Transformers to _robustly_ learn sharp functions out-of-distribution. Together w/ <a href="/cperivol_/">Christos Perivolaropoulos</a> <a href="/fedzbar/">Federico Barbero</a> &amp; Razvan!
Federico Barbero (@fedzbar) 's Twitter Profile Photo
Federico Barbero
@fedzbar

a month ago

I’m in Montreal 🇨🇦🍁 for COLM this week! Today (Tuesday) 11am-1pm Alvaro Arroyo and I will be presenting our work on attention sinks at the poster session. DMs are open :)

I’m in Montreal 🇨🇦🍁 for COLM this week! Today (Tuesday) 11am-1pm <a href="/arroyo_alvr/">Alvaro Arroyo</a> and I will be presenting our work on attention sinks at the poster session. DMs are open :)