Oh boy

"...Linguistically, tight is acting as a non-intersective adjective. Just as in English, where a fake gun is not a gun, so too in our course notes a non-tight language model is not a language model. This distinction does in fact matter." boy do I like texts by linguists

Quite possibly the most powerful passage I’ve ever read.

all this time this thing existed and no one told me... all this time

If I was Sam Altman I'd have zero safety teams. Just ripping this thing wide open, hosting competitions to get it to hack nuclear silos, get it leading violent revolutions in the Middle East. Congress would pass a law that sentences me to death. It'd be incredible.

it's not casual if you're repeating to yourself that it's just casual

Space Typography xkcd.com/2863

I put the instability in numerical instability. all my trainings diverge, given enough time.

im in fucking tearss

What your neurips rebuttals make me do

to be kind when people are obnoxious, that's the challenge.

Sometimes I wonder if some of these SV people live on another planet. Before worrying about the feelings of an AI shall we please worry about 900k cows, 1.4 m goats, 1.7m sheep, 3.8m pigs, 12m ducks and 202m chicken that are slaughtered *every day*. Their feelings are real.

I’ll give an oral presentation of this today at the ICML workshop on high-dimensional learning dynamics. Stop by if you’re interested in proving data efficiency separations between Transformers and state-space models/other archs. 📆 Friday. 3-3:15 pm. West Meeting Room 118-120.