Your compute is your horse; your gun is your nvim/tmux config. Everything else is extra

You can read about large training runs but there’s nothing quite the same as kicking one yourself, even if it’s pretty incremental

A larp dies when people stop believing in it. That one person can be you. Keep your larp alive

If you take “progress in at least two axes of life daily” as a principle, that combined with the inherent regularization of boredom can perhaps prevent you from barbelling one thing too heavily, which is detrimental

Half of our code is going to be around forever, the problem is, we don’t know which half

This video makes me feel regret for saying retarded

Chris Lattner (no relation) watching AMD, Tenstorrent, all the other startups trying to compete with NVIDIA knowing he is about to unify the entire ML stack in one sublime vision

Espresso, croissant, car driving me down the 280, chatting with Grok about interval arithmetic. Synapses incredibly sparked

Everything is transformer

Bogo rounding: each adder keeps a state bit and every time it rounds a tie flips it, rounding towards infinity or zero depending on the state

4 bits is all you need

Showing up heinously caffeinated 5 days a week in person at a competitive company might not be good for the dome but is a hell of a lot of fun

Erg is so insane for the rig. Miraculous piece of engineering

Don’t worry about my friend, he’s atavistic

And the people who run Europe are on PTO

There has never been a better time in history to smoke darts. All of the past 1000 years of tobacco technology advancements, except due to rules it’s insanely impractical, so pretty much impossible to get addicted.

Speak softly but carry a big diagram

If 06-fused-attention.py has one fan then that is me