I definitely do understand it because it was a rip off of the best sequence in any blizzard trailer

my turn now

no model can resist frostmourne (i had the wrong lr set for the experiment)

*rizzing* yeah i talk to models all day

doesn't have to be about the past. the further we are from an external, properly received feedback, the more delusional our response will be

this could easily be our new davinci davinci talking about long-term memory tbh

I've finally solved steepest descent on Finsler-structured (matrix) manifolds more generally. This generalizes work by me, Jeremy Bernstein, and jianlin.su on Muon, Orthogonal Muon, & Stiefel Muon. --- The general solution turned out to be much simpler than I thought. And it should

i think more hyperparameters are, in general, a good thing: each hyperparameter is (obviously) parametrizing a class of instances of your systems, possibly along tradeoffs you can exploit. The problem is when the hp exploration becomes too costly to even attempt, and standard

the models lack introverted intuition

insane how long the world is taking to rediscover entropix

Mansplain (sonnet 3.7) Manifest (llama 405B) Manipulate (gpt-4o)

HOLUP IS THIS THE INFAMOUS SLIME BALL U CALL """EARTH"""?!

looks like another W for attention scalers Ethan

Blogpost to read today: strong argument that the oversquashing of attention in the first tokens is not something learned from data distribution (like model should naturally "care" about the start of the text to grasp the rest) but a fundamental feature of attention graph.

Thrilled to announce TopoBench has been accepted to DMLR! 🚀 It’s a modular library for Topological Deep Learning, built to provide reproducible, cross-domain benchmarks and accelerate research. GitHub: github.com/geometric-inte… #AI #DeepLearning

tensorqt that is cool!! i like your perspective on this (it differs from my own slightly) and will likely use it in my future talks :) "In the strictly lower-triangular case (no self-loops) this is a nilpotent operator, so sufficiently high powers collapse entirely into the earliest