The Transformer is a magnificient neural network architecture because it is a general-purpose differentiable computer. It is simultaneously: 1) expressive (in the forward pass) 2) optimizable (via backpropagation+gradient descent) 3) efficient (high parallelism compute graph)

If you don’t lie awake at night thinking about it, you don’t want it badly enough.

I think the ultimate goal is to be free. Free to be who we are, to pursue our endless and ambitious goals, free from money problems, free from health problems.

Ok here we go. Nvim!

This is fun! I wasn’t sure what was going to come out of the chatgpt memory feature, but if you left it accumulating memories for many months it seems to be able to get a pretty good sense of you from all your queries and over time. I saw other versions of it too, e.g. “tell me

💯 Love this post on “info finance”. Prediction markets are an early special case of info finance - the use of markets to create distillations of more expensive mechanisms (eg predictions of voting outcomes). Multiple generalizations. At scale a possible revenue stream for AIs.

I put Gemini 2.0 inside a desktop app and gave it access to my screen, terminal, clipboard, and the internet:

RECUERDA:

Si tus hábitos no cambian, no tendrás un nuevo año, sólo tendrás otro año.

I still do this most days and I think it works great. My morning brain (right after 1hr exercise and 1 coffee) is quite eager to work and I go directly to the one top priority item. The energy decreases over time and with every distracting item loaded into the context window.

These are the resources I've been using: Mathematics > math for ml book: mml-book.github.io > why machines learn book: amazon.com/Why-Machines-L… > math for ml course: iamtk.co/series/mathema… > Math Academy Machine Learning > Intro to statistical learning:

The slow, then sudden decline of Stack Overflow. Full article (cont'd)

DeepSeek R1 confirma lo que veíamos venir desde Llama 2. AI no será un juego cerrado de un par de mega compañías como lo fue search. AI será investigación abierta multinacional. Hoy, el modelo más avanzado (OpenAI o3) aun es cerrado, pero es cuestión de tiempo. ¿Qué tiene

I created a roadmap to learn artificial Intelligence and machine learning in 2025. I recently transitioned to working in ai/ml as a software engineer. Here are the best free resources and roadmap I used to prepare for interviews and land a job. github.com/armankhondker/…

Some people today are discouraging others from learning programming on the grounds AI will automate it. This advice will be seen as some of the worst career advice ever given. I disagree with the Turing Award and Nobel prize winner who wrote, “It is far more likely that the

Here's my conversation with ThePrimeagen, a programmer who has educated, entertained, and inspired millions of people to build software and have fun doing it. It's here on X in full, and is up everywhere else too (see comment). Timestamps: 0:00 - Introduction 0:42 - Love for

Today, plan your week out: . what time you'll go to bed . when you'll turn off screens . the days you'll exercise Then achieve 100% of your goals and be proud of yourself.

Andrej Karpathy's (Andrej Karpathy) keynote yesterday at AI Startup School in San Francisco.

Some reflections: calv.info/openai-reflect…

Don't drop out of college to start or work for a startup. There will be other (and probably better) startup opportunities, but you can't get your college years back.