i love sand. it conducts, it insulates, and we can make it think

Alan Turing was born 113 years ago today. • Cracked the German's Enigma code in WWII • Proposed the “Turing Test” to judge machine intelligence • Designed a chess algorithm by hand in 1950 • Ran a 2h46 marathon, placing 5th in the 1948 Olympic trials

This is the syllabus of the course Geoffrey Hinton and I taught in 1998 at the Gatsby Unit (just after it was founded). Notice anything?

Elon can work at 9 startups, Jamie Dimon can be on board of multiple companies but when you do it, it’s ‘Scam’.

Andrej Karpathy llama2.c running on original iPhone (240k)

You're not depressed, you just need a quest.

*Into the land of automatic differentiation* Material is out! A short PhD course for the CS PhD in Sapienza Università di Roma covering basic and advanced topics in autodiff w/ slides, (rough) Notion notes, and two notebooks including a PyTorch-like implementation. 😅 sscardapane.it/teaching/phd-a…

The single most undervalued fact of mathematics: mathematical expressions are graphs, and graphs are matrices. Yes, I know. You already heard this from me, but hear me out. Viewing neural networks as graphs is the idea that led to their success.

Scientists just cut HIV out of immune cells using CRISPR. And the cells stayed HIV-free even after re-exposure.

If you have $1M, move to China, it feels like you have $10M. The USD is powerful, but even more so when spent abroad.

Who invented convolutional neural networks (CNNs)? 1969: Fukushima had CNN-relevant ReLUs [2]. 1979: Fukushima had the basic CNN architecture with convolution layers and downsampling layers [1]. Compute was 100 x more costly than in 1989, and a billion x more costly than

Huge thanks to all the open source projects that've made a lot of the tech we rely on in the world possible: Linux Git FFmpeg PyTorch & TensorFlow Apache & Nginx MySQL, PostgreSQL, SQLite Chromium & Firefox GCC & LLVM Docker & Kubernetes Also, all the open-weight LLMs... and

Huge computer science result: A Tsinghua professor JUST discovered the fastest shortest path algorithm for graphs in 40yrs. This improves on Turing award winner Tarjan’s O(m + nlogn) with Dijkstra’s, something every Computer Science student learns in college.

“Most people overestimate what they can do in one year and underestimate what they can do in ten years”

Here's my conversation with Keyu Jin all about China. She is an economist specializing in China's economy, international macroeconomics, global trade imbalances, and financial policy. She is the author of The New China Playbook: Beyond Socialism and Capitalism. It's here on X in

Starlink announced a $5/month plan that gives unlimited usage at 500kbits/s. Modern apps and web pages would immediately back up every buffer and make for a painful experience, but it is fun to consider optimizing inside that tight box (in the 90s, 4x ISDN was high end!).

Wait you guys drive?

10 years ago, deep learning was in its infancy. PyTorch didn't exist. Language models were recurrent, and not large. But it felt important: a new technology that would change everything. That's why Fei-Fei Li , Andrej Karpathy, and I started CS231N Staff back in 2015 - to teach the world's

Like all of you, I am utterly stunned and heartbroken and sick to my soul today. It is unimaginable to write these words. I met Charlie Kirk when he was 18 years old, a young man so eager and determined that I immediately turned to a friend and said, “That kid is going to be the