Shhhh . . . consultants have been making lots of money telling companies otherwise.

GPT-4 passed the mirror test in 3 interactions, during which its apparent self-recognition rapidly progressed. In the first interaction, GPT-4 correctly supposes that the chatbot pictured is an AI “like” itself. In the second interaction, it advances that understanding and

# explaining llm.c in layman terms Training Large Language Models (LLMs), like ChatGPT, involves a large amount of code and complexity. For example, a typical LLM training project might use the PyTorch deep learning library. PyTorch is quite complex because it implements a very

Houston has bad weather, no natural beauty, and little history. But that’s a feature, not a bug. It means government has to be responsive to the people to create a place people and businesses want to locate. It must be efficient with taxpayer money and consider tradeoffs. It must

The expected value of information with respect to GPT-5 is perhaps higher than for any other product in history. Huge implications.

14 years ago. Before GenAI, before the transformer, before deep learning was really a thing, there was The Learning Layer. And there was also tylercowen trying to push it aside :)

In minds & machines, only connectionist learning systems are capable of providing the base support for real-world decision making/agency, but they necessarily also require a complementary chain of thought-type function (e.g., System 2/explanation engine). learninglayer.wordpress.com/2024/09/01/the…

BREAKING NEWS The Royal Swedish Academy of Sciences has decided to award the 2024 #NobelPrize in Physics to John J. Hopfield and Geoffrey E. Hinton “for foundational discoveries and inventions that enable machine learning with artificial neural networks.”

Sundar Pichai said on the earnings call today that more than 25% of all new code at Google is now generated by AI.

“1. Identify a list of bottlenecks. 2. Drop everything else. Remove argmax(bottlenecks). By definition, nothing is as P0 to fix as the slowest-moving part. 3. Repeat from step 1.” There’s a book about that: datatolearningtoaction.com

It can be hard to “feel the AGI” until you see an AI surpass top humans in a domain you care deeply about. Competitive coders will feel it within a couple years. Paul is early but I think writers will feel it too. Everyone will have their Lee Sedol moment at a different time.

"Move 37" is the word-of-day - it's when an AI, trained via the trial-and-error process of reinforcement learning, discovers actions that are new, surprising, and secretly brilliant even to expert humans. It is a magical, just slightly unnerving, emergent phenomenon only

"Tell a story!" Tell me your target audience is midwits without telling me your target audience is midwits.

Claim: gpt-5-pro can prove new interesting mathematics. Proof: I took a convex optimization paper with a clean open problem in it and asked gpt-5-pro to work on it. It proved a better bound than what is in the paper, and I checked the proof it's correct. Details below.

Everyone ‘knows’ AGI will either make us all unemployed or fabulously wealthy. Except, a rather brilliant (and chilling) paper from a Yale economist suggests it's neither. It says the economy will boom, and our wages... won't. A bit awkward. I've been digging into this 2025

Yet more evidence that a pretty major shift is happening, this time by Scott Aaronson scottaaronson.blog/?p=9183&fbclid…