Arun Rao (@sudoraohacker) 's Twitter Profile
Arun Rao

@sudoraohacker

Builder of large-scale ML systems; adjunct prof @ucla; ex quant derivatives trader & startup founder. Tweets on AI, tech, science, & econ.

ID: 598951979

linkhttps://raohacker.com/ calendar_today04-06-2012 05:13:53

13,13K Tweet

3,3K Followers

3,3K Following

Sergey Levine (@svlevine) 's Twitter Profile Photo

I always found it puzzling how language models learn so much from next-token prediction, while video models learn so little from next frame prediction. Maybe it's because LLMs are actually brain scanners in disguise. Idle musings in my new blog post: sergeylevine.substack.com/p/language-mod…

Bryan Johnson (@bryan_johnson) 's Twitter Profile Photo

Advice I'd give to myself as a first-time father: + teach them to question everything + see my beliefs as trappings of my time + avoid the enslavement of societal norms + agency is the prize + existence is the highest virtue

Samuel Hughes (@scp_hughes) 's Twitter Profile Photo

Japan’s solution was land readjustment, a policy invented in C19 Germany. Landowners contribute a share of their land for infrastructure, which increases the value of the remaining land by opening it up for development. The remaining land is then redistributed among the

Japan’s solution was land readjustment, a policy invented in C19 Germany. Landowners contribute a share of their land for infrastructure, which increases the value of the remaining land by opening it up for development. 

The remaining land is then redistributed among the
Arun Rao (@sudoraohacker) 's Twitter Profile Photo

💯- not sure why New Yorkers are going deep into socialism and near communism with Mamdani, but I suspect it’s a mix of innumeracy and a lack of history (not knowing how the deep socialist states of the 20th century impoverished everyone - except the govt elites, who cheated the

Arun Rao (@sudoraohacker) 's Twitter Profile Photo

💯- Humans are terrible drivers on average, and probably at the 90th and 99th percentiles, versus AI. I’m always fearful and paranoid around human drivers due to their distraction and limited sensory input. The only driver I trust is Waymo, which is better than me or any human

Ethan Niser (@ethanniser) 's Twitter Profile Photo

My Notes: - “Software 3.0” Software 1.0 is code, 2.0 was weights of tightly scoped ML models, 3.0 is using English to program LLMs Just like how in certain use cases software 2.0 would “eat away” at software 1.0 code, software 3.0 will now eat away at a lot of places where we

Arun Rao (@sudoraohacker) 's Twitter Profile Photo

What should kids learn in a world of AI, where traditional pedagogy and even curricula are becoming obsolete? I have some thoughts: it seems much will have to change, but perhaps a few things will stay constant (creatively using STEM to build, building & leading teams, coming up

Paul Novosad (@paulnovosad) 's Twitter Profile Photo

Interesting paper. If parental human capital raises productivity in the production of children's human capital, you may not get regression to the mean across generations. Societies may develop a "human capital elite" with mobility within but not across class boundaries. 1/?

Interesting paper.

If parental human capital raises productivity in the production of children's human capital, you may not get regression to the mean across generations.

Societies may develop a "human capital elite" with mobility within but not across class boundaries.

1/?
Moses Kagan (@moseskagan) 's Twitter Profile Photo

More & more convinced that American kids need to take a "Basics of Western Civilization" course, where they learn: - What life was like before the Enlightenment / Industrial Revolution kicked off the massive improvement in living standards we are all still experiencing - What's

Fermat's Library (@fermatslibrary) 's Twitter Profile Photo

200 years ago, in 1825, Michael Faraday extracted a clear, sweet-smelling liquid from the oily residues of London’s gas lamps. He named it benzene and nothing in chemistry would ever be the same. What set benzene apart, even from the moment of its discovery, was its resistance

200 years ago, in 1825, Michael Faraday extracted a clear, sweet-smelling liquid from the oily residues of London’s gas lamps. He named it benzene and nothing in chemistry would ever be the same.

What set benzene apart, even from the moment of its discovery, was its resistance
Roy (@im_roy_lee) 's Twitter Profile Photo

i am surrounded by more people than ever, but have never felt this alone in my life. feels like no one in the entire world is taking the bets that i am, as publicly as i am. if i lose, i am forgotten or despised. if i win, i change the game forever. only way out is through.

John Arnold (@johnarnoldfndtn) 's Twitter Profile Photo

The most vocal critics of the debt and deficit tend to be people who run successful trading businesses: Dalio, Griffin, Druckenmiller, Singer, Solomon, Gross, Dimon, Gundlach, etc. Here's my theory why... Every successful trading business is grounded in risk management.

Arun Rao (@sudoraohacker) 's Twitter Profile Photo

Sadly, as a California resident, I’d have to say this list is accurate. Californian cities are broken and it’s hurting the Democratic Party and progressives. I see governance at the municipal and county level here that’s on par with or worse than some developing countries I’ve

Arun Rao (@sudoraohacker) 's Twitter Profile Photo

Decent list - probably directionally right and spot on for Apple (whose recovery window is closing) and is in a steep decline (the product decline will eventually follow with revenue and stock declines). Lots of variability in the top 10-20 companies for where they end up, but

Arun Rao (@sudoraohacker) 's Twitter Profile Photo

Congress is moving to pass a reckless reconciliation bill, continuing a 25 year trend of unwise policies under both parties (GOP and Democrats), taxing Americans near historic levels and also spending more than it takes in with historic deficits. The US comes closer to becoming

Congress is moving to pass a reckless reconciliation bill, continuing a 25 year trend of unwise policies under both parties (GOP and Democrats), taxing Americans near historic levels and also spending more than it takes in with historic deficits.  The US comes closer to becoming
David (@davidsholz) 's Twitter Profile Photo

ai people keep asking where the aliens are. shame they dont know that dark matter is actually alien femtomachine computronium; invisible supercomputing fabric made of subatomic particles that don't even interact w light. 85% of the galaxy's mass is already thinking without us!

Arun Rao (@sudoraohacker) 's Twitter Profile Photo

This is the dominant view and attitude of tech regarding the next few decades. It has its pros and cons (and I’m biased to it). Current liberal institutions and even culture of the last 200 years isn’t ready for the onslaught, the incredible change coming from AI and the 6-8