🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Working my way through an early copy of the new book by Eliezer Yudkowsky ⏹️ and Nate Soares. And here is a link bookshop.org/p/books/if-any… More thoughts/ context below :

...huh I think this significantly changes how I feel about open book exams

If AIs could learn as efficiently as a bright 10 year old child, then shortly after this point AIs would likely be generally superhuman via learning on more data and compute than a human can. So, I don't expect human level learning and sample efficiency until very powerful AI.

frye My understanding, somewhat but not completely based on neuro/psych research: - They're Christ: this is en.wikipedia.org/wiki/Delusions… . Probably some kind of mania that's along for the ride with schizophrenia. Seems like there is a mania-depressive axis that goes from "I'm great" to "I

j⧉nus This is false at multiple levels: - I did all of the initial work for the paper and I don't work at Anthropic. So the narrative you suggest here (where Anthropic was looking for a test the model would fail) is very false. - I was specifically interested in studying

From former high-ranking White House and DoD officials to former CEOs of OpenAI and Reddit to a Nobel laureate who was the chairman of the Federal Reserve during the 2008 financial crisis. These reviews of _If Anyone Builds It _ give hope!

You can see: this book works. If everyone reads it, maybe humanity decides to do something which is not omnicide. Now, pre-orders are the top priority. 20k of them = likely a NYT bestseller, the talk of the town, the publisher prints more -> incentivizes everyone to advertise it.

Sam Altman in 2023: "the worst case scenario is lights out for everyone" Sam Altman in 2025: the worst case scenario is that ASI might not have as much 💫 positive impact 💫 as we'd hoped ☺️

Huge repository of information about OpenAI and Altman just dropped — 'The OpenAI Files'. There's so much crazy shit in there. Here's what Claude highlighted to me: 1. Altman listed himself as Y Combinator chairman in SEC filings for years — a total fabrication (?!): "To

If you thought that almost no-one in public life would dare agree that wiping out humanity ought to be further discussed before implementation, think again. (Link below.)

lesswrong.com/posts/khmpWJnG…

Anyone who can get actual help should go get actual help (and share transcripts for humanity's good). But I have personally already had the experience of telling somebody to for god's sake get some sleep, and ChatGPT talking them out of it. x.com/galitodev/stat…

Some huge book endorsements today — from retired three-star general Jack Shanahan, former DHS Under Secretary Suzanne Spaulding, security expert Bruce Schneier, Nobel laureate Ben Bernanke, former US NSC Senior Director Jon Wolfsthal, geneticist George Church, and more!

"If anyone builds it, everyone dies" is getting good advance press. I preordered a copy. If you're interested, search it up and maybe preorder too because that's how books get on best-of lists and make a real difference.

Ben Bernanke Nobel economist ex-Fed Chair Jack Shanahan retired USAF general DoD AI chief Suzanne Spaulding ex-DHS Jon Wolfsthal nuclear advisor Stephen Fry George Church Mark Ruffalo Bruce Schneier Max Tegmark Scott Aaronson Grimes Emmett Shear ex-OpenAI Yishan Wong ex-Reddit

My favorite reaction I’ve gotten when sharing some of the blurbs we’ve recently received for Eliezer and Nate’s forthcoming book: If Anyone Builds It, Everyone Dies From someone who works on AI policy in DC:

Lots of people in AI, and especially AI policy, seem to think that aligning superintelligence is the most important issue of our time, and that failure could easily lead to extinction -- like what happened in AI 2027. But they don’t mention this fact in public because it sounds

Trying to help

A little surprised to see Bruce Schneier blurbing 'If Anyone Builds, It Everyone Dies'. When I last spoke with him in 2019 he didn't take extinction from AI seriously, but I guess a lot has happened! Also — Ben Bernanke?!

Senior White House officials, a retired three-star general, a Nobel laureate, and others come out to say that you should probably read Eliezer Yudkowsky and Nate Soares' "If Anyone Builds It, Everyone Dies". Preorders are live.