Llama 3 is out in 8B and 70B sizes! (400B still training) Congrats to the AI at Meta team! ai.meta.com/blog/meta-llam…

Too many startups focused on what GPT-4 isn't, not enough startups focused on what future models could be

Someone on the admissions committee for a top CS PhD program told me they no longer filter based on paper count because too many of the applicants already have multiple publications. Instead, they now filter by citation count. Not sure if he was joking but I believed it.

Eval numbers for the new GPT-4 Turbo are out

🔥Exciting news -- GPT-4-Turbo has just reclaimed the No. 1 spot on the Arena leaderboard again! Woah!

We collect over 8K user votes from diverse domains and observe its strong coding & reasoning capability over others. Hats off to OpenAI for this incredible launch!

To offer

The new GPT-4-Turbo improves an impressive 4.5 points on LiveCodeBench (comprising competition-style programming problems).

These problems are quite challenging for current LLMs and this improvement highlights a considerable improvement in reasoning!!

x.com/polynoamial/st…

I tried to get a friend to read the scaling laws paper but they said it was too long so I sent them this gif instead

Eliezer Yudkowsky ⏹️ while computers may excel at soft skills like creativity and emotional understanding, they will never match human ability at dispassionate, mechanical reasoning

Best people are motivated to learn and ship independently, just need to pay attention to who has that drive and give them the tools/resources to keep running

This is similar to how I found Eric Steinberger. He was just an undergrad, but he did research on his own and put a solo paper on arxiv that followed up on my work. I was impressed, so I invited him to work with me. There's a lot of talent out there with non-traditional backgrounds.

If you haven't disabled voice authentication for your bank account and had a conversation with your family about AI voice impersonation yet, now would be a good time.

SOTA AI for games like poker & Hanabi rely on search methods that don’t scale to games w/ large amounts of hidden information.

In our ICLR paper, we introduce simple search methods that scale to large games & get SOTA for Hanabi w/ 100x less compute. 1/N

arxiv.org/abs/2304.13138

We just hosted our 2nd annual Sequoia Capital AI Ascent, a gathering of the 100 top founders and researchers in AI.

Big thank you to our amazing speakers including Sam Altman Bill Peebles Noam Brown of OpenAI, Arthur Mensch of Mistral AI, Daniela Amodei of Anthropic, Dylan Field of Figma,

I wish every AI startup founder would read The Bitter Lesson incompleteideas.net/IncIdeas/Bitte…

I’m 36.

For all Diplomacy players in the Bay Area: there's a 3-game tournament in SF this weekend! Everyone is welcome, including new players (just need to know the rules). Folks are welcome to play any number of games! I'll be there for the 2 morning rounds. diplobn.com/events/whippin…

'Fundamentally, these models are just getting better, and that will keep happening.'

This podcast episode from last year was one of the best interviews I’ve ever had. Kanjun 🐙🏡 and Josh Albrecht are exceptional interviewers. I remember being impressed by how they managed to consistently ask such good follow-up questions.