openAI or "open"AI? 1/ OpenAI's #chatgpt release will mark the beginning of the end of the golden age of open research in deep learning. This will have significant implications for LLM research going forward. Here are some thoughts from me, Vivek Raghunathan and Rajhans Samdani 🧵

Want to understand what's happening with chatbots, art generators, and the rise of artificial intelligence? Read my new feature on The End of the Turing Test: nytimes.com/2023/01/20/tec…

there is a huge gain to be made by every company on the planet by just running every file in their codebase through gpt4 with the prompt "what's wrong with this?"

also if you do this with social science analyses files you can unpublish like 50% of all papers

Meditations on Moloch by Scott Alexander is the most eloquent explanation I've read on how game theory can explain many real-world challenges and tragedies that humanity faces. It's a long read, but very accessible and completely worth it. slatestarcodex.com/2014/07/30/med…

I'm at #ICML2023 this week, hit me up if you're around and want to chat (or surf)!

Python is removing the GIL. The GIL (Global Interpreter Lock) prevents you from running multi-threaded code. That makes ML code, in particular, really hard to write in pure Python. Here's what it takes to remove the GIL:

Congrats Sam Gross, what a monumental achievement. I'm inspired by your courage to believe you could do something so big and persisting through years of challenge and uncertainty. I can't wait for noGIL to arrive!

What do dynamic protein complexes look like *inside the cell*? Excited to share our work, led by superstar Ramya Rangan, on cryoDRGN-ET, a new approach in the ❄️🐉 software for reconstructing and visualizing structures from in situ cryo-ET data. 1/ biorxiv.org/content/10.110…

Introducing “Diffusion with Forward Models”, 𝗮 𝗺𝗼𝗱𝗲𝗹 𝘁𝗵𝗮𝘁 𝗰𝗮𝗻 𝗴𝗲𝗻𝗲𝗿𝗮𝘁𝗲 𝗱𝗶𝘃𝗲𝗿𝘀𝗲, 𝗿𝗲𝗮𝗹 𝟯𝗗 𝘀𝗰𝗲𝗻𝗲𝘀 𝗳𝗿𝗼𝗺 𝗮 𝘀𝗶𝗻𝗴𝗹𝗲 𝗶𝗺𝗮𝗴𝗲, 𝘁𝗿𝗮𝗶𝗻𝗲𝗱 𝘄𝗶𝘁𝗵 𝗶𝗺𝗮𝗴𝗲𝘀 𝘄/𝗼 𝗮𝗻𝘆 𝟯𝗗 𝗱𝗮𝘁𝗮! …ffusion-with-forward-models.github.io 1/n

Me and alex peysakhovich 🤖 call this "humming": the LLM's gotta hum the tune to know the next line.

Did you know it took over 500 BILLION gallons of water to train GPT-4? That’s nearly *ten percent* of the entire Pacific Ocean! We are going to run out of drinkable water at this rate.

That's fantastic! Great for science and society that the broad academic research enabled by AF will continue :)

i excite that u excite

Our new model GPT-4o is pretty good :) and cool that everyone will now be able to use GPT-4 level models for free. Most of all I'm stoked to work at a company that troll-pre-released it's model as gpt2-chatbot 🤩

OpenAI Our o1-preview and o1-mini models are available immediately. We’re also sharing evals for our (still unfinalized) o1 model to show the world that this isn’t a one-off improvement – it’s a new scaling paradigm and we’re just getting started. 2/9

Which humanitarian programs previously supported by US foreign aid face the most critical funding gaps? Looking to donate where it will have maximum impact.