Attention has dominated DL but intuition remains limited for why it works so well. In our #NeurIPS paper just out(!), Cengiz Pehlevan and I show Attention can be closely related to the bio plausible Sparse Distributed Memory (SDM). Paper: openreview.net/pdf?id=WVYzd7G… Thread: 1/12 🧵👇

Congratulations! Very cool approach

Has anybody seen any data on booster dose effectiveness (especially against Delta) after more than 2 weeks? I can't find any studies with longer follow-ups even though eg Israel has been boosting since July

1/ We're thrilled to announce the FTX Foundation's Future Fund. We make grants and investments to ambitious projects to improve humanity's long-term prospects. We plan to deploy >$100M this year, and potentially a lot more (in principle up to $1B). ftxfuturefund.org/announcing-the…

Estimates are fuzzy, but syphilis kills perhaps 100,000 babies a year. There is no vaccine, and astonishingly little research into syphilis globally. If only there were more Caroline Camerons!

Cured my RSI completely after a first and only read - I am as confused as the next person🤷‍♂️

After a deep review of our potential paths to impact and $$$, we've decided to discontinue Alvea's core operations & return remaining funds (~1y of runway) to investors. It's been a wild ride these past 1.5 yrs—huge thank you to all who've supported us ♥️ Reflections coming soon!

Back to twitter to read on OpenAI news and wow! Seems so bad to base any takes on press leaks esp from anon sources in the middle of this. Many ppl “familiar with discussions” talking to press trying hard to swing public and internal opinion, likely super misleading/biased info.

🧵Announcing GPQA, a graduate-level “Google-proof” Q&A benchmark designed for scalable oversight! w/ Julian Michael, Sam Bowman GPQA is a dataset of *really hard* questions that PhDs with full access to Google can’t answer. Paper: arxiv.org/abs/2311.12022

The FDA says it takes 4 months to put together a "new drug application." In today's Statecraft, we looked at a startup that was able to do it in 48 hours. statecraft.pub/p/how-to-speed…

Far-UVC light is a promising potential tool for pandemic control. CR's biosecurity road-mappers convened a workshop with top experts on UV emitters to figure out how to make this tool affordable and scalable. Read the report here: convergentresearch.org/blog/far-uvc-r…

I'm learning frontend dev right now and need to copy html I'm seeing to claude all the time. This sounds super easy. Save page as html and copy paste, right? NO! We cannot have nice things. 1/

Wildly underrated and counterintuitive insight for biotech startup founders about the value of fast human data