*Transformer Memory as a Differentiable Search Index* by Yi Tay vinh q. tran Mostafa Dehghani et al. Intriguing paper that proposes to replace an entire information retrieval system with a single transformer model trained to predict the document id (docid). arxiv.org/abs/2202.06991

Beyond neural scaling laws: beating power law scaling via data pruning Suggests that the discovery of good data-pruning metrics may provide a viable path forward to substantially improved neural scaling laws. arxiv.org/abs/2206.14486

A melodic inversion! In the Gigue of Bach's 5th French Suite (BWV 816), the melody is repeated in the second half of the piece "upside down". youtube.com/watch?v=f_U0lm…

I think I like Brad Mehldau’s slightly more but these were both lovely open.spotify.com/track/7kdPpPFz… open.spotify.com/track/1nRGAGIN…

Finally got to see this illustrated!

I listened for 25,904 minutes in 2024. What about you? #SpotifyWrapped open.spotify.com/wrapped/share/…

(Yet) another tale of Rise and Fall: DeepSeek R1 is claimed to match o1/o1-preview on olympiad level math & coding problems. Can it handle versions of AIW problems that reveal generalization & basic reasoning deficits in SOTA LLMs? (arxiv.org/abs/2406.02061) 🧵1/n

Read my essay about what Altadena meant to us here: sacbee.com/opinion/op-ed/…

I am alarmed by the proposed cuts to U.S. funding for basic research, and the impact this would have for U.S. competitiveness in AI and other areas. Funding research that is openly shared benefits the whole world, but the nation it benefits most is the one where the research is

Introducing Exa 2.1 We scaled our pre-training and test-time compute by an order of magnitude, unlocking frontier search API performance for both fast and agentic search. Deep dive below:

The murder in Minneapolis by the government’s secret police this week has stirred something in me. A mother was gunned down in the street by ICE, and the government doesn’t even have the decency to perform a scripted condolence. No matter which way the tires were pointing, this

We should all support the courageous people of Iran as they fight for independence from a corrupt regime. And we should all support Jerome Powell and the Federal Reserve as they fight for independence from a corrupt regime.

ICEout.tech

Musk threatens any xAI staffer if they speak out against ICE violence. If you work at xAI, don't be a loser. If you get fired the internet will have your back. Do the right thing. Sign the letter: ICEout.Tech via ICEout.Tech

Introducing Exa Instant: the first sub-200ms search engine. Faster than Google, it's custom built to power realtime AI products like chat and voice.