A reminder that I made a template for ML research project pages! It uses modern web dev technologies like Tailwind CSS and Astro, and it's easier to use than forking the Nerfies website. (1/4)

#Tokenization is undeniably a key player in the success story of #LLMs but we poorly understand why. I want to highlight progress we made in understanding the role of tokenization, developing the core incidents and mitigating its problems. 🧵👇

Does equivariance matter when you have lots of data and compute? In a new paper with Sönke Behrends, Pim de Haan, and Taco Cohen, we collect some evidence. arxiv.org/abs/2410.23179 1/7

Current video representation models (e.g. VideoMAE) are inefficient learners. How inefficient? We show that reprs with similar quality can be learned without training on *any* real videos, by using synthetic datasets that were created from very simple generative processes!

The urge to submit experiments before going to sleep so that they can run overnight is just unprecedented

Prediction: within the next year there will be a pretty sharp transition of focus in AI from general user adoption to the ability to accelerate science and engineering. For the past two years it has been about user base and general adoption across the public. This is very

See also: arxiv.org/abs/2202.07477 & cvgmt.sns.it/media/doc/pape…

Any recommendations for resources to self-study reinmenien geometry?

Machine learning is a huge field today, but at its core it's about two principles: 1) Generalization 2) Scaling laws

Some personal updates: 1. I will defend my PhD thesis, "Advancing Artificial Intelligence for Efficient and Synthesizable In-silico Molecular Design," at 10 am on May 9th in MIT 66-110, all are welcome! 2. After a ~1 year postdoc at Stanford, I’ll join the CBE department at UPenn

Thanks MIT CSAIL for featuring our work!🖊️🎨 Huge thanks to the CSAIL news team for the fun article + video!! We'll be presenting SketchAgent at #CVPR2025 next week — come say hi if you're curious how LLMs can be used to collaboratively sketch!🖌️ 👉 bit.ly/43mTme1