Prateek Jain
@jainprateek_
Learning machine learning at Google DeepMind.
ID: 969143088127008769
http://prateekjain.org 01-03-2018 09:31:32
474 Tweet
4,4K Followers
644 Following
Inspired by excellent works such as Matformer and OFA, we adapted the concept for LLMs and showed its efficacy for attention and MLP. 🙌 Big thanks to all contributors: Ruisi Cai, Saurav Muralidharan, GREG, Hongxu (Danny) Yin, VITA Group, Jan Kautz #ICML2024 #LLM #MachineLearning #AI
Excellent crop of ICML best papers. Congratulations! 🎉🎉🎉 All are great, but a couple stand out to me personally: Florian Tramèr & my Google DeepMind colleague Nicholas Carlini have TWO best papers. One with Gautam Kamath and one with me (and others). 1/
After 5 beautiful years PhDing Allen School, I joined Google DeepMind as a Research Scientist & relocated to the SF Bay Area (let us grab a coffee!) 🌉 I'm excited to build (& collaborate on) next gen ML fundamentals & models -- adaptive compute, world models, new capabilities ...!✨
We're humbled by the early positive reception and shares for our MoNE paper! 🙏 A huge shoutout to my amazing collaborators and mentors for their incredible contributions - Sujoy Paul Nidhi Hegde Aditya Kusupati Prateek Jain Arsha Nagrani Shyamal Buch, Anurag Arnab ✨
I personally love listening to podcasts, and I'm excited that we're launching season 3 of the Google DeepMind podcast, covering some of the most important topics in AI.
Headed back with incredible memories from Vietnam and Singapore! A crazy fun and productive week at the GenAI Summit and FUV in Vietnam ➡️ NUS + Google office in SIN! Hanging out with Prateek Jain Jeff Dean (@🏡) Thang Luong Quoc Le Yi Tay and co! Fun + work pics below!
*Mixture of Nested Experts: Adaptive Processing of Visual Tokens* by Gagan Jain Sujoy Paul Aditya Kusupati Prateek Jain Arsha Nagrani MoE variant where experts are slices of a single MLP, allowing for dynamic compute for tokens given a budget. arxiv.org/abs/2407.19985
Past 7 yrs in Bangalore have been very rewarding - lots of growing up, building a new research program and helping build a new lab from the ground-up with the best people! Prateek Jain Manish Gupta Partha Talukdar Milind Tambe Shachi Dave and many more !
Prateek Jain Manish Gupta Partha Talukdar Milind Tambe Shachi Dave also very grateful to my academic friends in India, South and Southeast Asia, I'll continue to be a cheerleader for you all always :D Big thanks to Ashwani Sharma who has opened all of these doors over the years!