Anjney Midha @ ICLR ‘24
@AnjneyMidha
general partner @a16z • board @MistralAI @LumaAI • past: ceo/founder @ubiquity6 (acquired by @discord), bioinformatics @StanfordMed
ID:295339039
https://a16z.com/author/anjney-midha/ 08-05-2011 20:38:38
1,5K Tweets
7,1K Followers
1,5K Following
New short course with Mistral AI !
Mistral's open-source Mixtral 8x7B model uses a 'mixture of experts' (MoE) architecture. Unlike a standard transformer, an MoE model has multiple expert feed-forward networks (8 in this case), with a gating network selecting two experts at
15 trillion tokens (~Llama3 scale) open sourced by Guilherme Penedo and team - incredible contribution to the community
There's 3 days left to apply for the Y Combinator Summer 2024 batch.
YC changed my life, and it could change yours:
Congrats Jennifer Li! SO well deserved - we're lucky to be able to work with you everyday
'The infra life chose us, we chose the infra life.'
benahorowitz.eth martin_casado zane Anjney Midha Matt Bornstein Yoko Rajko Radovanović Justine Moore Marco Mascorro Guido Appenzeller Satish Talluri Sarah Wang Joel de la Garza
We be cooking with $1.25B in fresh capital to fund the AI infra of the future 🤖🏗️
Come build with martin_casado Matt Bornstein Jennifer Li Yoko Guido Appenzeller Rajko Radovanović zane Satish Talluri Marco Mascorro benahorowitz.eth Marc Andreessen 🇺🇸 me & the entire a16z team
Happy to see this new podcast live! Check out the first two episodes to hear Naveen Rao Matt Bornstein and I discuss a bunch of topics around enterprise LLMs, and an open source panel discussion led by Anjney Midha .
the best way to predict the future is to invent it, and as martin_casado sometimes does, ship it to arxiv!