andrew gao (@itsandrewgao) 's Twitter Profile
andrew gao

@itsandrewgao

@cognition_labs @stanford; prev @sequoia @LangChainAI @pika_labs @nomic_ai; Z Fellow 🇺🇸; views my own

ID: 1316471712549011456

linkhttps://andrewgao.dev/ calendar_today14-10-2020 20:11:40

9,9K Tweet

37,37K Takipçi

2,2K Takip Edilen

andrew gao (@itsandrewgao) 's Twitter Profile Photo
andrew gao
@itsandrewgao

a year ago

Snowflake Arctic's architecture vs. Grok, Mixtral, and Llama 3 ICYMI, this is a gigantic 480 billion parameter model made of 128 tiny experts, each not even 4B parameters fully #opensource (Apache 2.0), link to detailed thread in comments

Snowflake Arctic's architecture vs. Grok, Mixtral, and Llama 3 ICYMI, this is a gigantic 480 billion parameter model made of 128 tiny experts, each not even 4B parameters fully #opensource (Apache 2.0), link to detailed thread in comments