sridhar
@RamaswmySridhar
CEO @snowflakedb; founder @neeva Ex-@GreylockVC Ex-@Google SVP of Ads Ex-@BellLabs.
ID:1046844574486818816
https://www.linkedin.com/in/sridhar-ramaswamy/ 01-10-2018 19:29:30
2,7K Tweets
25,0K Followers
618 Following
#SnowflakeArctic from @snowflakedb is a big deal not just because it's an amazing model but because it moves the ecosystem of AI developers forward with real insights from a crack team.
And of course, no day of mine is complete without a cartoon from chatGPT. We want to teach
Thrilled to share the release of #Snowflake Arctic , an enterprise focused foundation model from #Snowflake , that is efficiently intelligent and truly open.
1/4 Have you wondered how to optimize sys-perf for training Arctic-like models (MoE arch)? Let’s dive in! Our first technique: custom fused kernels. By crafting these kernels, we streamline irregular and sparse operators, boosting efficiency. #SnowflakeArctic #SystemOptimization
Snowflake Arctic's architecture vs. Grok, Mixtral, and Llama 3
ICYMI, this is a gigantic 480 billion parameter model made of 128 tiny experts, each not even 4B parameters
fully #opensource (Apache 2.0), link to detailed thread in comments