@stasbekman : semianalysis.com/p/the-memory-w… This is an important study as if you're not aware the new accelerators' efficiency keeps on going down because the compute speed up is happening faster than HBM speed up. So for example H1500 is less efficient than H200, even though the compute is the • TwiCopy

Stas Bekman

@stasbekman

+ Follow

Toolmaker. Software creator, optimizer and harmonizer.

Makes things work and fly at @ContextualAI

Training LLM/RAG/Generative AI/Machine Learning/Scalability

ID: 1068360975898660864

linkhttps://stasosphere.com/machine-learning/ calendar_today30-11-2018 04:28:00

1,1K Tweet

7,7K Followers

273 Following

Stas Bekman

@stasbekman

2 months ago

semianalysis.com/p/the-memory-w… This is an important study as if you're not aware the new accelerators' efficiency keeps on going down because the compute speed up is happening faster than HBM speed up. So for example H100 is less efficient than H200, even though the compute is the

thumb_up_off_alt161

chat_bubble_outline4

repeat33

shareShare