NVIDIA AI Developer (@nvidiaaidev) 's Twitter Profile
NVIDIA AI Developer

@nvidiaaidev

All things AI for developers from @NVIDIA.

Additional developer channels: @NVIDIADeveloper, @NVIDIAHPCDev, and @NVIDIAGameDev.

ID: 877952584333410305

linkhttps://developer.nvidia.com/blog calendar_today22-06-2017 18:13:02

5,5K Tweet

73,73K Takipçi

306 Takip Edilen

NVIDIA AI Developer (@nvidiaaidev) 's Twitter Profile Photo
NVIDIA AI Developer
@nvidiaaidev

3 months ago

.LMSYS Org (SGLang) now achieves 7,583 tokens per second per GPU running DeepSeek R1 on the GB200 NVL72, a 2.7x leap over H100. We're excited to see the open source ecosystem advance inference optimizations on GB200 NVL72, driving down cost per token for the industry at

.<a href="/lmsysorg/">LMSYS Org</a> (SGLang) now achieves 7,583 tokens per second per GPU running <a href="/deepseek_ai/">DeepSeek</a> R1 on the GB200 NVL72, a 2.7x leap over H100. We're excited to see the open source ecosystem advance inference optimizations on GB200 NVL72, driving down cost per token for the industry at