SemiAnalysis (@semianalysis_) 's Twitter Profile
SemiAnalysis

@semianalysis_

ID: 1745106082790318080

linkhttp://www.semianalysis.com calendar_today10-01-2024 15:31:48

135 Tweet

16,16K Takipçi

2 Takip Edilen

SemiAnalysis (@semianalysis_) 's Twitter Profile Photo
SemiAnalysis
@semianalysis_

3 months ago

On a Performance per dollar basis, MI300X beats H100 for LLama3 405B reasoning workloads. This is due the MI300X's higher theoretical memory bandwidth allowing for higher decoding speed. In terms of memory capacity, due to H100's limited 80GB HBM capacity, after fitting the

On a Performance per dollar basis, MI300X beats H100 for LLama3 405B reasoning workloads. This is due the MI300X's higher theoretical memory bandwidth allowing for higher decoding speed. In terms of memory capacity, due to H100's limited 80GB HBM capacity, after fitting the