Cody Blakeney (@code_star) 's Twitter Profile
Cody Blakeney

@code_star

Data Guy @datologyai | Formerly Data Research Lead @DbrxMosaicAI | Visiting Researcher @ Facebook | Ph.D | #TXSTFOOTBALL fan | linktr.ee/code_star

ID: 354571530

calendar_today13-08-2011 23:19:18

13,13K Tweet

4,4K Followers

1,1K Following

Cody Blakeney (@code_star) 's Twitter Profile Photo
Cody Blakeney
@code_star

2 years ago

An interesting bit of nuance missing from throughput charts like this is that tokens != generated text. Because DBRX / LLama3 / GPT4s tokenizer has a larger vocabulary (100k+) they actually generate much faster then (20-30%) then tokens alone will measure compared to say Mixtral