Magnus Revang (@magnusrevang) 's Twitter Profile
Magnus Revang

@magnusrevang

Bluesky: @magnusrevang.bsky.social

ID: 1732787725525274624

calendar_today07-12-2023 15:42:51

66 Tweet

41 Takipçi

167 Takip Edilen

Magnus Revang (@magnusrevang) 's Twitter Profile Photo

If we are to avoid another AI winter, inference workloads need to grow 100x-1000x that of training workloads. And that makes the focus on nVidia as the only option strange.

Magnus Revang (@magnusrevang) 's Twitter Profile Photo

Hear hear, I keep repeating this, Yann keeps repeating this, a lot of AI researchers keep repeating this - yet people keep listening to salespeople with an economic interest in you believing the opposite

Magnus Revang (@magnusrevang) 's Twitter Profile Photo

Last generation open-source models was trained on 2-5T tokens, this generation is trained on 10-30T tokens. It will be really interesting to see the downstream effects of this 240T token dataset being available on the next generation of open-source models.