Iz Beltagy (@i_beltagy) 's Twitter Profile
Iz Beltagy

@i_beltagy

Cofounder @SpiffyAI, Research Lead building OLMo at @allenai_org, formerly @UTCompSci PhD.

ID: 417436602

calendar_today20-11-2011 23:02:37

140 Tweet

1,1K Takipçi

425 Takip Edilen

Iz Beltagy (@i_beltagy) 's Twitter Profile Photo

This was a fun discussion. One thing we debated is compute cost, and how it will change in the future. My guess is that training cost will continue to increase, not to train larger models, but to train longer on more data and more modalities. On the other hand, inference cost