@i_beltagy : This was a fun discussion. One thing we debated is compute cost, and how it will change in the future. My guess is that training cost will continue to increase, not to train larger models, but to train longer on more data and more modalities. On the other hand, inference cost • TwiCopy

Iz Beltagy

@i_beltagy

+ Follow

Cofounder @SpiffyAI, Research Lead building OLMo at @allenai_org, formerly @UTCompSci PhD.

ID: 417436602

calendar_today20-11-2011 23:02:37

140 Tweet

1,1K Followers

425 Following

Iz Beltagy

@i_beltagy

a year ago

This was a fun discussion. One thing we debated is compute cost, and how it will change in the future. My guess is that training cost will continue to increase, not to train larger models, but to train longer on more data and more modalities. On the other hand, inference cost

thumb_up_off_alt8

chat_bubble_outline0

repeat1

shareShare