@tongpetersb : This project really changed how I think about multimodal models and LLMs. I used to believe that multimodal (visual) prediction required significant changes to the model and heavy pretraining, like Chameleon. But surprisingly, the opposite is true! In large autoregressive models, • TwiCopy

Peter Tong

@tongpetersb

+ Follow

Berkeley 23', CS PhD Student in NYU Courant advised by Professor @ylecun and Professor @sainingxie

ID: 1551975677552902152

linkhttps://tsb0601.github.io/petertongsb/ calendar_today26-07-2022 17:00:19

92 Tweet

1,1K Followers

113 Following

Peter Tong

@tongpetersb

6 months ago

This project really changed how I think about multimodal models and LLMs. I used to believe that multimodal (visual) prediction required significant changes to the model and heavy pretraining, like Chameleon. But surprisingly, the opposite is true! In large autoregressive models,

thumb_up_off_alt476

chat_bubble_outline9

repeat97

shareShare