alphaXiv
@askalphaxiv
Adding comment sections to arXiv papers
ID: 1722422481942884352
http://alphaxiv.org 09-11-2023 01:15:23
123 Tweet
4,4K Followers
27 Following
New from AI at Meta: Efficient Early-Fusion Pre-training with Mixture of Modality-Aware Experts With a 1T token training budget, MoMa 1.4B achieves FLOPs savings of 3.7x π Authors Victoria X Lin, Akshat Shrivastava, and Liang Luo will be on alphaXiv this week to answer your questions.