Rulin Shao
@rulinshao
PhD @UWNLP | MS @SCSatCMU | ex-Applied Scientist @AWS
ID: 1512510916083994630
https://rulinshao.github.io/ 08-04-2022 19:21:35
122 Tweet
1,1K Followers
497 Following
🔥We release the first open-source 1.4T-token RAG datastore and present a scaling study for RAG on perplexity and downstream tasks! We show LM+RAG scales better than LM alone, with better performance for the same training compute (pretraining+indexing) retrievalscaling.github.io 🧵