Jason Weston (@jaseweston) 's Twitter Profile
Jason Weston

@jaseweston

Research @MetaAI+NYU. Pretrain+SFT: NLP from Scratch (2011). Multilayer attention+position encode+LLM: MemNet (2015). Recent (2024): Self-Rewarding LLMs & more!

ID: 14551614

linkhttp://www.jaseweston.com calendar_today26-04-2008 21:14:17

299 Tweet

10,10K Followers

583 Following

Jason Weston (@jaseweston) 's Twitter Profile Photo

🚨New Paper 🚨 Self-Alignment with Instruction Backtranslation - New method auto-labels web text with instructions & curates high quality ones for FTing - Our model Humpback 🐋 outperforms LIMA, Claude, Guanaco, davinci-003 & Falcon-Inst arxiv.org/abs/2308.06259 (1/4)🧵

🚨New Paper 🚨
Self-Alignment with Instruction Backtranslation

- New method auto-labels web text with instructions & curates high quality ones for FTing

- Our model Humpback 🐋 outperforms LIMA, Claude, Guanaco, davinci-003 & Falcon-Inst

arxiv.org/abs/2308.06259
(1/4)🧵