Zijian Wang @ ICML 🇦🇹 (@zijianwang30) 's Twitter Profile
Zijian Wang @ ICML 🇦🇹

@zijianwang30

Science Manager at AWS AI Labs @amazonscience. LLM for code and beyond.
Past: @StanfordNLP @StanfordSymSys @UMich @DL4Code

ID: 900040276034674689

linkhttps://zijianwang.me/ calendar_today22-08-2017 17:01:38

79 Tweet

377 Followers

312 Following

Zijian Wang @ ICML 🇦🇹 (@zijianwang30) 's Twitter Profile Photo

🚀Introducing "Fewer Truncations Improve Language Modeling" at #ICML2024 We tackle a fundamental issue in LLM pre-training: docs are often broken into pieces. Such truncation hinders model from learning to compose logically coherent and factually grounded content. 👇🧵1/n

🚀Introducing "Fewer Truncations Improve Language Modeling" at #ICML2024 

We tackle a fundamental issue in LLM pre-training: docs are often broken into pieces. Such truncation hinders model from learning to compose logically coherent and factually grounded content. 

👇🧵1/n