@yifan_zhang_ : 🚀Another thing that needs to be quoted is the upcoming Multi-Token Prediction (MTP) by Meta (arxiv.org/abs/24504.19737) and speculative decoding, which are rapidly becoming de facto components of modern LLMs. SPECTULATIVE DECODING IS COMPUTE-BOUND This trend suggests that • TwiCopy

Yifan Zhang

@yifan_zhang_

+ Follow

Language & Thought

ID: 1585517096120655872

calendar_today27-10-2022 06:22:03

47 Tweet

284 Followers

265 Following

Yifan Zhang

@yifan_zhang_

a day ago

🚀Another thing that needs to be quoted is the upcoming Multi-Token Prediction (MTP) by Meta (arxiv.org/abs/2404.19737) and speculative decoding, which are rapidly becoming de facto components of modern LLMs. SPECTULATIVE DECODING IS COMPUTE-BOUND This trend suggests that

thumb_up_off_alt110

chat_bubble_outline0

repeat13

shareShare