Xinyu Yang (@xinyu2ml) 's Twitter Profile
Xinyu Yang

@xinyu2ml

Ph.D. @CarnegieMellon. Working on principled algorithm & system co-design for scalable and generalizable foundation models. he/they. A fan of TileLang!!!

ID: 1601134489161400321

linkhttps://xinyuyang.me/ calendar_today09-12-2022 08:40:04

146 Tweet

530 Takipçi

606 Takip Edilen

Xinyu Yang (@xinyu2ml) 's Twitter Profile Photo

We will be presenting "APE: Faster and Longer Context-Augmented Generation via Adaptive Parallel Encoding", a novel encoding method that enables: 🚀Pre-caching Contexts for Fast Inference 🐍Re-using Positions for Long Context Our poster session is located in Hall 3 and Hall 2B,

We will be presenting "APE: Faster and Longer Context-Augmented Generation via Adaptive Parallel Encoding", a novel encoding method that enables:
🚀Pre-caching Contexts for Fast Inference
🐍Re-using Positions for Long Context

Our poster session is located in Hall 3 and Hall 2B,