Xingyi Yang (@yxy2168) 's Twitter Profile
Xingyi Yang

@yxy2168

PhD student at National University of Singapore. Visiting PhD at @Oxford. ML & AI
Interned at @Tiktok @ Shanghai AI Lab

ID: 1036818922543173632

linkhttp://adamdad.github.io calendar_today04-09-2018 03:31:09

315 Tweet

850 Takipçi

365 Takip Edilen

Xingyi Yang (@yxy2168) 's Twitter Profile Photo

🚀 LLMs are hard to interpret? 🧠✨ Our solution: Mixture of Experts (MoE)! Built for interpretability, they create sparse, powerful models 👉 No more post-training hacks (Bye-bye sparse auto-encoders) 🔗 Read the paper: arxiv.org/abs/2503.07639 huggingface.co/papers/2503.07…

🚀 LLMs are hard to interpret? 

🧠✨ Our solution: 
Mixture of Experts (MoE)! Built for interpretability, they create sparse, powerful models

👉 No more post-training hacks (Bye-bye sparse auto-encoders)

🔗 Read the paper:
arxiv.org/abs/2503.07639
huggingface.co/papers/2503.07…