Sara Du
@saraduit
building quietly | cofounder @alloyautomation, dropped out @harvard
ID: 4544645238
https://saradu.com/ 13-12-2015 06:19:34
1,1K Tweet
34,34K Followers
902 Following
great work by my friend Simon Guo 🦝 in explaining Ring Attention, a new method for scaling LLM context windows beyond 1M tokens by splitting attention calculation across GPUs coconut-mode.com/posts/ring-att…