Alexander Long (@_alexanderlong) 's Twitter Profile
Alexander Long

@_alexanderlong

Founder @PluralisHQ | prev. Applied Scientist at Amazon | ML PhD |
Protocol Learning: Multi-participant, low-bandwidth model parallel.

ID: 1684127558563151873

linkhttp://Pluralis.ai calendar_today26-07-2023 09:05:01

289 Tweet

1,1K Followers

715 Following

Alexander Long (@_alexanderlong) 's Twitter Profile Photo
Alexander Long
@_alexanderlong

4 months ago

Why Model Parallelism Matters in Decentralized AI A lot of prior work has focused on data parallelism (DP), and for good reason. It’s simple to scale, relatively well supported by infrastructure, and compatible with many gradient compression techniques. But there’s a critical