Sham Kakade (@shamkakade6) 's Twitter Profile
Sham Kakade

@shamkakade6

Harvard Professor.
Full stack ML and AI.
Co-director of the Kempner Institute for the Study of Artificial and Natural Intelligence.

ID: 1069106254927273984

linkhttps://shamulent.github.io calendar_today02-12-2018 05:49:28

418 Tweet

14,14K Takipçi

463 Takip Edilen

Sham Kakade (@shamkakade6) 's Twitter Profile Photo

1/6 Infinite-dim SGD in linear regression is the strawman model for studying scaling laws, critical batch sizes, and LR schedules. We revisit (and simplify) its analysis using just linear algebra, making it easier to derive and reason about. No PSD operators. No tensor calculus.