TIL Google has offices in the loo

typical co-op resume sesh

singapore local’s first “real food” in waterloo (1.5 hr wait time 😭)

4th day in the loo 👍 ✅attended kw redeemer church;; their pastor is very funny and cool ✅a 3rd yr UW christian paid for ALL 12 first years’ lunch… insane. ✅chat w my don omar; he’s pre chill and shouted me out in his email LMAO

Performative final boss spotted

bro making 800 people learn dances in the sun is not it

Bro what is happening 💀💀

was worth the walk from v1 to the other side of campus !

Probably one of the best pieces written on the critique of Singaporean culture!

me after first day of loo math classes

This essay is correct in many ways. The question then is, now what? I think it is upon us to change it. To make the golden age of our glorious yet nascent city-state

🤯🤯after one full day of (okay for them it was half a day) of math 🤯🤯

Same with uwaterloo too! No luck :/

Wrote an in-depth blog on Scaling Modern Transformers with n-D parallelism. Includes an explanation with code on how modern-day transformers (multi-latent attention, decoupled RoPE, interleaved-attention, mixture-of-experts, etc.) are built across a multi-node TPU cluster.

ever wondered how billion-param transformers are actually trained across massive TPU clusters? i just built one from scratch and wrote a step-by-step guide (with code). introducing JAXformer: a modern transformer with n-D parallelism written entirely in JAX. here's how 👇

earlier this summer, i headed to Toronto and spent a month continuing my work at UofT's Computational Social Science Lab found a little time to write some thoughts ↓

Michael Han many such cases

finally met Sonith at the waterloo Z Fellows meet s/o adi akatos. for hosting

New blogpost: Use NVRTC to explore MMA instruction variants, including FP16 accumulate and INT4. gau-nernst.github.io/nvrtc-matmul/ Thanks Mark Saroufim for bringing NVRTC to PyTorch, and mobicham for (indirectly) giving me the idea.

A wild Z Fellows appeared