Amit (@const_amit) 's Twitter Profile
Amit

@const_amit

I write code that works, sometimes | @modal_labs, @IllinoisCDS

ID: 1536853801071779841

linkhttps://amit.prasad.me calendar_today14-06-2022 23:31:29

2,2K Tweet

2,2K Followers

162 Following

Amit (@const_amit) 's Twitter Profile Photo

Oh jeez took a look at Cloudflare serverless the framework/DX just looks so annoying & fragmented into workers (+KV, AI, etc) and then Durable Objects too.

Amit (@const_amit) 's Twitter Profile Photo

using Modal to simulate load testing behavior for LLM/ML systems was way easier than I anticipated Scaled up to nearly 100 GPUs, heterogenous system with both H100s and A100s, within a couple of minutes, very cool. (this test set isn't very good :( call it a proof of concept)

using Modal to simulate load testing behavior for LLM/ML systems was way easier than I anticipated

Scaled up to nearly 100 GPUs, heterogenous system with both H100s and A100s, within a couple of minutes, very cool.

(this test set isn't very good :( call it a proof of concept)