Simon Eskildsen
@Sirupsen
founder @turbopuffer, former principal infra @Shopify 1kβ1m RPS
ID:29170474
http://sirupsen.com 06-04-2009 09:15:53
12,8K Tweets
9,3K Followers
588 Following
watching Bojan Serafimov pulling 2 IOIs a day [0] on the query planner with Morgan Gallant playing evaluator, godly pace
[0]: en.wikipedia.org/wiki/Internatiβ¦
took me an hour to spin up a new region of turbopuffer the other day, despite having done nothing special for multi-region provisioning
beauty of object storage being your _only_ stateful dependency.
100m 1536 dim vectors fundamentally are ~600 GiB:
3xNVME (replicate): $190
SSD network disk: $120
Object+spot NVME: $45
HDD network disk: $30
cheapest, fastest, and most scalable to have an architecture of object storage w/ spot NVME caching like turbopuffer does