Tristan Hume (@trishume) 's Twitter Profile
Tristan Hume

@trishume

Performance optimization lead @AnthropicAI. Profiling, distributed systems, dev tools, interpretability. [email protected]

ID: 23242559

linkhttp://thume.ca calendar_today07-03-2009 22:25:43

1,1K Tweet

6,6K Takipçi

338 Takip Edilen

Tristan Hume (@trishume) 's Twitter Profile Photo
Tristan Hume
@trishume

6 months ago

Here's Claude 3 Haiku running at >200 tokens/s (>2x as fast as prod)! We've been working on capacity optimizations but we can have fun testing those as speed optimizations via overly-costly low batch size. Come work with me at Anthropic on things like this, more info in thread 🧵