Joschka Braun (@joschkabraun) 's Twitter Profile
Joschka Braun

@joschkabraun

Co-founder of @PareaAI (YC S23) • Building Generative AI Developer Tools • @FulbrightPrgrm

ID: 1332560411003129856

linkhttps://www.parea.ai calendar_today28-11-2020 05:42:29

413 Tweet

663 Takipçi

242 Takip Edilen

Joschka Braun (@joschkabraun) 's Twitter Profile Photo
Joschka Braun
@joschkabraun

7 months ago

I benchmarked Anthropic's new tool use beta API on the Berkeley function calling benchmark. Haiku beats GPT-4 Turbo in half of the scenarios. Results in 🧵 A huge thanks to Shishir Patil, Fanjia Yan, Tianjun Zhang, Joey Gonzalez & rest for providing this benchmark publicly.

I benchmarked <a href="/AnthropicAI/">Anthropic</a>'s new tool use beta API on the Berkeley function calling benchmark. Haiku beats GPT-4 Turbo in half of the scenarios. Results in 🧵 A huge thanks to <a href="/shishirpatil_/">Shishir Patil</a>, <a href="/fanjia_yan/">Fanjia Yan</a>, <a href="/tianjun_zhang/">Tianjun Zhang</a>, <a href="/profjoeyg/">Joey Gonzalez</a> &amp; rest for providing this benchmark publicly.