Olivier Chafik (@ochafik) 's Twitter Profile
Olivier Chafik

@ochafik

Googler (views expressed = my own)

OpenSCAD & llama.cpp contributor

he/him πŸ³οΈβ€πŸŒˆ

@ochafik.bsky.social
@[email protected]

ID: 45456164

linkhttp://ochafik.com/ calendar_today08-06-2009 00:05:22

859 Tweet

646 Followers

588 Following

sophia aram (@sophiaaram) 's Twitter Profile Photo

. Jean-Luc Mélenchon au moment où le peuple syrien se libère de la dictature que vous avez toujours soutenu, la décence aurait voulu que vous vous taisiez. Vous avez choisi d'ajouter le mensonge à la longue liste de vos indignités sur le sujet. Alors, s'il ne fallait garder q'une

James O'Leary (@jpohhhh) 's Twitter Profile Photo

You're seeing a minor miracle: Phi-4 3.8B doing agentic tool calls. Doing that reliably, locally, even with 8B, has been a fools errand until Olivier Chafik's opus of a patch series to llama.cpp (PR coming for phi-4)

Olivier Chafik (@ochafik) 's Twitter Profile Photo

Loving this... hope OSS catches up quickly πŸ€— Also, conforming to JSON schemas in a diffusion context is going to be an interesting challenge (schema / grammar compliance gradients anyone?)

Xuan-Son Nguyen (@ngxson) 's Twitter Profile Photo

Day-zero Gemma 3 support in llama.cpp 🀯 πŸ‘‰ 4 model sizes: 1B, 4B, 12B, 27B πŸ‘‰ Vision capability (except for 1B) with bi-direction attention πŸ‘‰ Context size: 32k (1B) and 128k (4B, 12B, 27B) πŸ‘‰ +140 languages support (except for 1B) πŸ‘‰ Day-zero support on many frameworks πŸš€

Day-zero Gemma 3 support in llama.cpp 🀯

πŸ‘‰ 4 model sizes: 1B, 4B, 12B, 27B
πŸ‘‰ Vision capability (except for 1B) with bi-direction attention
πŸ‘‰ Context size: 32k (1B) and 128k (4B, 12B, 27B)
πŸ‘‰ +140 languages support (except for 1B)
πŸ‘‰ Day-zero support on many frameworks πŸš€
Olivier Chafik (@ochafik) 's Twitter Profile Photo

WIP: streaming support for llama.cpp's tool calling + normalization of streamed <think> tags (for QwQ, DeepSeek R1 & Cohere Command R7B) Still strongly conforming to tool schemas (grammar-constrained). Testing / feedback welcome :-) github.com/ggml-org/llama…

Olivier Chafik (@ochafik) 's Twitter Profile Photo

llama.cpp streaming support for tool calling & thoughts was just merged: please test & report any issues πŸ˜… github.com/ggml-org/llama… #llamacpp