Idk have 4 API endpoints maybe instead of a classifier that will fail X% of the time.

Building a model router in a world where 4 use cases represent >90% of the needs: ????

I discovered at ICLR 2024 that a lot of what I take for granted about LLM evaluation is actually not that widely known...

So I made a blog!
- how do we do currently do LLM evaluation? ⚖️
- most importantly, what is it actually useful for? 🤔

huggingface.co/blog/clefourri…

Outlines just reached 6,000 stars 🎉

Thank you ❤️

Big news for both outlines and Argilla. Open source ❤️

As the stragglers are still heatedly debating F# vs C# vs OCaml vs Haskell, the language designers github.com/githubnext/cop… have already moved on to the next generation of AI-based programming languages githubnext.com/projects/specl….

Skate towards where the puck is going, not where it

My workflow is so automated that I sometimes feel like I am working on a production line.

There are 10 Python libraries for structured LLM output. I've tried them all. My top recommendations: outlines and instructor. Read my full review here:
simmering.dev/blog/structure…

The urge to write a blog post about the future of interacting with auto-regressive language models when I have to do a bunch of admin.

Doesn’t update my priors by much having witnessed the early EA scene in Oxford

🙋‍♂️

Wife lost her engagement ring in #cannes2024 She’s devastated. Please share in case someone found it 🙏

Using an audio transcription tool for my calls and, rereading one, I see that I have a tendency to go on a tangent inside a tangent inside a tangent and go back to the main point until the next nested tangent. I feel sorry for everyone who’s had to go through this.

I see a lot of 'delve' in documentation these days and if that means that there would otherwise be little to no documentation I’m all for it.

Working with closed APIs, all you can do is 'prompt hacking' and hope for improvements.

With open models, you have so much more control over what the model is doing and how performance can be improved. You can do actual engineering.

This is key to unlocking the largest gains.

I will be speaking at the AI Engineer World’s Fair 🎉

Swap notes is the new pick your brain is the new free consulting

I will be speaking at the AI Engineer World’s Fair 🎉