🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Most teams only find out their AI is broken when someone complains or churns. Your agents shouldn’t fail silently. We’re launching Quotient AI Detections: a system to catch agent mistakes, identify how they happened, and automatically fix them.

If you're building AI apps and flying blind, we can help. → Sign up: app.quotientai.co → Grab $250 in credits with the ElevenLabs AI Engineer Pack: aiengineerpack.com → Join our Discord: discord.com/invite/YeJzANp… Let us help you understand how your agents fail,

We just launched Quotient AI Detections: the first system that helps teams catch AI failures before their users do. As part of the launch, we partnered with ElevenLabs to offer coupons through the AI Engineer Pack: → 1,000,000 extra logs → 10,000 free detections → $250+

HypoEval evaluators (github.com/ChicagoHAI/Hyp…) are now incorporated into judges from Quotient AI — check it out at github.com/quotient-ai/ju…!

detections go brrr One week in, Quotient AI Detections has processed 20M+ tokens, analyzed tens of thousands of logs, and caught thousands of hallucinations across real AI production apps. Still a long way to go, but we're committed to giving builders SOTA AI monitoring.

referring to Raichu as “fine-tuned Pikachu” from now on

pretty cool for our tiny country 🇨🇷

headed to SF for AI Engineer World’s Fair! Who wants to meet up? Who should I meet? Will be around until Thursday evening

it was a pleasure speaking at AI Engineer with Maitar Asher 🎗️ from tavily and Deanna Emery from Quotient AI 🫡

retrieval + search track = best vibes AI Engineer ft Maitar Asher 🎗️ Deanna Emery Jerry Liu tavily Quotient AI LlamaIndex 🦙

You probably knew you could turn an LLM into a classifier. But the basic approach returns a hard classification – yes or no; good or bad. In this post I'll show you a simple technique to make your LLM classifiers more nuanced – they tell you HOW good or HOW bad something is. 👇

prayers out to all the infra teams right now. thought it was just gcp but now other clouds. brazy

so who’s the bad node in the dependency graph right now? supabase, aws, gcp, cursor, cloudflare, azure… surely something upstream?

it’s good everyone here can share the misery of the internet being broken. hopefully this doesn’t jinx it

“You want your model hitting milestones, not minefields.” Most AI eval talk is hand-wavy. This isn’t. Freddie Vargus (Quotient AI CTO) gets into the weeds: how to actually test tool use, avoid minefields, and build agents that don’t break. Check out the recording👇