📝 How do you choose which language model to use? Quantitative benchmarks can be uninformative and fall prey to Goodhart's Law, and even Chatbot Arena performance can be optimized for. In our new preprint, we propose generating qualitative report cards... 🧵

You can now listen to an digestible AI podcast about a research paper on AI grading AIs The new paper -> podcast quality is wild