Introducing Prompt-to-leaderboard (P2L): a real-time LLM leaderboard tailored exactly to your use case! P2L trains an LLM to generate "prompt-specific" leaderboards, so you can input a prompt and get a leaderboard specifically for that prompt. The model is trained on the 2M

Prompt-to-Leaderboard is now LIVE❤️‍🔥 Input any prompt → leaderboard for you in real-time. Huge shoutout to the incredible team that made this happen! Evan Connor Chen Joseph Tennyson Tianle (Tim) Li Wei-Lin Chiang Anastasios Nikolas Angelopoulos Ion Stoica

Prompt-to-Leaderboard is one of my favorite projects ever. "Which LLM is best for me and my use-case?" We train an LLM to take in prompts and output a vector of BT regression coefficients: one per model. By converting evaluation into learning, we benefit from scaling laws in

Have been waiting for this banger to go public, super fun to play around with. A huge congrats to Evan Tianle (Tim) Li Connor Chen Anastasios Nikolas Angelopoulos Wei-Lin Chiang and Ion Stoica!

📢We’re excited to share that we’ve raised $100M in seed funding to support LMArena and continue our research on reliable AI. Led by a16z and UC Investments (University of California), we're proud to have the support of those that believe in both the science and the mission. We’re

Just heard from the LMArena team that since launching on Vercel, usage is up 6.5× to 1.2 million human votes per month 😳 Arenas are such a critical resource to help devs understand real-world model performance. h/t Anastasios Nikolas Angelopoulos