profile-img
lmsys.org

@lmsysorg

Large Model Systems Organization. We created Vicuna and Chatbot Arena! Compare 30+ LLMs (GPT-4/Claude/Llamas) side-by-side at https://t.co/IDFeIDIOtm

calendar_today30-03-2023 09:56:38

460 Tweets

43,2K Followers

171 Following

lmsys.org(@lmsysorg) 's Twitter Profile Photo

Exciting new blog -- What’s up with Llama-3?

Since Llama 3’s release, it has quickly jumped to top of the leaderboard. We dive into our data and answer below questions:

- What are users asking? When do users prefer Llama 3?
- How challenging are the prompts?
- Are certain users

Exciting new blog -- What’s up with Llama-3? Since Llama 3’s release, it has quickly jumped to top of the leaderboard. We dive into our data and answer below questions: - What are users asking? When do users prefer Llama 3? - How challenging are the prompts? - Are certain users
account_circle
lmsys.org(@lmsysorg) 's Twitter Profile Photo

2. As prompts get challenging*, the gap between Llama 3 against top-tier models becomes larger.

* We define challenging using several criteria like complexity, problem-solving, domain knowledge, and more.

2. As prompts get challenging*, the gap between Llama 3 against top-tier models becomes larger. * We define challenging using several criteria like complexity, problem-solving, domain knowledge, and more.
account_circle