Rohan Paul (@rohanpaul_ai) 's Twitter Profile
Rohan Paul

@rohanpaul_ai

💼 Engineer.

📚 I write daily on actionable AI developments.

🗞️ Subscribe and instantly get a 1300+page Python book → rohan-paul.com

ID: 2588345408

linkhttp://www.rohan-paul.com calendar_today25-06-2014 22:38:54

36,36K Tweet

63,63K Takipçi

780 Takip Edilen

Rohan Paul (@rohanpaul_ai) 's Twitter Profile Photo
Rohan Paul
@rohanpaul_ai

3 months ago

This is really BAD news of LLM's coding skill. ☹️ The best Frontier LLM models achieve 0% on hard real-life Programming Contest problems, domains where expert humans still excel. LiveCodeBench Pro, a benchmark composed of problems from Codeforces, ICPC, and IOI (“International

This is really BAD news of LLM's coding skill. ☹️ The best Frontier LLM models achieve 0% on hard real-life Programming Contest problems, domains where expert humans still excel. LiveCodeBench Pro, a benchmark composed of problems from Codeforces, ICPC, and IOI (“International