@qiyuegao123 : 🤔 Have @OpenAI o3, Gemini 2.5, Claude 3.7 formed an internal world model to understand the physical world, or just align pixels with words? We introduce WM-ABench, the first systematic evaluation of VLMs as world models. Using a cognitively-inspired framework, we test 15 SOTA • TwiCopy

Qiyue Gao

@qiyuegao123

+ Follow

PhD student @UCSanDiego; Prev intern @allen_ai #AI #ML #NLP

ID: 1939706598521520128

calendar_today30-06-2025 15:24:34

15 Tweet

80 Followers

15 Following

Qiyue Gao

@qiyuegao123

5 months ago

🤔 Have OpenAI o3, Gemini 2.5, Claude 3.7 formed an internal world model to understand the physical world, or just align pixels with words? We introduce WM-ABench, the first systematic evaluation of VLMs as world models. Using a cognitively-inspired framework, we test 15 SOTA

thumb_up_off_alt206

chat_bubble_outline3

repeat44

shareShare