🚀 We release MMLongBench: Benchmark for evaluating long-context VLMs. 📊 13,331 examples across 5 tasks: – Visual RAG – Many-shot ICL – Needle-in-a-haystack – VL Summarization – Long-document VQA 📏 Lengths: 8 / 16 / 32 / 64 / 128K 🔍 Benchmarking both thoroughly & effectively!

Great to see the wonderful series of work that @WangCarrey has been leading at UIUC. We also had a fun collaboration recently together with my incoming PhD student Shijue. Check out our latest release 𝘈𝘥𝘢𝘊𝘵𝘳𝘭: 𝘈𝘥𝘢𝘱𝘵𝘪𝘷𝘦 𝘢𝘯𝘥 𝘊𝘰𝘯𝘵𝘳𝘰𝘭𝘭𝘢𝘣𝘭𝘦

We studied both rule-based and model-based verifiers and found that each has unique limitations. Rule-based verifiers are often unreliable, even in math, and are unavailable in many domains. Model-based verifiers can be easily hacked. In our paper, we construct simple

Thrilled to share a major milestone: the culmination of a 15-month project, ATLAS—a new benchmark in event graphs and conceptualization! This journey began with Probase in 2012, evolved through ASER (2019), AbstractATOMIC (2022), and AbsPyramid (2023), and now realizes a

🤯 Multimodal LLMs can be confidently wrong. A single early mistake in perception can lead to a completely incorrect answer. 🚀Introducing our work, MMBoundary, a new framework to make MLLMs aware of their own knowledge boundaries! 🧵 Paper:arxiv.org/abs/2505.23224 #ACL2025

Excited to share our new survey on the reasoning paradigm shift from "Think with Text" to "Think with Image"! 🧠🖼️ Our work offers a roadmap for more powerful & aligned AI. 🚀 📜 Paper: arxiv.org/pdf/2506.23918 ⭐ GitHub (400+🌟): github.com/zhaochen0110/A…

#COLM2025 Our work has been accepted to COLM 2025😊 Looking forward to discussing Scalable Oversight and Synthetic Data with old and new friends in Montréal Conference on Language Modeling ！

📢 Join us for the ACL Mentorship Session ACL 2025 #ACL2025NLP #NLProc • Session Link: mentorship.aclweb.org/schedule • Ask Questions: tinyurl.com/y2v2j462 Mentors: • May Fung (hiring postdocs) (HKUST) • Dennis Aumiller at #ACL2025 (cohere) • Verna Dankers (Mila - Institut québécois d'IA) • Martin Ziqiao Ma (Computer Science and Engineering at Michigan) •

Heading out to #ACL2025 in Vienna with six main/finding papers to present! 🇦🇹✈️🤩 Would love to chat about research on multimodal model reasoning and agent, as well as opportunities in my group HKUST NLP. Please DM if you'd like to meet!

HKUST NLP UIUC NLP ACL 2025 [1/n] "𝘔𝘢𝘵𝘤𝘩𝘪𝘯𝘨 𝘤𝘶𝘦𝘴 𝘧𝘰𝘳 𝘪𝘥𝘦𝘯𝘵𝘪𝘤𝘢𝘭 𝘰𝘣𝘫𝘦𝘤𝘵𝘴, 𝘥𝘪𝘴𝘵𝘪𝘯𝘤𝘵 𝘢𝘵𝘵𝘳𝘪𝘣𝘶𝘵𝘦𝘴 𝘧𝘰𝘳 𝘶𝘯𝘪𝘲𝘶𝘦 𝘰𝘯𝘦𝘴." Such 𝙘𝙧𝙤𝙨𝙨-𝙘𝙤𝙣𝙩𝙚𝙭𝙩 𝙫𝙞𝙨𝙪𝙖𝙡 𝙧𝙚𝙖𝙨𝙤𝙣𝙞𝙣𝙜 is extremely simple and straightforward for the human cognitive process,

Find us at the poster booth ✨Wed 7/30 11am Hall 4/5 ✨

If you are at ACL, please talk to our members of KnowComp HKUST and HKUST NLP big family

Excited to present our work, MMBoundary, at #ACL2025! Come chat with us at our poster session! 📍 Hall 4/5, Session 12: Poster Session 4 🗓️ Wednesday, July 30 ⏰ 11:00-12:30

Check out our new work on multimodal long-context!

Actually, we implemented this kind of capability in our AdaCtrl paper three months ago by injecting difficult-aware tags (i.e., easy, hard, adaptive) to trigger different reasoning behaviors of LLMs. Paper: arxiv.org/pdf/2505.18822

🎉 Congrats to our students on the new #EMNLP2025 paper acceptances! 1⃣ LLM Natural-Formal Hybrid Reasoning arxiv.org/abs/2505.23703 2⃣ Text-Instructed Image Editing on Medical Domain arxiv.org/abs/2506.01921 3⃣ Knowledge Boundary Aware Multi-Compositional Reasoning

Check out this awesome paper on a new paradigm about thinking with imagination/images led by Prof. May Fung May Fung and her super productive team at HKUST!

How far are we from Artificial General Intelligence—and what might follow as Artificial Superintelligence? IJCAI Closing Panel opened by James Kwok, #IJCAI2025 Programe Chair. share.google/DbB2Ky20bCc3B0… #Montreal #AI