SuperGPQA Scaling LLM Evaluation across 285 Graduate Disciplines

🥁🥁 Happy to share our latest efforts on math pre-training data, the MegaMath dataset! This is a 9-month project starting from 2024’s summer, and we finally deliver: the largest math pre-training data to date containing 💥370B 💥tokens of web, code, and synthetic data!

1/n Delighted to share the release of our new preprint "ContrastScore: Towards Higher Quality, Less Biased, More Efficient Evaluation Metrics with Contrastive Evaluation" 📄Paper: arxiv.org/abs/2504.02106 💻Code: github.com/NL2G/contrasti…

🚀 General-Reasoner: Generalizing LLM Reasoning Across All Domains (Beyond Math) Most recent RL/R1 works focus on math reasoning—but math-only tuning doesn't generalize to general reasoning (e.g. drop on MMLU-Pro and SuperGPQA). Why are we limited to math reasoning? 1. Existing

Delighted to share the #ACL2025 and TACL papers (10 in total) from the @manchester_nlp group! Come chat with our staff and students in Vienna! 🇦🇹

📢 The Joint Call for Tutorial Proposals for EACL/ACL 2026 is now live 👉 2026.eacl.org/calls/tutorial… Tutorial proposals should be submitted online via the Softconf system at the following link: softconf.com/p/acl-tutorial… Deadline: 20 Oct 2025 eaclmeeting @ #ACL2026NLP #EACL2026