🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

SIGIR deadline is tomorrow. But Eval4RAG is also right at the corner! 📅 Submit your one-pager by this Friday (Feb 21) for presentation at the workshop! eval4rag.github.io

Hope people are recovered from SIGIR and ACL deadline! Still a day for Eval4RAG workshop! 🔅Come present your brilliant idea in eval for RAG!

🛎️🛎️And today is the day! Looking forward to reviewing all the fun idea on evaluating RAG systems! Remember to submit it by the end of the day AoE!

Ever wonder how test-time compute would do in retrieval? 🤔 introducing ✨rank1✨ rank1 is distilled from R1 & designed for reranking. rank1 is state-of-the-art at complex reranking tasks in reasoning, instruction-following, and general semantics (often 2x RankLlama 🤯) 🧵

🚨 New Pre-Print! 🚨 Reviewer 2 has once again asked for DL’19, what can you say in rebuttal?  We have re-annotated DL’19 in the form of classic evaluation stability studies. Work done with Maik Fröbe, Harry Scells, Ferdinand Schlatt, Guglielmo Faggioli, Saber Zerhoudi, Sean MacAvaney, Eugene Yang 🧵

👁️Recent works use LLMs for social simulations—but can these agents help shape effective policies? 💥Our new paper tackles a bold question many have wondered about: Can generative agent societies simulate to inform public health policy? 🔗: arxiv.org/abs/2503.09639

"We tackle the problem of text-to-video retrieval (T2VR). Inspired by the success of late interaction techniques in text-document, text-image, and text-video retrieval, our approach, Video-ColBERT, introduces a simple and efficient mechanism for fine-grained similarity assessment

Check out our latest work, Video-ColBERT, an efficient late interaction approach for video retrieval! Recently accepted at #CVPR2025

🚨 New Pre-Print!🚨 with Sean MacAvaney & Iadh Ounis. Stop using "translate-train" for all your multilingual needs. We explore zero-shot transfer for low-resource languages... 🧵

Wish you could get a Wikipedia style article for unfolding events? Introducing WikiVideo: a new multimodal task and benchmark for Wikipedia-style article generation from multiple videos!

Starting today's #ecir2025 papers with Eugene Yang's illuminating talk on "MURR: Model Updating with Regularized Replay for Searching a Document Stream"

🚨 IT'S HERE! 🚨 The Eval Leaderboard is now LIVE! 🏆💻 Our video retrieval collection stumps most pre-trained models. See if you can build a better system! eval.ai/web/challenges…

NeurIPS D&B track in a nutshell: (1) An LLM-generated benchmark dataset (2) used to test performance of LLMs (3) evaluated via LLM-as-a-judge