🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

I am on the industry job market, and am planning to interview around next March. I am attending NeurIPS Conference, and I hope to meet you there if you are hiring! My website: soyeonm.github.io Short bio about me: I am a 5th year PhD student at CMU MLD, working with Russ Salakhutdinov

We have released Global-MMLU-lite 🔥 This is designed to run more efficiently while giving a good estimate of overall performance -- which balances both culturally sensitive and culturally agnostic examples. 🎉 huggingface.co/datasets/Coher…

Announcement #1: our call for papers is up! 🎉 colmweb.org/cfp.html And excited to announce the COLM 2025 program chairs Yoav Artzi Eunsol Choi Ranjay Krishna and Aditi Raghunathan

Announcement #2: our call for workshops is up! 💥 colmweb.org/cfw.html And excited to announce the first ever workshop chairs for COLM..... 🥁🥁🥁 COLM 2025 workshops will be led by Colin Raffel and Adina Williams Workshop proposal deadline is April 14 🗓️

COLM now has a mailing list: groups.google.com/g/colm-announc… In the future we will send general updates like CFP and registration becoming available. We will keep the traffic to a minimum

COLM 2025: Oct 7-9 (conference), Oct 10 (workshops) Montreal, Canada Abstract deadline: March 20, 2025 Paper deadline: March 27, 2025 CFP: colmweb.org/cfp.html Workshop proposal deadline: April 14, 2025 Call: colmweb.org/cfw.html Mailing list: groups.google.com/g/colm-announc…

Today, we are publishing the first-ever International AI Safety Report, backed by 30 countries and the OECD, UN, and EU. It summarises the state of the science on AI capabilities and risks, and how to mitigate those risks. 🧵 Link to full Report: assets.publishing.service.gov.uk/media/679a0c48… 1/16

Excited to have this writeup published on Google AI summarizing a long & fruitful line of research our team & collaborators have been working on for ~4 yrs. For me, this journey started when Mark Díaz & I started working on this w/ Aida Davani as her intern project back in 2021!

We’ve confirmed the #FAccT2025 venue! We’re so excited to welcome you all on June 23-26 to the Athens Conservatoire in the heart of downtown Athens! 🦉🇬🇷🌊🏛️ athensconservatoire.gr/en-venuehire/

Join the WiML Organizing Team for 2025! We’re looking for passionate organizers to help shape Women in Machine Learning events. Gain leadership experience, grow your network, and empower women in AI! Apply by Feb 28: bit.ly/415M9xU 📅 #WiML #WomenInAI

We updated our Global-MMLU paper to describe our Global-MMLU lite ✨ eval set. This is a quicker more effficient eval on a subset of languages balanced with equal number of Culturally Sensitive (CS) and culturally Agnostic (CA) per language. We also added to eval harness 🔥

We’ve updated our Global-MMLU paper to include Global-MMLU Lite ✨—a faster, more efficient eval set. Plus, we’ve added to the eval harness! It covers a balanced subset of languages with an equal mix of Culturally Sensitive (CS) & Culturally Agnostic (CA) questions per language

Have you signed up for Expedition Aya yet? 🌍 Join us for a 6-week open build challenge to accelerate ML research progress in multilingual, multimodal and efficiency.

Many AI models struggle with less common languages—leaving us with awkward, broken responses. But what if we could fix it together? Together? Yes, you, MIT CSAIL Hugging Face Cohere For AI IBM Research Alice Oh omer goldman and you and you ...

SKorea upholding democracy, respecting the Constitution, confirming that the voice of the citizens will not be silenced by political agenda. nytimes.com/live/2025/04/0… via @NYTimes

Starting my sabbatical at Google!

Are you working on a peer-reviewed paper, dataset, code, or another research output and want to leverage Cohere’s models? Cohere For AI offers research grants to provide academic researchers and developers with subsidized access to the Cohere API.

🚀 We are excited to introduce Kaleidoscope, the largest culturally-authentic exam benchmark. 📌 Most VLM benchmarks are English-centric or rely on translations—missing linguistic & cultural nuance. Kaleidoscope expands in-language multilingual 🌎 & multimodal 👀 VLMs evaluation

Honoured to have 2 of our datasets recognized by the Stanford HAI AI Index Report as some of the most significant releases of 2024. Congrats to the Aya Dataset & Global MMLU teams, with shoutout to Shivalika Singh - 1st author on both! - and mentors Marzieh Fadaee Beyza Ermiş Sara Hooker.

Great job NAVER_official for making these models publicly available. Here's a graph showing a larger version of their model doing quite well on our BLEnD dataset. arxiv.org/pdf/2406.09948