RWKV: Reinventing RNNs for the Transformer Era propose a novel model architecture, Receptance Weighted Key Value (RWKV), that combines the efficient parallelizable training of Transformers with the efficient inference of RNNs. Our approach leverages a linear attention mechanism

Hi there, I've been using Matplotlib for 8+ years and I still google how to do everything except plt.plot()

Jobs: Linguistics - Tenure-track Position, University of Michigan: The Department of Linguistics at the University of Michigan, Ann Arbor, invites applications for a new full-time, tenure-track position, beginning August 26, 2024. Qualifications: We seek… dlvr.it/SvgX7k

Dear ACL community, ACL is considering multiple proposals to change its anonymity period policy. It seeks immediate feedback from the community about the proposed changes. Please add your voice until Friday, September 22nd (AOE): aclweb.org/portal/content… #NLProc

We're hiring in Computational Linguistics! (tenure track, research stream) Deadline Dec 8th. linguistics.ubc.ca/job-opportunit…

I'm collecting data about using LLMs for NLP system development. Please fill out this short survey and RT: surveymonkey.com/r/CHK6QTP

Excited to share our new applied causal machine learning book causalml-book.org is available online. Any feedback/corrections greatly appreciated!

Introducing: StarCoder2 and The Stack v2 ⭐️ StarCoder2 is trained with a 16k token context and repo-level information for 4T+ tokens. All built on The Stack v2 - the largest code dataset with 900B+ tokens. All code, data and models are fully open! hf.co/bigcode/starco…

David is a great researcher and a wonderful mentor! Vote for him!

I have updated the OWSM-CTC model page to include examples of short-form ASR/ST, long-form ASR/ST, and CTC forced alignment (it takes a few seconds to align a 20min audio on a GPU): huggingface.co/pyf98/owsm_ctc… x.com/ArxivSound/sta…

🦅 Eagle & 🐦 Finch The RWKV v5 and v6 architecture paper is here arxiv.org/abs/2404.05892 Both of which, improve over RWKV-4, scaled up to 7.5b and 3.1b billion multilingual models respectively Open-source code, weights, and dataset Apache 2 licensed, under Linux Foundation

Super excited about Isabel (Isabel Papadimitriou) joining us at UBC Linguistics and UBC NLP Group !

Welcome to Paris ❤

If you're at COLM and interested in talking about RNNs, come hang out with Eric Alcaide and I as we talk about the latest RWKV paper! Poster #8, morning session Paper: arxiv.org/abs/2404.05892

Do you want to understand how language models work, and how they can change language science? I'm recruiting PhD students at UBC Linguistics! The research will be fun, and Vancouver is lovely. So much cool NLP happening at UBC across both Ling and CS! linguistics.ubc.ca/graduate/admis…

If you are attending #neurips2024 consider attending our workshop and presenting a poster: nlp.cs.ubc.ca/future-of-nlp-…

You can also apply to UBC Linguistics to work with Jian Zhu, Isabel Papadimitriou and Muhammad AbdulMageed: linguistics.ubc.ca/graduate/admis…. You can even have supervisors in both departments! 😃

ARR February Authors: If you keep receiving confusing reminder emails about volunteer qualifications, please ask your nominated volunteer to update the OpenReview profile with either ACL Anthology or DBLP. This is how PCs verify qualification. RT appreciated!

🟢 Announcing the #NAACL2025 Award Winners! The Best Paper and Best Theme Paper winners will present at our closing session 2025.naacl.org/blog/best-pape…

Congrats to Shenran Wang, Changbing Yang, Michael l Parkhill, Chad Quinn, Christopher Hammerly and Jian Zhu - their paper "Developing multilingual speech synthesis system for Ojibwe, Mi’kmaq, and Maliseet" won the best theme paper runner-up at #naacl2025! 👏🎉 aclanthology.org/2025.naacl-sho…