The invitation to review for Eval4NLP 2022 was just sent out. If you would like to review (or know someone who does) but didn't get an email, get in contact with us! [email protected]

I got three fully funded PhD positions in new BMBF project "Metrics4NLG". Topic: Evaluation for Text Generation (and text generation itself). Very cool interdisciplinary project :-). If you're interested or know anyone interested, drop me a line ([email protected]).

The deadline to submit to Eval4NLP has been extended to August 15! We will also be accepting papers with reviews from AACL in addition to ARR, both due September 21! eval4nlp.github.io/2022/cfp.html

This year, Eval4NLP is accepting submissions of papers with reviews from other venues (see the CFP for more details eval4nlp.github.io/2022/cfp.html#…). Submit your paper and reviews here openreview.net/group?id=aclwe… by September 21, AOE!

The list of accepted papers is now on our website! eval4nlp.github.io/2022/accepted-… Congratulations to all of the authors, and we look forward to your presentations on November 20. FYI, registration for AACL is now open! aacl2022.org/Registration

Eval4NLP is happening tomorrow, starting at 10:30 UTC. Our combined program with SUMEval @ COLING 2025 includes some great paper presentations and invited talks from @peyrardmax and @rktamplayo. See you there tomorrow! eval4nlp.github.io/2022/program.h…

📢📢📢 The Eval4NLP workshop will take place this year at AACL 2023. Special focus: Evaluation of/with LLMs. Including a shared task on Prompting LLMs as Explainable Metrics. 📢📢📢 Direct submission deadline: 25.08. Webpage: eval4nlp.github.io/2023/index.html CFP: eval4nlp.github.io/2023/cfp.html

📢📢📢 We have released the description of Eval4NLP's shared task on "Prompting LLMs as Explainable Evaluation Metrics" (for MT & summarization). Dev phase: Aug. 7 Test phase: Sep. 18 System Submission Deadline: Sep. 23 More details: eval4nlp.github.io/2023/shared-ta… 🚀🚀🚀

Shared task on explainable evaluation metrics: The development phase is running, but participation is still easily possible, there's also no necessity to train systems to take part. #nlproc #machinelearning Find out more @nlp_evaluation: eval4nlp.github.io/2023/shared-ta…

📢📢Brief reminder that Eval4NLP submission deadline is this **Friday, 25.08.2023** Focus: Evaluation with/of LLMs, all other evaluation aspects also very welcome 2nd call4papers: aclweb.org/portal/content… Webpage: eval4nlp.github.io/2023/index.html Venue: AACL 2025 (Bali 🏖️)

Due to popular demand, the Eval4NLP workshop @ AACL 2025 submission deadline has been moved to September 1. We look forward to your submissions! 📣📣 More infos: eval4nlp.github.io

Round #2 of DALLE images, using requests from y'all. Here's two animals mixed together into a new species.

📢📢 Don't forget: Pre-reviewed papers can be submitted to Eval4NLP AACL 2025 until September 25 via Openreview Just include the paper and your meta-reviews along with reviews and all the scores. eval4nlp.github.io

📢📢To accommodate the recent ARR author response period, Eval4NLP AACL 2025 extends the deadline for pre-reviewed papers until September 30th. Pre-reviewed papers must include: the paper along with its original reviews and scores. More details: eval4nlp.github.io

Our accepted papers and program are now online: eval4nlp.github.io/2023/program.h… eval4nlp.github.io/2023/accepted-… Moreover, we're excited to have Alex Fabbri as invited speaker on the topic of "Re-Evaluating Summarization Evaluation in the Era of LLMs" See u tomorrow 9am (UTC+8), online only!

Eval4NLP23 has concluded. We thank everyone + congratulate our shared task winners on inducing high-quality metrics for MT+summ. using prompting and efficient models: "HIT-MI&T Lab" (even beating GEMBA + COMET🚀) & "DSBA". Shared task overview paper: arxiv.org/pdf/2310.19792…

📢📢👉👉@chrleiter presenting his work on how explainability can improve evaluation metrics for MT and summarization tomorrow at #eacl2024 x.com/ChrLeiter/stat…

📢📢📢The NLLG lab has three new open fully funded PhD positions: 1⃣ - Next Generation LLMs 2⃣ - NLP for Science 3⃣ - Multimodal evaluation metrics Deadlines: End of October ℹ️More information: nl2g.github.io/positions

Two more days left to apply 👇👇 x.com/NLLG_lab/statu…

📢📢 This year Eval4NLP is co-located with #aacl2025. Our CFP is now out: eval4nlp.github.io/2025/cfp.html Paper submission deadline: September 29, 2025. Direct submission via OpenReview. ARR commitment deadline: October 27, 2025 Notification of acceptance: November 3, 2025