We are committed to supporting the academic research community by amplifying emerging leaders and their cutting-edge machine learning research. Learn more about the 2024 Apple Scholars in AIML PhD fellowship program here: machinelearning.apple.com/updates/apple-…

We're looking for a final-year PhD intern passionate about working on automatic metrics for machine translation and NLP in Mountain View. If interested, please send an email to me and Dan Deutsch. The ideal candidate should have experience working on automatic evaluation and

Help us break LLMs! The test suite sub-task will be included for the sixth time in the General MT Shared Task of the Conference on Machine Translation (WMT24). This year's theme is to reveal weaknesses of LLMs when translating #LLMs #EMNLP #NLProc| www2.statmt.org/wmt24/testsuit…

Excuse me internet, we now have a German adaptation of aphasiatherapyonline.com/de thanks to Lena Werner, Dorothea Peitz and Katja Hußmann 🇩🇪🥳 This provides a free option to *self manage* therapy tasks for German speakers with #aphasia

Would not have been possible without the wonderful work by John E Pierce Thanks so much!

Big achievement and an important milestone! 🏆 Happy to see that my wife’s work on the success rate of intensive #aphasia therapy has been finally published in the Journal of Neurology! 🧠 Congratulations! 🚀

🚀 How accurately can automatic metrics evaluate the best MT systems and cutting-edge LLM translations? 🌟 🔥 WMT24 Metrics Shared Task Alert: This year's challenge is all about pushing the boundaries of automatic metrics! 🎯 Your mission: assign quality scores to all WMT

Exciting times to join Apple for AI/ML! machinelearning.apple.com/research/intro…

📢 WMT24 Metric Shared Task Starts NOW! 🎉 Calling all researchers and metrics enthusiasts! We invite you to submit your best evaluation metrics to the WMT Metric Shared Task. Assign quality scores to all WMT submissions and translations by top LLMs like Gemini, GPT4o, Claude,

I will soon be hiring PhDs/postdocs for a new university lab in Germany! If you have strong CL/NLP skills and are interested in modeling implicit/underspecified language, misunderstandings, or commonsense vs. individual background knowledge, let's connect. Please DM me or RT! :)

🥳 LLMs are changing the game, even for datasets! NewsPaLM, a publicly released LLM-generated dataset, outperforms larger web-crawled corpora for MT. It includes sentence & paragraph-level, MBR-decoded data. See paper for more, incl. LLM self-distillation. arxiv.org/abs/2408.06537

Great to see the Translation API in action!

Don't believe the numbers until you are able to reproduce them!

A new 🆕 approach from Google mimics the human translation process, incorporating research, 🧐 drafting, ✍️ and iterative 🔄 refinement in the #LLM translation process and promises better #translation quality. #xl8 #t9n Eleftheria Briakou Colin Cherry Markus Freitag slator.com/google-aligns-…

Have you recently used COMET for MT evaluation? ☄️ - Did you report the specific model? ≥12% of papers don't! - Did you report the package version? Makes a difference. - `pip install sacrecomet` generates a nice version+model signature. Not too late for WMT/EMNLP camera-ready!

I'm very excited to share this great example of applied research: machinelearning.apple.com/research/gener… Research (arxiv.org/abs/2407.20438 with data github.com/apple/ml-gende…) applied in our product (apps.apple.com/de/app/transla…) Congrats to the team!

Work with us! #nlproc #llm #neuralempty jobs.apple.com/en-us/details/…

The Microsoft Translator group is looking for a Ph.D. student intern this summer to work with us in Redmond on machine translation. The application link can be found at aka.ms/mtintern. Please share if you know of someone who might be interested!

Overcoming Vocabulary Constraints with Pixel-level Fallback. arxiv.org/abs/2504.02122

Happy to share that our work on evaluating tokenizers has been accepted to #ACL2025! This is one of two projects I worked on during my internship Apple.