Craig Stewart (@_craig_stewart_) 's Twitter Profile
Craig Stewart

@_craig_stewart_

Research Scientist @Unbabel, developing COMET and doing all sorts of other MT evaluation related stuff

COMET: github.com/Unbabel/COMET

ID: 1350076366289514496

calendar_today15-01-2021 13:44:35

30 Tweet

54 Takipçi

55 Takip Edilen

Nitika Mathur (@probablynitika) 's Twitter Profile Photo

We are planning to incorporate significant changes in the upcoming WMT 2021 metrics task. We want to share our plans with the community and give everyone the chance to request additional changes. We plan to change the following when compared the previous WMT metric tasks: (1/n)

Matt Post (@mjpost) 's Twitter Profile Photo

Our approach is to replace the standard (subword-segmented text) embeddings with "visual text" embeddings, computed from a rendered image of the raw text that is sliced into overlapping, horizontal windows, akin to ASR.

Our approach is to replace the standard (subword-segmented text) embeddings with "visual text" embeddings, computed from a rendered image of the raw text that is sliced into overlapping, horizontal windows, akin to ASR.
Markus Freitag (@markuseful) 's Twitter Profile Photo

Happy to announce our most recent paper: Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation arxiv.org/abs/2104.14478 - We re-evaluated the outputs from WMT20 using in-context MQM annotations from professional translators.

Happy to announce our most recent paper: Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation arxiv.org/abs/2104.14478 - We
re-evaluated the outputs from WMT20 using in-context MQM annotations from professional translators.
Kayo Yin (@kayo_yin) 's Twitter Profile Photo

Why should you, as an NLP researcher, work on signed languages? Our upcoming #ACL2021NLP paper (w/ Amit Moryossef @jahochcam (((ل()(ل() 'yoav))))👾 Malihe Alikhani) is a call-to-action for the NLP community to include signed languages, and explains how to do so 🤟[1/7] arxiv.org/abs/2105.05222

Why should you, as an NLP researcher, work on signed languages?

Our upcoming #ACL2021NLP paper (w/ <a href="/amitmoryossef/">Amit Moryossef</a> @jahochcam <a href="/yoavgo/">(((ل()(ل() 'yoav))))👾</a> <a href="/malihealikhani/">Malihe Alikhani</a>) is a call-to-action for the NLP community to include signed languages, and explains how to do so 🤟[1/7]

arxiv.org/abs/2105.05222
Graham Neubig (@gneubig) 's Twitter Profile Photo

One important thing I'd like everyone that is using NLP to know is that when someone releases a wonderful new model that supports 100 languages, that doesn't mean that it works on 100 languages.

Craig Stewart (@_craig_stewart_) 's Twitter Profile Photo

Nice paper from @KocmiTom et al at Microsoft recommending the use of #COMET to evaluate MT over metrics like BLEU: arxiv.org/pdf/2107.10821… github.com/Unbabel/COMET

Markus Freitag (@markuseful) 's Twitter Profile Photo

To jump on the hype of great new metric papers: Consider submitting to this year's WMT21 metric task: statmt.org/wmt21/metrics-…

ParaCrawl (@paracrawl) 's Twitter Profile Photo

Summer was for work! Now #ParaCrawl v9 corpora are done and again bigger than the previous ones!🤩 Extrinsic evaluation through MT almost finished and, according to old BLEU and new COMET, the quality of the MT output improves! 🥳 We will share corpora and more results soon!🕑

Unbabel (@unbabel) 's Twitter Profile Photo

We are thrilled to announce that Unbabel is #acquiring @Lingo24! 🎉 Learn how our combined forces will provide more consistent, high-quality #multilingual customer experiences across marketing and customer service channels. hubs.li/Q010XTsl0

Unbabel (@unbabel) 's Twitter Profile Photo

#CX is changing rapidly, so our CEO Vasco Pedro shares his top 4 predictions for #CustomerExperience in 2022, on CustomerThink. 🎱 Empathy at scale, the merge of #customerservice and #marketing, and #ResponsibleAI are all going to be key this year.👇 customerthink.com/4-predictions-…

Andre Martins (@andre_t_martins) 's Twitter Profile Photo

Working on a model but not sure if your random variables should be discrete or continuous? Try something in-between! Check out our new #ICLR2022 paper for the information theory of mixed variables. Bonus: Gaussian-sparsemax (the sparsemax counterpart of the logistic-normal)!

Working on a model but not sure if your random variables should be discrete or continuous? Try something in-between! Check out our new #ICLR2022 paper for the information theory of mixed variables. Bonus: Gaussian-sparsemax (the sparsemax counterpart of the logistic-normal)!
Markus Freitag (@markuseful) 's Twitter Profile Photo

Happy to announce the WMT22 Metrics Shared Task: We are (again) planning to incorporate significant changes like (a) better human evaluation and (b) 3 new subtasks! (1/n)

EAMT2024 (@eamt_2024) 's Twitter Profile Photo

Day 3! A final day with many interesting talks, a keynote by Laura Rossi, and another poster session. Unbabel starting with a talk on MT in customer support and the impact of agent and user-generated content.

Day 3! A final day with many interesting talks, a keynote by Laura Rossi, and another poster session. <a href="/Unbabel/">Unbabel</a> starting with a talk on MT in customer support and the impact of agent and user-generated content.