Wenting Zhao (@wzhao_nlp) 's Twitter Profile
Wenting Zhao

@wzhao_nlp

PhD student @cornell_tech
NLP + AI

ID: 1473829704

linkhttps://wenting-zhao.github.io/ calendar_today01-06-2013 05:18:16

343 Tweet

1,1K Followers

495 Following

Wenting Zhao (@wzhao_nlp) 's Twitter Profile Photo
Wenting Zhao
@wzhao_nlp

10 months ago

Eval platforms like Chatbot Arena attract users to provide preference votes. But what are the incentives of these users? Are they apathetic, or are they adversarial and just aiming to inflate their model rankings? We show 10% adversarial votes change the model rankings by a lot!

Eval platforms like Chatbot Arena attract users to provide preference votes. But what are the incentives of these users? Are they apathetic, or are they adversarial and just aiming to inflate their model rankings? We show 10% adversarial votes change the model rankings by a lot!