EleutherAI (@aieleuther) 's Twitter Profile
EleutherAI

@aieleuther

A non-profit research lab focused on interpretability, alignment, and ethics of artificial intelligence.

Creators of GPT-J, GPT-NeoX, Pythia, and VQGAN-CLIP

ID: 1561918448766173185

linkhttp://www.eleuther.ai calendar_today23-08-2022 03:29:21

690 Tweet

20,20K Followers

77 Following

EleutherAI (@aieleuther) 's Twitter Profile Photo
EleutherAI
@aieleuther

4 months ago

Excited to share our new paper, Lessons From The Trenches on Reproducible Evaluation of Language Models! In it, we discuss common challenges we’ve faced evaluating LMs, and how our library the Evaluation Harness is designed to mitigate them 🧵 arxiv.org/abs/2405.14782

Excited to share our new paper, Lessons From The Trenches on Reproducible Evaluation of Language Models! In it, we discuss common challenges we’ve faced evaluating LMs, and how our library the Evaluation Harness is designed to mitigate them 🧵 arxiv.org/abs/2405.14782