EleutherAI (@aieleuther) 's Twitter Profile
EleutherAI

@aieleuther

A non-profit research lab focused on interpretability, alignment, and ethics of artificial intelligence.

Creators of GPT-J, GPT-NeoX, Pythia, and VQGAN-CLIP

ID: 1561918448766173185

linkhttp://www.eleuther.ai calendar_today23-08-2022 03:29:21

758 Tweet

23,23K Followers

80 Following

arlo_son (@gson_ai) 's Twitter Profile Photo

Our deep-dive case studies show typical AI blind spots: models struggle with long-tail knowledge absent from web data and extremely long contexts; without fully spelled-out derivations, they misinterpret calculations and ignore domain-specific conventions, leading to student-like

Our deep-dive case studies show typical AI blind spots: models struggle with long-tail knowledge absent from web data and extremely long contexts; without fully spelled-out derivations, they misinterpret calculations and ignore domain-specific conventions, leading to student-like
Sebastian Majstorovic (@storytracer) 's Twitter Profile Photo

Common Pile v0.1 is only the beginning. At EleutherAI we will publish open datasets on a regular basis from now on, using the toolkit we launched together with Mozilla to extract high-quality data from openly licensed content: blog.mozilla.org/en/mozilla/ai/…. Stay tuned for more!

Brian Bartoldson (@bartoldson) 's Twitter Profile Photo

Here's a free/gift link to the Washington Post article about training LLMs on openly licensed text: wapo.st/3T94IfQ. x.com/AiEleuther/sta…