We don't talk enough about where our human data is coming from - our new preprint hopes to peel back that mystery!

Human feedback is a key component for improving the capabilities and safety of AI models but it’s currently concentrated in a few companies. We want to change this, so we’ve outlined a vision for creating an ecosystem for sharing and collaborating on open human feedback data👇🏼

Outline of a vision for creating an ecosystem of collective open human feedback data👇🏼

This is the one paper to read if you care about human input into AI systems. You know who else agrees we have to collect and leverage human feedback in open source AI? That's right Yann LeCun and definitely Soumith Chintala

One thing I've learnt from Ramon Astudillo model releases RLHF multiple times! We can't even train once on open data...

One thing I didn't really think about before this, when I talk to a model and it generates an image, the image is mine. Why isn't it the case when it is text? Well, isn't it? t\h Ramon Astudillo Yangsibo Huang others