We’ll release our first trained model with Stability AI soon. If you want to start tinkering with RLHF now, we’re also helping develop TRLX: github.com/CarperAI/trlx — the open source library for reinforcement learning with transformers.

Excited to see CarperAI releasing diff models! carper.ai/diff-models-a-…

CarperAI is doing great work lowering the barrier for RLHF training (i.e. training ChatGPT-like models). The latest release of their trlX library includes this great example, showing how to train RLHF models at scale with an open-source dataset!

Learn from the best people training large models 🧑‍💻 Join Alex Havrilla from CarperAI Stability AI present trlX, one of the first open source RLHF implementations capable of fine-tuning large language models at scale. 👉 Register here: fullyconnected.com/?utm_source=tw…