Axolotl (@axolotl_ai) 's Twitter Profile
Axolotl

@axolotl_ai

Axolotl is the premier open source LLM fine tuning framework. find us on discord discord.gg/cq8QGrh9mC

ID: 1733513286052720640

calendar_today09-12-2023 15:46:24

52 Tweet

1,1K Takipçi

20 Takip Edilen

Axolotl (@axolotl_ai) 's Twitter Profile Photo

🚀 Async-RL is now available with Nous Research Atropos and Axolotl! We've created a plugin for tighter RL iterations that leverages Atropos' optimized asynchronous rollouts. Check out the plugin and get started: github.com/axolotl-ai-clo…

Tanishq Mathew Abraham, Ph.D. (@iscienceluvr) 's Twitter Profile Photo

Model Merging in Pre-training of Large Language Models "We present the Pre-trained Model Averaging (PMA) strategy, a novel framework for model merging during LLM pre-training. Through extensive experiments across model scales (from millions to over 100B parameters), we

Model Merging in Pre-training of Large Language Models

"We present the Pre-trained Model Averaging (PMA) strategy, a novel framework for model merging during LLM pre-training. Through extensive experiments across model scales (from millions to over 100B parameters), we
RunPod (@runpod_io) 's Twitter Profile Photo

Spot the runpod truck in sf and get $250 in gpu credits Snap a pic + tag Runpod and we'll send you a credit code 🤝 Hint: it's right by AI Engineer

Spot the runpod truck in sf and get $250 in gpu credits

Snap a pic + tag <a href="/runpod_io/">Runpod</a> and we'll send you a credit code 🤝

Hint: it's right by <a href="/aiDotEngineer/">AI Engineer</a>
Sophia Yang, Ph.D. (@sophiamyang) 's Twitter Profile Photo

Mistral AI 64 comrades airship cooperative Magistral Small is an open-weight model, and is available for self-deployment under the Apache 2.0 license. You can use it with the following frameworks: - vllm (recommended): huggingface.co/mistralai/Magi… The community has prepared quantized versions of the model that can be used

Koyeb (@gokoyeb) 's Twitter Profile Photo

Looking to fine-tune models? Meet Axolotl 💚 an open-source tool that simplifies the entire fine-tuning pipeline. Learn how to get started with our tutorial covering how to fine-tune Llama 3 🦙 koyeb.com/tutorials/usin…