1 🚀 Introducing the Future of Language Model Training with Spectrum Continuous Pre-Training! 🌐 Using the innovative Spectrum CPT we targeted only 25% of the model's layers during training. The result: SauerkrautLM-1.5b. A SLM applicable for smartphone and tablet use cases.