Mamba3 just silently dropped on ICLR🤯 A faster, longer-context, and more scalable LLM architecture than Transformers A few years ago, some researchers started rethinking sequence modeling from a different angle. Instead of stacking more attention layers, they went back to an

Check 4️⃣

RoPE vs NoPE in hybrid linear attention models like Kimi Linear / Qwen3Next is tricky for example, when using NoPE, we found that slowly expanding the window size of the attention layers during training (64->4k) greatly helps convergence:

Today is the day. Parlez-vous finance en français dans le texte? Dragon LLM (ex Lingua Custodia) releases its fine tuned models for french finance. Stay tuned.

🥳 #Adopt_AI - Grand Palais is rapidly approaching! Iconic event at an iconic venue! 😍 We'll be at booth F6—we'd love to see you there! 🤗 📅 25-26 November 🗺️ The Grand Palais, Paris 🥖 👉 adoptai.artefact.com/partner/ac083f…

We can only agree with Christine Lagarde latest speech on EU risk of lagging on #AI. As Andreea Niculcea puts it (c) , "We become users of someone else’s models, someone else’s compute, someone else’s innovation — with our margins squeezed and our clients drifting to whoever offers