TuringPost (@theturingpost) 's Twitter Profile
TuringPost

@theturingpost

Newsletter exploring AI & ML - AI 101 - ML techniques - AI Business insights - Global dynamics - ML History Led by @kseniase_ Save hours of research 👇🏼

ID: 1271482878958940160

linkhttps://www.turingpost.com/subscribe calendar_today12-06-2020 16:42:17

15,15K Tweet

70,70K Followers

12,12K Following

TuringPost (@theturingpost) 's Twitter Profile Photo
TuringPost
@theturingpost

7 months ago

What is Mixture-of-Mamba (MoM)? MoM expands Mixture-of-Experts (MoE) concept on State Space Models SSMs). This development brings a new architecture that can handle all modalities by applying modality-aware sparsity inside the core of the Mamba block. ▪️ What is this

What is Mixture-of-Mamba (MoM)? MoM expands Mixture-of-Experts (MoE) concept on State Space Models SSMs). This development brings a new architecture that can handle all modalities by applying modality-aware sparsity inside the core of the Mamba block. ▪️ What is this