MoE Mamba

Open state-space + Mixture-of-Experts hybrid architecture beating transformers.