MoE

Cohere reportedly released North Small Translate, a 218B-parameter MoE model for 50-plus languages, with performance claims still needing verification.

NVIDIA has released Nemotron 3 Super, an open hybrid Mamba-Transformer Mixture-of-Experts model optimized for agentic reasoning tasks, offering strong performance at reduced inference cost.