Meta releases 816B open-weight Muse Spark Open
Meta has published the weights of Muse Spark Open, an 816B-parameter MoE model aimed at coding and agents, and says two 512GB Mac Studios can run it.
MoE architecture News and Analysis
6 verified stories covering MoE architecture, product updates and industry developments.
StepFun open-sources Step 5, a 600B model that runs on 8 GPUs
StepFun released the Step 5 Preview weights on Hugging Face as promised. The 600B MoE model runs in FP8 on a single 8-GPU H200 server.
StepFun Launches Step 5 Preview, Claims Cost 1/8 of Opus 5
StepFun's new Step 5 Preview MoE model claims a top-three open-weight benchmark score and a cost one-eighth of Claude Opus 5, with full weights due October 15.
Kimi K2.6 tops HLE open-source leaderboard
Moonshot AI released the full production-grade Kimi K2.6 model, which scored 54.0 on HLE-Full, surpassing closed-source models Claude Opus 4.6 and GPT-5.4. The 1-trillion-parameter MoE model activates only 32B parameters per inference and supports up to 300 parallel sub-agents.
NVIDIA open-sources Nemotron 3 family and training data
NVIDIA has released the Nemotron 3 series, including model weights, a 3 trillion token pre-training dataset, reinforcement learning pipelines, and evaluation tools, all under open licenses.
Mistral Open-Sources MoE Model: 119B Parameters, Only 6.5B Activated
Mistral released Small 4, a single MoE model that merges three previous standalone models into one deployment, supporting text reasoning, image understanding, code generation, function calling, and JSON output with a 256K context window.