mixture of experts

Nvidia open-sources a 30B mixture-of-experts model that activates only 3B parameters yet matches DeepSeek's 671B model on olympiad-level math and coding benchmarks.

Mistral releases Small 4, a 119B-parameter open-weight model under Apache 2.0, and Forge, an enterprise platform for training custom models on proprietary data, as open-weight AI closes to within three months of frontier systems.