Thinking Machines Releases Inkling-Small, Outperforms Larger Model
Thinking Machines Lab's second open-weight model needs a quarter of its predecessor's active parameters yet edges past it on reasoning and coding benchmarks.
Read more →Mixture of Experts (MoE)and AI Research
Every AI News story tagged with both Mixture of Experts (MoE) and AI Research — the two topics side by side, updated as new articles publish.
3 articles
Moonshot AI Unveils Kimi K3, a 2.8-Trillion-Parameter Open Model
China's Moonshot AI released Kimi K3, a 2.8-trillion-parameter open model with a 1-million-token context window — a system the company calls the world's first open 3-trillion-class AI model.
Read more →What Is a Mixture of Experts (MoE) AI Model — and Why It Matters
Mixture of Experts (MoE) lets an AI model hold hundreds of billions of parameters while activating only a fraction of them per query — the main reason some huge models are also cheap to run.
Read more →