DeepSeek opens DSpark for faster inference
DeepSeek and Peking University open sourced DSpark, an inference framework that raises generation speed by 60% to 85% and can lift single-GPU throughput as much as 6.6 times.
AI inference News and Analysis
3 verified stories covering AI inference, product updates and industry developments.
Xiaomi MiMo claims 1,000 tokens per second on standard GPUs
Xiaomi MiMo claims 1,000 tokens per second on standard GPUs. The story explains the announcement, the strategic context and the practical risks for the people or companies affected.
Tensormesh raises $20M to cut AI inference waste
Tensormesh discussed $20 million from AMD Ventures, NVentures, CoreWeave, and others to commercialize its KV cache platform that reduces redundant GPU computation in AI inference.