DeepSeek Open-Sources Its Production Inference Engine
DeepSeek released DeepInfer — the in-house inference framework running DeepSeek-V4.1-Flash in production — under Apache 2.0, including natively on both Nvidia Blackwell GPUs and Huawei Ascend 950 NPUs, hardware sitting on opposite sides of US export controls.
- TileLang custom kernels, FlashMLA attention, and confidence-scheduled speculative decoding all included in the release
- Dual-hardware path documents production-grade inference on Huawei Ascend 950 alongside Nvidia SM100, both in the same codebase
- deepseek-recipe tokenization library also released; the full production stack is now effectively open-sourced