deepseek-ai/DeepInfer

What DeepInfer is

DeepInfer is the high-performance inference framework that powers DeepSeek's large-scale production services. This open-source release provides offline inference with the core features needed for serving at scale.

From the repository README · read it on GitHub →