DeepInfer: Inference for DeepSeek Models
DeepInfer is DeepSeek’s open-source inference framework for DeepSeek-V4.1-Flash, with parallelism, decoding, and structured-output features. A complete serving stack still requires additional components.
Tag
# model inference
1 post with this tag.