diffbot/DeepSeek-V4.1-Flash-EXL3-3bpw-2x-RTX-PRO-6000 at main

DeepSeek-V4.1-Flash-EXL3-3bpw-2x-RTX-PRO-6000

346 GB

Ctrl+K

1 contributor

History: 24 commits

miketung

Tool namespaces and thinking precedence in the DS4.1 renderer (v41-namespaces-thinking.diff)

451f7dc verified 6 days ago

docs
Tool namespaces and thinking precedence in the DS4.1 renderer (v41-namespaces-thinking.diff) 6 days ago
drafter-code-fp8
Add the code-tuned DSpark head in DeepSeek's original format (drafter-code-fp8/) 7 days ago
drafter-code-k7
drafter-code-k7: correct the changed-tensor split (65 weights + 25 FP8 scales) 7 days ago
encoding
DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
inference
DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
recipe
Tool namespaces and thinking precedence in the DS4.1 renderer (v41-namespaces-thinking.diff) 6 days ago
.gitattributes

1.86 kB
Add files using upload-large-folder tool about 2 months ago
LICENSE

1.08 kB
Add files using upload-large-folder tool about 2 months ago
README.md

8.65 kB
Model card: list drafter-code-fp8/ in the files table 7 days ago
config.json

4.67 kB
DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00001-of-00048.safetensors

971 MB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00002-of-00048.safetensors

1.32 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00003-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00004-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00005-of-00048.safetensors

5.3 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00006-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00007-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00008-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00009-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00010-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00011-of-00048.safetensors

5.3 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00012-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00013-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00014-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00015-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00016-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00017-of-00048.safetensors

5.3 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00018-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00019-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00020-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00021-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00022-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00023-of-00048.safetensors

5.29 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00024-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00025-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00026-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00027-of-00048.safetensors

5.29 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00028-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00029-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00030-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00031-of-00048.safetensors

5.29 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00032-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00033-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00034-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00035-of-00048.safetensors

5.29 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00036-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00037-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00038-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00039-of-00048.safetensors

5.29 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago
model-00040-of-00048.safetensors

5.28 GB
xet

DeepSeek-V4.1-Flash-1017: our calibrated EXL3 3-bit experts, int4 Engram, EXL3 drafter; recipe with VRAM cache for host experts, optional CPU host experts, new MoE kernels, vLLM #62196 encoder 11 days ago