TheBloke/deepseek-coder-1.3b-instruct-GGUF at refs/pr/5

deepseek-coder-1.3b-instruct-GGUF

10.7 GB

1 contributor

History: 46 commits

ghazab123

Rename deepseek-coder-1.3b-instruct.Q8_0.gguf to deepseek-coder-1.3b-instruct.Q2.gguf

b4a5367 verified about 1 month ago

.gitattributes

2.51 kB

Rename deepseek-coder-1.3b-instruct.Q8_0.gguf to deepseek-coder-1.3b-instruct.Q2.gguf about 1 month ago
README.md

21.3 kB

Upload README.md about 2 years ago
config.json

32 Bytes

GGUF model commit (made with llama.cpp commit 3d48f42) about 2 years ago
deepseek-coder-1.3b-instruct.Q2.gguf

1.43 GB
xet

Rename deepseek-coder-1.3b-instruct.Q8_0.gguf to deepseek-coder-1.3b-instruct.Q2.gguf about 1 month ago
deepseek-coder-1.3b-instruct.Q2_K.gguf

632 MB
xet

GGUF model commit (made with llama.cpp commit bb60fd0) about 2 years ago
deepseek-coder-1.3b-instruct.Q3_K_L.gguf

745 MB
xet

GGUF model commit (made with llama.cpp commit bb60fd0) about 2 years ago
deepseek-coder-1.3b-instruct.Q3_K_M.gguf

705 MB
xet

GGUF model commit (made with llama.cpp commit bb60fd0) about 2 years ago
deepseek-coder-1.3b-instruct.Q3_K_S.gguf

659 MB
xet

GGUF model commit (made with llama.cpp commit bb60fd0) about 2 years ago
deepseek-coder-1.3b-instruct.Q4_0.gguf

776 MB
xet

GGUF model commit (made with llama.cpp commit bb60fd0) about 2 years ago
deepseek-coder-1.3b-instruct.Q4_K_M.gguf

874 MB
xet

GGUF model commit (made with llama.cpp commit bb60fd0) about 2 years ago
deepseek-coder-1.3b-instruct.Q4_K_S.gguf

815 MB
xet

GGUF model commit (made with llama.cpp commit bb60fd0) about 2 years ago
deepseek-coder-1.3b-instruct.Q5_0.gguf

936 MB
xet

GGUF model commit (made with llama.cpp commit bb60fd0) about 2 years ago
deepseek-coder-1.3b-instruct.Q5_K_M.gguf

1 GB
xet

GGUF model commit (made with llama.cpp commit bb60fd0) about 2 years ago
deepseek-coder-1.3b-instruct.Q5_K_S.gguf

953 MB
xet

GGUF model commit (made with llama.cpp commit bb60fd0) about 2 years ago
deepseek-coder-1.3b-instruct.Q6_K.gguf

1.17 GB
xet

GGUF model commit (made with llama.cpp commit bb60fd0) about 2 years ago