cmarkea/Meta-Llama-3.1-70B-Instruct-4bit
Text Generation
•
73B
•
Updated
•
23
•
1
Quantized 4-bit models
Large model quantized with post-quantization performance very close to the original models, allowing it to run on reasonable infrastructure.
-
-
cmarkea/Mixtral-8x7B-Instruct-v0.1-4bit
Text Generation • 48B • Updated • 27 • 2 -
cmarkea/Qwen2.5-32B-Instruct-4bit
Text Generation • 34B • Updated • 14 • 3 -
cmarkea/CodeLlama-70b-hf-4bit
Text Generation • 71B • Updated • 14 • 1 -
cmarkea/CodeLlama-70b-Instruct-hf-4bit
Text Generation • 71B • Updated • 16 • 1 -
cmarkea/CodeLlama-34b-hf-4bit
Text Generation • 35B • Updated • 19 • 1 -
cmarkea/CodeLlama-34b-Instruct-hf-4bit
Text Generation • 35B • Updated • 12 • 1 -
cmarkea/CodeLlama-7b-hf-4bit
Text Generation • 7B • Updated • 10 • 2 -
cmarkea/Qwen2.5-Coder-7B-Instruct-4bit
Text Generation • 8B • Updated • 21 • 2