lilyanatia
/

Bonsai-8B-requantized

Model card Files Files and versions

requantized Bonsai-8B for software that doesn't support Q1_0 quantization.

Downloads last month: 9,506

GGUF

Model size

8B params

Architecture

qwen3

Hardware compatibility

Log In to add your hardware

1-bit

2-bit

View +1 variant

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for lilyanatia/Bonsai-8B-requantized

Base model

prism-ml/Bonsai-8B-unpacked

Quantized

prism-ml/Bonsai-8B-gguf

Quantized

(1)

this model

Space using lilyanatia/Bonsai-8B-requantized 1

Collection including lilyanatia/Bonsai-8B-requantized

Bonsai requantized

requantized Bonsai for software that doesn't support Q1_0 quantization. • 3 items • Updated about 21 hours ago • 2