mlx-community/K2-Horizon-MoVA-36B-A4B-bf16

Text Generation • 37B • Updated 8 days ago • 394

Note Unquantized bf16, 70 GB. For 128 GB Macs.

mlx-community/K2-Horizon-MoVA-36B-A4B-8bit

Text Generation • 37B • Updated 8 days ago • 312 • 1

Note 8-bit, 37 GB, effectively lossless (+0.04% ppl).

mlx-community/K2-Horizon-MoVA-36B-A4B-4bit

Text Generation • 37B • Updated 8 days ago • 634 • 3

Note Mixed 4-bit, 25 GB (+1.2% ppl). For 48 GB+ Macs.

mlx-community/K2-Horizon-7B-bf16

Text Generation • 9B • Updated 7 days ago • 415

Note 7B dense, unquantized bf16, 18 GB. For 32 GB+ Macs.

mlx-community/K2-Horizon-7B-8bit

Text Generation • 9B • Updated 7 days ago • 118

Note 7B dense, 8-bit, 9.6 GB, effectively lossless (+0.2% ppl).

mlx-community/K2-Horizon-7B-4bit

Text Generation • 9B • Updated 7 days ago • 206 • 1

Note 7B dense, mixed 4-bit, 7.2 GB (+4.5% ppl). For 16 GB+ Macs.

mlx-community/K2-Horizon-3.7B-bf16

Text Generation • 5B • Updated 7 days ago • 422

Note 3.7B dense, unquantized bf16, 10 GB. For 24 GB+ Macs.

mlx-community/K2-Horizon-3.7B-8bit

Text Generation • 5B • Updated 7 days ago • 96

Note 3.7B dense, 8-bit, 5.4 GB, effectively lossless (-0.04% ppl).

mlx-community/K2-Horizon-3.7B-4bit

Text Generation • 5B • Updated 7 days ago • 195

Note 3.7B dense, mixed 4-bit, 4.2 GB (+4.4% ppl). For 16 GB+ Macs.

mlx-community/K2-Horizon-0.9B-bf16

Text Generation • 1B • Updated 7 days ago • 436

Note 0.9B dense (YaRN, 128K context), unquantized bf16, 2.2 GB.

mlx-community/K2-Horizon-0.9B-8bit

Text Generation • 1B • Updated 7 days ago • 71

Note 0.9B dense, 8-bit, 1.2 GB, effectively lossless (+0.3% ppl).

mlx-community/K2-Horizon-0.9B-4bit

Text Generation • 1B • Updated 7 days ago • 132

Note 0.9B dense, mixed 4-bit, 0.9 GB (+5.6% ppl).