Update README.md
Browse files
README.md
CHANGED
|
@@ -5,9 +5,9 @@ base_model:
|
|
| 5 |
pipeline_tag: text-generation
|
| 6 |
---
|
| 7 |
|
| 8 |
-
# zletpm/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-4.5bit
|
| 9 |
|
| 10 |
-
This model [zletpm/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-4.5bit](https://huggingface.co/mlx-community/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-4.5bit) was
|
| 11 |
converted to MLX format from [anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only](https://huggingface.co/anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only)
|
| 12 |
using mlx-lm version **0.25.2**.
|
| 13 |
|
|
@@ -20,7 +20,7 @@ pip install mlx-lm
|
|
| 20 |
```python
|
| 21 |
from mlx_lm import load, generate
|
| 22 |
|
| 23 |
-
model, tokenizer = load("zletpm/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-4.5bit")
|
| 24 |
|
| 25 |
prompt = "hello"
|
| 26 |
|
|
|
|
| 5 |
pipeline_tag: text-generation
|
| 6 |
---
|
| 7 |
|
| 8 |
+
# zletpm/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-MLX-4.5bit
|
| 9 |
|
| 10 |
+
This model [zletpm/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-MLX-4.5bit](https://huggingface.co/mlx-community/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-4.5bit) was
|
| 11 |
converted to MLX format from [anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only](https://huggingface.co/anthracite-core/Mistral-Small-3.2-24B-Instruct-2506-Text-Only)
|
| 12 |
using mlx-lm version **0.25.2**.
|
| 13 |
|
|
|
|
| 20 |
```python
|
| 21 |
from mlx_lm import load, generate
|
| 22 |
|
| 23 |
+
model, tokenizer = load("zletpm/Mistral-Small-3.2-24B-Instruct-2506-Text-Only-MLX-4.5bit")
|
| 24 |
|
| 25 |
prompt = "hello"
|
| 26 |
|