Update README.md
Browse files
README.md
CHANGED
|
@@ -6,6 +6,8 @@ base_model:
|
|
| 6 |
This is the [Qwen/Qwen2.5-VL-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-3B-Instruct) model, converted to OpenVINO, with int4 weights for the language model, int8 weights for the other models.
|
| 7 |
The INT4 weights are compressed with symmetric, channel-wise quantization, with AWQ and scale estimation. The model works on CPU, GPU and NPU. See below for the model export command/properties.
|
| 8 |
|
|
|
|
|
|
|
| 9 |
## Download Model
|
| 10 |
|
| 11 |
To download the model, run `pip install huggingface-hub[cli]` and then:
|
|
|
|
| 6 |
This is the [Qwen/Qwen2.5-VL-3B-Instruct](https://huggingface.co/Qwen/Qwen2.5-VL-3B-Instruct) model, converted to OpenVINO, with int4 weights for the language model, int8 weights for the other models.
|
| 7 |
The INT4 weights are compressed with symmetric, channel-wise quantization, with AWQ and scale estimation. The model works on CPU, GPU and NPU. See below for the model export command/properties.
|
| 8 |
|
| 9 |
+
** This is subject to Qwen Research License **
|
| 10 |
+
|
| 11 |
## Download Model
|
| 12 |
|
| 13 |
To download the model, run `pip install huggingface-hub[cli]` and then:
|