Qwen3VL-8B with WORKING coordinates please!
Im using Qwen3VL for computer use
Qwen3VL-4B and 8B including bnb quantised versions are able to give grounding coordinates for clicks.
i was having troiuble weith llama.cpp and exllama inference in that the grounding clicks are off and unusuable for computer use.
I had just about given up and even tried checking the inference code on exllama3 but then i tried
https://huggingface.co/ArtusDev/Qwen_Qwen3-VL-4B-Instruct-EXL3/tree/8.0bpw_H8
And to my surprise, the grounding works!!!
https://huggingface.co/ArtusDev/Qwen_Qwen3-VL-8B-Instruct-EXL3/tree/6.0bpw_H6 is giving off coordinates
im just goign to try https://huggingface.co/ArtusDev/Qwen_Qwen3-VL-8B-Instruct-EXL3/tree/8.0bpw_H8
But please can you fix? wondering if certain layers are particularly sensitive to quatisation?
https://huggingface.co/ArtusDev/Qwen_Qwen3-VL-8B-Instruct-EXL3/tree/8.0bpw_H8 is also a fail for coordinates