Inference Providers
Active filters: vLLM
RohitUltimate/Qwen3.5_VL_2B_12k
Image-Text-to-Text
• 2B • Updated • 159
• 7
mistralai/Mistral-Small-4-119B-2603
119B • Updated • 81.2k
• 354
QuantTrio/Qwen3.5-27B-AWQ
Image-Text-to-Text
• 28B • Updated • 367k
• 41
mistralai/Mistral-Small-4-119B-2603-eagle
Updated • 315
• 46
QuantTrio/Qwopus3.5-27B-v3-AWQ
Image-Text-to-Text
• 27B • Updated • 20.7k
• 9
QuantTrio/gemma-4-31B-it-AWQ
Image-Text-to-Text
• 31B • Updated • 68k
• 6
QuantTrio/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2-AWQ
Image-Text-to-Text
• 28B • Updated • 34.3k
• 12
QuantTrio/gemma-4-31B-it-AWQ-6Bit
Image-Text-to-Text
• 31B • Updated • 9.73k
• 8
JunHowie/Qwen3-4B-Instruct-2507-GPTQ-Int4
Text Generation
• 4B • Updated • 124k
• 3
QuantTrio/Qwen3-VL-30B-A3B-Instruct-AWQ
Text Generation
• 31B • Updated • 769k
• 42
QuantTrio/MiniMax-M2.5-AWQ
Text Generation
• 229B • Updated • 80.7k
• 14
QuantTrio/Qwen3.5-35B-A3B-AWQ
Image-Text-to-Text
• 36B • Updated • 154k
• 17
Image-Text-to-Text
• 5B • Updated • 40.2k
• 8
unsloth/Mistral-Small-4-119B-2603-GGUF
119B • Updated • 35.6k
• 58
Xingyu-Zheng/Qwen3.5-9B-GLM5.1-Distill-v1-INT4-FOEM
Image-Text-to-Text
• 9B • Updated • 1
QuantTrio/Qwopus3.5-27B-v3-AWQ-6Bit
Image-Text-to-Text
• 27B • Updated • 1.72k
• 2
model-scope/glm-4-9b-chat-GPTQ-Int4
Text Generation
• 9B • Updated • 144
• 6
model-scope/glm-4-9b-chat-GPTQ-Int8
Text Generation
• 9B • Updated • 15
• 2
tclf90/qwen2.5-72b-instruct-gptq-int4
Text Generation
• 73B • Updated • 90
• 2
tclf90/qwen2.5-72b-instruct-gptq-int3
Text Generation
• 69B • Updated • 74
prithivMLmods/Nu2-Lupi-Qwen-14B
Text Generation
• 15B • Updated • 6
• 2
mradermacher/Nu2-Lupi-Qwen-14B-GGUF
15B • Updated • 127
• 1
mradermacher/Nu2-Lupi-Qwen-14B-i1-GGUF
15B • Updated • 231
• 1
JunHowie/Qwen3-0.6B-GPTQ-Int4
Text Generation
• 0.6B • Updated • 60
• 1
JunHowie/Qwen3-0.6B-GPTQ-Int8
Text Generation
• 0.6B • Updated • 8
JunHowie/Qwen3-1.7B-GPTQ-Int4
Text Generation
• 2B • Updated • 137
• 1
JunHowie/Qwen3-1.7B-GPTQ-Int8
Text Generation
• 2B • Updated • 12
JunHowie/Qwen3-32B-GPTQ-Int4
Text Generation
• 33B • Updated • 27.9k
• 4
JunHowie/Qwen3-32B-GPTQ-Int8
Text Generation
• 33B • Updated • 233
• 4
JunHowie/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
• 5B • Updated • 6
• 1