Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

226

Base only

Active filters: vLLM

Xingyu-Zheng/Qwopus3.5-27B-v3.5-INT8-FOEM

Image-Text-to-Text • 27B • Updated Apr 17 • 12

Xingyu-Zheng/Qwopus3.5-9B-v3.5-INT4-FOEM

Image-Text-to-Text • 9B • Updated Apr 17 • 10 • 1

Xingyu-Zheng/Qwopus3.5-9B-v3.5-INT8-FOEM

Image-Text-to-Text • 9B • Updated Apr 17 • 10

Explyt/GLM-5-AWQ-pruned-20

Text Generation • 609B • Updated Apr 17 • 15

QuantTrio/MiniMax-M2.7-AWQ

Text Generation • 229B • Updated Apr 20 • 7.47k • 8

ClaudioItaly/Qwopus3.5-9B-v3-INT8-FOEM-Q4_K_M-GGUF

Image-Text-to-Text • 9B • Updated Apr 20 • 5

QuantTrio/GLM-5.1-AWQ

Text Generation • 754B • Updated Apr 21 • 360 • 9

selode-ai/Qwen-3.6-35B-A3B-VRAP-4-bit-AWQ-21.2GB

Image-Text-to-Text • 29B • Updated Jun 16 • 25.2k • 16

Explyt/GLM-5.1-AWQ

Text Generation • 754B • Updated Jun 24 • 18 • 1

QuantTrio/Qwen3.6-27B-AWQ

Image-Text-to-Text • 28B • Updated Apr 23 • 774k • 24

QuantTrio/Qwen3.6-27B-AWQ-6Bit

Image-Text-to-Text • 28B • Updated Apr 23 • 27.7k • 17

Xingyu-Zheng/Qwen3.6-27B-INT8-FOEM

Image-Text-to-Text • 27B • Updated Apr 24 • 10

Xingyu-Zheng/Qwen3.6-27B-INT4-FOEM

Image-Text-to-Text • 27B • Updated Apr 24 • 16

axolotl-ai-co/Mistral-Medium-3.5-128B-BF16

128B • Updated Apr 24 • 108

Xingyu-Zheng/Qwopus3.6-27B-v1-preview-INT4-FOEM

Image-Text-to-Text • 27B • Updated May 15 • 7 • 1

Xingyu-Zheng/Qwopus3.6-27B-v1-preview-INT8-FOEM

Image-Text-to-Text • 27B • Updated Apr 27 • 7 • 1

mistralai/Mistral-Medium-3.5-128B-EAGLE

Updated Apr 30 • 308 • 57

bartowski/mistralai_Mistral-Medium-3.5-128B-GGUF

Image-Text-to-Text • 125B • Updated May 4 • 4.55k • 10

NeuralNotwerk/Mistral-Medium-3.5-128B-NVFP4

74B • Updated May 9 • 673 • 10

olka-fi/Mistral-Medium-3.5-128B-MXFP4

Text Generation • 128B • Updated May 2 • 85 • 2

naruonenime/Mistral-Medium-3.5-128B

128B • Updated May 4 • 6

cyankiwi/Mistral-Medium-3.5-128B-AWQ-INT4

25B • Updated Jul 21 • 883 • 4

mradermacher/Mistral-Medium-3.5-128B-GGUF

125B • Updated May 9 • 246 • 1

Sav868767876-9999999876654346/Mistral-Medium-3.5-128B

128B • Updated May 8 • 10

mradermacher/Mistral-Medium-3.5-128B-i1-GGUF

125B • Updated May 9 • 350

clemsail/qwen3.5-27b-opus-awq

Image-Text-to-Text • 28B • Updated May 11 • 5

gsting/Qwen3-VL-235B-A22B-Instruct-AWQ

Text Generation • 236B • Updated May 12 • 12

tema18/Mistral-Medium-3.5-128B

128B • Updated May 17 • 4

inferencerlabs/Mistral-Medium-3.5-MLX-Q9

Image-Text-to-Text • Updated Jun 27 • 257 • 1

Flaxyditto/FlaxyDitto-Bot

Text Generation • 7B • Updated May 23 • 7