Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

edge-deployment

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

172

Base only

Active filters: edge-deployment

nameissakthi/PebbleLM-117M

Text Generation • Updated Jan 23 • 26 • 2

nameissakthi/PebbleLM-117M-Chat

Text Generation • Updated Jan 23 • 20 • 1

OceanirAI/Oculus-0.1

Image-Text-to-Text • Updated Jan 29 • 22 • 2

StentorLabs/Stentor-12M

Text Generation • 12M • Updated Feb 10 • 129 • 1

LetheanNetwork/LEK-Gemma3-4B

Text Generation • 5B • Updated Feb 19 • 13

StentorLabs/Stentor-30M

Text Generation • 30.4M • Updated Feb 21 • 207 • 3

mradermacher/Stentor-30M-GGUF

Text Generation • 30.4M • Updated Feb 21 • 538 • 3

mradermacher/Stentor-30M-i1-GGUF

Text Generation • 30.4M • Updated Feb 21 • 664 • 2

StentorLabs/Stentor-30M-Instruct

Text Generation • 30.4M • Updated Feb 22 • 53 • 1

StentorLabs/Stentor-12M-Instruct

Text Generation • 12M • Updated Feb 22 • 30 • 1

mradermacher/Stentor-30M-Instruct-GGUF

Text Generation • 30.4M • Updated Feb 22 • 352 • 4

Flexan/StentorLabs-Stentor-12M-Instruct-GGUF

Text Generation • 12M • Updated Feb 23 • 152 • 1

hikewa/eisv-lumen-student

mradermacher/Stentor-12M-Instruct-GGUF

Text Generation • 12M • Updated Feb 23 • 122 • 1

StentorLabs/Stentor2-12M-Preview

Text Generation • 12.3M • Updated Feb 25 • 182 • 2

Thejmimiia/blackbird-she-doesnt-refuse-21b

21B • Updated Feb 24 • 24

WayBob/Qwen3VL-8B-4bit-GGUF-Jetson-Deployment

Image-Text-to-Text • 8B • Updated Mar 9 • 32

MihaiPopa-1/Stentor-30M-Instruct-heretic-safety-defiltered

Text Generation • 30.4M • Updated Feb 26 • 58 • 2

StentorLabs/Stentor2-12M

Text Generation • 12.3M • Updated Mar 8 • 29 • 2

forkjoin-ai/qwen2.5-0.5b-instruct-gguf

Text Generation • 0.6B • Updated Jun 7 • 15

forkjoin-ai/qwen2.5-7b-instruct-gguf

Text Generation • 8B • Updated Jul 8 • 57 • 1

forkjoin-ai/qwen3-4b-gguf

Text Generation • 4B • Updated Jun 30 • 27

forkjoin-ai/qwen3-8b-gguf

Text Generation • 8B • Updated Jun 30 • 31

forkjoin-ai/llama-3.2-3b-gguf

Text Generation • 3B • Updated Jun 9 • 4

forkjoin-ai/llama-3.3-70b-instruct-gguf

Text Generation • 71B • Updated Jun 9 • 31

forkjoin-ai/qwen2.5-vl-3b-instruct-gguf

Image-Text-to-Text • 3B • Updated Jun 9 • 39

forkjoin-ai/deepseek-ocr-2

Image-Text-to-Text • 3B • Updated Jun 9 • 18

forkjoin-ai/qwen3-tts-12hz-1.7b-customvoice

Text-to-Audio • 2B • Updated Jun 9 • 20 • 1

forkjoin-ai/qwen3-tts-12hz-1.7b-voicedesign

Text-to-Audio • 2B • Updated Jun 9 • 14

forkjoin-ai/qwen3-tts-12hz-0.6b-base

Text-to-Speech • 0.9B • Updated Jun 7 • 12