Christian Otto Stelter PRO

stelterlab's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted a collection 27 days ago

Qwen3.6

Collection

4 items • Updated 21 days ago • 333

New activity in nvidia/Nemotron-Cascade-2-30B-A3B about 2 months ago

Add documentation on how to use with vLLM to README.md

🤝👍 6

1

#7 opened about 2 months ago by

stelterlab

published a model about 2 months ago

stelterlab/Nemotron-Cascade-2-30B-A3B-AWQ

Text Generation • 5B • Updated Mar 21 • 2.8k • 1

updated a model about 2 months ago

stelterlab/Nemotron-Cascade-2-30B-A3B-AWQ

Text Generation • 5B • Updated Mar 21 • 2.8k • 1

liked a model 2 months ago

Sehyo/Qwen3.5-35B-A3B-NVFP4

Updated Mar 2 • 30k • 40

New activity in stelterlab/Qwen3-30B-A3B-Instruct-2507-AWQ 2 months ago

Qwen3.5-35B-A3B AWQ quant planned?

2

#1 opened 2 months ago by

amidwestnoob

New activity in RedHatAI/Qwen3.5-397B-A17B-FP8-dynamic 3 months ago

Which transformer version did you use?

#3 opened 3 months ago by

stelterlab

New activity in stelterlab/NVIDIA-Nemotron-3-Nano-30B-A3B-AWQ 3 months ago

tokenizer_config.json missing chat_template field (tool calling broken without workaround)

1

#1 opened 3 months ago by

seanthomaswilliams

Updated tokenizer_config.json now w/ chat_template included

#2 opened 3 months ago by

stelterlab

updated a model 3 months ago

stelterlab/NVIDIA-Nemotron-3-Nano-30B-A3B-AWQ

Text Generation • 5B • Updated Feb 23 • 67.1k • 10

published a model 3 months ago

stelterlab/NVIDIA-Nemotron-3-Nano-30B-A3B-AWQ

Text Generation • 5B • Updated Feb 23 • 67.1k • 10

New activity in mistralai/Ministral-3-14B-Instruct-2512 5 months ago

NVFP4 / AWQ Quants or llm-compressor recipe

🤗 2

1

#1 opened 5 months ago by

stelterlab

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit 6 months ago

vLLM v0.11.1 seems to work, but v0.11.2 fails

👍❤️ 2

9

#3 opened 6 months ago by

stelterlab

New activity in cyankiwi/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit 8 months ago

Error when running in VLLM

👍 2

21

#1 opened 8 months ago by

d8rt8v

liked a model 9 months ago

janhq/Jan-v1-4B-GGUF

Text Generation • 4B • Updated Aug 13, 2025 • 8.53k • 139

updated a model 9 months ago

stelterlab/Qwen3-30B-A3B-Instruct-2507-AWQ

Text Generation • 5B • Updated Aug 2, 2025 • 29.9k

published a model 9 months ago

stelterlab/Qwen3-30B-A3B-Instruct-2507-AWQ

Text Generation • 5B • Updated Aug 2, 2025 • 29.9k

updated a model 9 months ago

stelterlab/Qwen3-Coder-30B-A3B-Instruct-AWQ

Text Generation • 5B • Updated Aug 2, 2025 • 37.4k • 5

New activity in stelterlab/Qwen3-Coder-30B-A3B-Instruct-AWQ 9 months ago

Unable to run the model in VLLM: KeyError: 'layers.14.mlp.gate.qweight'

3

#1 opened 10 months ago by

fredericodeveloper

published a model 10 months ago

stelterlab/Qwen3-Coder-30B-A3B-Instruct-AWQ

Text Generation • 5B • Updated Aug 2, 2025 • 37.4k • 5