In a Training Loop 🔄

68 1 10

Ton Cao

cpatonn

ton-cao-208032186

AI & ML interests

None yet

Recent Activity

updated a model less than a minute ago

cyankiwi/Ministral-3-14B-Instruct-2512-AWQ-4bit

updated a model 1 minute ago

cyankiwi/Ministral-3-8B-Reasoning-2512-AWQ-8bit

updated a model 2 minutes ago

cyankiwi/Ministral-3-8B-Reasoning-2512-AWQ-4bit

View all activity

Organizations

New activity in cyankiwi/GLM-4.6V-Flash-AWQ-8bit about 1 hour ago

Can't run model with vllm

#1 opened about 3 hours ago by

attashe

New activity in cpatonn/Qwen3-VL-8B-Instruct-AWQ-4bit 1 day ago

What framework was used to quantize Qwen3-VL? Is it llmcompressor?

#1 opened 1 day ago by

qqescac

New activity in cyankiwi/Nemotron-Orchestrator-8B-AWQ-8bit 4 days ago

Unable to run with latest vllm version

#1 opened 6 days ago by

suneetk

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit 13 days ago

vLLM v0.11.1 seems to work, but v0.11.2 fails

👍 ❤️ 2

#3 opened 14 days ago by

stelterlab

New activity in cpatonn/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit 14 days ago

Performance evaluation for v1.0.0 Model

#12 opened 14 days ago by

woodytse

New activity in cpatonn/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit 15 days ago

Successfully Running Qwen3-Next-80B-A3B-Instruct-AWQ-4bit on 3x RTX 3090s

❤️ 🤝 4

#9 opened 2 months ago by

8055izham

New activity in cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit 20 days ago

Model not loading

#8 opened 22 days ago by

nephepritou

New activity in cyankiwi/GLM-4.6-AWQ-4bit 20 days ago

Great quantized model

#1 opened 20 days ago by

CHNtentes

New activity in cyankiwi/MiniMax-M2-REAP-162B-A10B-AWQ-4bit 21 days ago

I have problem with run on latest vllm and 4x 3090

#1 opened 21 days ago by

funny-42

New activity in cpatonn/Qwen3-Omni-30B-A3B-Instruct-AWQ-4bit 22 days ago

How to run awq model with audio output?

#8 opened 22 days ago by

morlz

New activity in cyankiwi/MiniMax-M2-AWQ-4bit 22 days ago

"observer": "mse" could improve accuracy?

#1 opened 22 days ago by

CHNtentes

New activity in cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit 23 days ago

why recently re-uploaded the core?

#7 opened 23 days ago by

Geximus

New activity in cpatonn/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit 25 days ago

Multi token prediction not working

#6 opened 28 days ago by

abhinavkulkarni

New activity in cpatonn/Qwen3-Next-80B-A3B-Instruct-AWQ-4bit 25 days ago

sorta works on vllm now

👍 1

#8 opened 3 months ago by

MrDragonFox

Did anyone get speculative decode working?

👀 1

#10 opened about 2 months ago by

amit864

New activity in cyankiwi/aquif-3.5-Max-42B-A3B-AWQ-4bit 26 days ago

Update thinking=true by default

#1 opened 28 days ago by

pramjana

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit about 1 month ago

Added tool tokens (from original repository)

#2 opened about 1 month ago by

LPN64

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-8bit about 1 month ago

Having trouble running

#1 opened about 1 month ago by

ramendik