Hugging Face's logo

QuantTrio
Team
community
Activity Feed

AI & ML interests

We're a trio of AI enthusiasts who create LLM quantization models (GPTQ, WNA16) in our spare time. We bridge ModelScope and Hugging Face by porting our quantized models to make efficient AI more accessible globally.

Recent Activity
JunHowie  new activity about 3 hours ago
QuantTrio/GLM-5.2-Int4-Int8Mix:GLM-5.2-Int4-Int8Mix generates only "!!!!!" on H100 8×80GB with vLLM 0.23.0/0.24.0 — IndexShare sparse indexer K-cache never populated during prefill
tclf90  new activity 6 days ago
QuantTrio/GLM-5.2-Int4-Int8Mix:AWQ 4bit
JunHowie  new activity 6 days ago
QuantTrio/GLM-5.2-Int4-Int8Mix:Any chances for A100?
View all activity
JunHowie 
in QuantTrio/GLM-5.2-Int4-Int8Mix about 3 hours ago

GLM-5.2-Int4-Int8Mix generates only "!!!!!" on H100 8×80GB with vLLM 0.23.0/0.24.0 — IndexShare sparse indexer K-cache never populated during prefill

1
#3 opened about 5 hours ago by
kinggenguo
tclf90 
in QuantTrio/GLM-5.2-Int4-Int8Mix 6 days ago

AWQ 4bit

2
#2 opened 6 days ago by
MatthieuZ
JunHowie 
in QuantTrio/GLM-5.2-Int4-Int8Mix 6 days ago

Any chances for A100?

4
#1 opened 6 days ago by
traphix
JunHowie 
updated a model 7 days ago
JunHowie 
published a model 7 days ago
JunHowie 
published a model 8 days ago
JunHowie 
updated a model 8 days ago
JunHowie 
in QuantTrio/GLM-5.1-AWQ 8 days ago

GLM-5.2-AWQ

1
#2 opened 14 days ago by
ag1988
tclf90 
in QuantTrio/GLM-4.7-AWQ about 1 month ago

Revert remplate
#8 opened about 2 months ago by
s-yanev
tclf90 
in QuantTrio/GLM-4.7-AWQ about 2 months ago

Support for structured output
#7 opened about 2 months ago by
s-yanev
tclf90 
in QuantTrio/DeepSeek-V3.1-AWQ-Lite about 2 months ago

Fix chat_template crash when assistant message omits the `content` key
#5 opened about 2 months ago by
qgallouedec
tclf90 
in QuantTrio/DeepSeek-V3.2-Exp-AWQ about 2 months ago

Fix chat_template crash when assistant message omits the `content` key
#4 opened about 2 months ago by
qgallouedec
tclf90 
in QuantTrio/DeepSeek-V3.1-AWQ about 2 months ago

Fix chat_template crash when assistant message omits the `content` key
#5 opened about 2 months ago by
qgallouedec
tclf90 
updated a collection 2 months ago
JunHowie 
updated 2 models 2 months ago
JunHowie 
published 2 models 2 months ago