Fabian Heller

Ununnilium's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in Intel/Mistral-Small-3.2-24B-Instruct-2506-int4-AutoRound 4 months ago

Works good with vLLM, just no tool calling

1

#1 opened 4 months ago by

Ununnilium

New activity in QuantTrio/GLM-4.5-AWQ 4 months ago

How many GPU Memory AWQ need?

5

#1 opened 4 months ago by

hermitg

Does it possible to create a version without MTP layer to save some VRAM

👍 1

1

#3 opened 4 months ago by

adonishong