Qwen3 irish-quant/Qwen-Qwen3-8B-8bit 8B • Updated Jul 8, 2025 irish-quant/Qwen-Qwen3-8B-2bit 8B • Updated Jul 8, 2025 • 1 irish-quant/Qwen-Qwen3-8B-3bit 8B • Updated Jul 8, 2025 • 1 irish-quant/Qwen-Qwen3-8B-4bit 8B • Updated Jul 8, 2025
Qwen1.5 irish-quant/Qwen-Qwen1.5-0.5B-Chat-2bit 0.5B • Updated Jun 11, 2025 irish-quant/Qwen-Qwen1.5-0.5B-Chat-4bit 0.5B • Updated Jun 11, 2025 irish-quant/Qwen-Qwen1.5-0.5B-Chat-3bit 0.4B • Updated Jun 11, 2025 irish-quant/Qwen-Qwen1.5-0.5B-Chat-8bit 0.5B • Updated Jun 11, 2025
Phi-3.5 irish-quant/microsoft-Phi-3.5-mini-instruct-8bit 4B • Updated Jun 11, 2025 irish-quant/microsoft-Phi-3.5-mini-instruct-2bit 4B • Updated Jun 11, 2025 irish-quant/microsoft-Phi-3.5-mini-instruct-4bit 4B • Updated Jun 11, 2025 • 2 irish-quant/microsoft-Phi-3.5-mini-instruct-3bit 4B • Updated Jun 11, 2025 • 1
Llama 3.2 irish-quant/meta-llama-Llama-3.2-1B-2bit 1B • Updated Jun 11, 2025 irish-quant/meta-llama-Llama-3.2-1B-3bit 1B • Updated Jun 11, 2025 irish-quant/meta-llama-Llama-3.2-1B-4bit 1B • Updated Jun 11, 2025 • 1 irish-quant/meta-llama-Llama-3.2-1B-8bit 1B • Updated Jun 11, 2025
Llama 3.1 irish-quant/meta-llama-Llama-3.1-8B-3bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Llama-3.1-8B-4bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Llama-3.1-8B-8bit 8B • Updated Jun 11, 2025 • 2 irish-quant/meta-llama-Llama-3.1-8B-2bit 8B • Updated Jun 11, 2025
SmolVLM irish-quant/HuggingFaceTB-SmolLM-1.7B-2bit 2B • Updated Jun 10, 2025 • 1 irish-quant/HuggingFaceTB-SmolLM-1.7B-3bit 2B • Updated Jun 10, 2025 • 1 irish-quant/HuggingFaceTB-SmolLM-1.7B-4bit 2B • Updated Jun 10, 2025 • 1 irish-quant/HuggingFaceTB-SmolLM-1.7B-8bit 2B • Updated Jun 10, 2025 • 1
Google Gemma 3 irish-quant/google-gemma-3-1b-it-4bit 1.0B • Updated Jun 12, 2025 • 1 irish-quant/google-gemma-3-1b-pt-4bit 1.0B • Updated Jun 12, 2025 irish-quant/google-gemma-3-1b-it-8bit 1.0B • Updated Jun 30, 2025 • 1 irish-quant/google-gemma-3-1b-pt-8bit 1.0B • Updated Jun 30, 2025
Yi-1.5 This collection houses GPTQ quants of Yi-1.5 6B and 9B base and chat models. irish-quant/01-ai-Yi-1.5-6B-3bit 6B • Updated Jun 10, 2025 irish-quant/01-ai-Yi-1.5-6B-2bit 6B • Updated Jun 10, 2025 irish-quant/01-ai-Yi-1.5-6B-4bit 6B • Updated Jun 10, 2025 irish-quant/01-ai-Yi-1.5-6B-8bit 6B • Updated Jun 10, 2025 • 1
Qwen2.5 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-2bit 3B • Updated Jun 12, 2025 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-3bit 3B • Updated Jun 12, 2025 • 1 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-4bit 3B • Updated Jun 12, 2025 • 1 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-8bit 3B • Updated Jun 12, 2025
Mistral irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-2bit 24B • Updated Jun 11, 2025 • 1 irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-3bit 22B • Updated Jun 11, 2025 irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-4bit 24B • Updated Jun 11, 2025 • 1 irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-8bit 24B • Updated Jun 11, 2025
Phi-3 irish-quant/microsoft-Phi-3-mini-128k-instruct-2bit 4B • Updated Jun 11, 2025 • 2 irish-quant/microsoft-Phi-3-mini-128k-instruct-4bit 4B • Updated Jun 11, 2025 irish-quant/microsoft-Phi-3-mini-128k-instruct-8bit 4B • Updated Jun 11, 2025 irish-quant/microsoft-Phi-3-mini-128k-instruct-3bit 4B • Updated Jun 11, 2025 • 1
Llama 3 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-2bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-4bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-8bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-3bit 8B • Updated Jun 11, 2025
Llama-Guard-2 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-2bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-3bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-8bit 8B • Updated Jun 11, 2025 • 1 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-4bit 8B • Updated Jun 11, 2025
Google Gemma 2 irish-quant/google-gemma-2-2b-2bit 3B • Updated Jun 12, 2025 irish-quant/google-gemma-2-2b-3bit 2B • Updated Jun 12, 2025 irish-quant/google-gemma-2-2b-4bit 3B • Updated Jun 12, 2025 • 1 irish-quant/google-gemma-2-2b-8bit 3B • Updated Jun 12, 2025
DeepSeek-R1-Distill irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-4bit 71B • Updated Jun 12, 2025 irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-2bit 8B • Updated Jun 12, 2025 irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-3bit 8B • Updated Jun 12, 2025 irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-4bit 8B • Updated Jun 12, 2025
Qwen3 irish-quant/Qwen-Qwen3-8B-8bit 8B • Updated Jul 8, 2025 irish-quant/Qwen-Qwen3-8B-2bit 8B • Updated Jul 8, 2025 • 1 irish-quant/Qwen-Qwen3-8B-3bit 8B • Updated Jul 8, 2025 • 1 irish-quant/Qwen-Qwen3-8B-4bit 8B • Updated Jul 8, 2025
Qwen2.5 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-2bit 3B • Updated Jun 12, 2025 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-3bit 3B • Updated Jun 12, 2025 • 1 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-4bit 3B • Updated Jun 12, 2025 • 1 irish-quant/Qwen-Qwen2.5-Coder-3B-Instruct-8bit 3B • Updated Jun 12, 2025
Qwen1.5 irish-quant/Qwen-Qwen1.5-0.5B-Chat-2bit 0.5B • Updated Jun 11, 2025 irish-quant/Qwen-Qwen1.5-0.5B-Chat-4bit 0.5B • Updated Jun 11, 2025 irish-quant/Qwen-Qwen1.5-0.5B-Chat-3bit 0.4B • Updated Jun 11, 2025 irish-quant/Qwen-Qwen1.5-0.5B-Chat-8bit 0.5B • Updated Jun 11, 2025
Mistral irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-2bit 24B • Updated Jun 11, 2025 • 1 irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-3bit 22B • Updated Jun 11, 2025 irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-4bit 24B • Updated Jun 11, 2025 • 1 irish-quant/mistralai-Mistral-Small-24B-Instruct-2501-8bit 24B • Updated Jun 11, 2025
Phi-3.5 irish-quant/microsoft-Phi-3.5-mini-instruct-8bit 4B • Updated Jun 11, 2025 irish-quant/microsoft-Phi-3.5-mini-instruct-2bit 4B • Updated Jun 11, 2025 irish-quant/microsoft-Phi-3.5-mini-instruct-4bit 4B • Updated Jun 11, 2025 • 2 irish-quant/microsoft-Phi-3.5-mini-instruct-3bit 4B • Updated Jun 11, 2025 • 1
Phi-3 irish-quant/microsoft-Phi-3-mini-128k-instruct-2bit 4B • Updated Jun 11, 2025 • 2 irish-quant/microsoft-Phi-3-mini-128k-instruct-4bit 4B • Updated Jun 11, 2025 irish-quant/microsoft-Phi-3-mini-128k-instruct-8bit 4B • Updated Jun 11, 2025 irish-quant/microsoft-Phi-3-mini-128k-instruct-3bit 4B • Updated Jun 11, 2025 • 1
Llama 3.2 irish-quant/meta-llama-Llama-3.2-1B-2bit 1B • Updated Jun 11, 2025 irish-quant/meta-llama-Llama-3.2-1B-3bit 1B • Updated Jun 11, 2025 irish-quant/meta-llama-Llama-3.2-1B-4bit 1B • Updated Jun 11, 2025 • 1 irish-quant/meta-llama-Llama-3.2-1B-8bit 1B • Updated Jun 11, 2025
Llama 3 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-2bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-4bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-8bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Meta-Llama-3-8B-Instruct-3bit 8B • Updated Jun 11, 2025
Llama 3.1 irish-quant/meta-llama-Llama-3.1-8B-3bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Llama-3.1-8B-4bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Llama-3.1-8B-8bit 8B • Updated Jun 11, 2025 • 2 irish-quant/meta-llama-Llama-3.1-8B-2bit 8B • Updated Jun 11, 2025
Llama-Guard-2 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-2bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-3bit 8B • Updated Jun 11, 2025 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-8bit 8B • Updated Jun 11, 2025 • 1 irish-quant/meta-llama-Meta-Llama-Guard-2-8B-4bit 8B • Updated Jun 11, 2025
SmolVLM irish-quant/HuggingFaceTB-SmolLM-1.7B-2bit 2B • Updated Jun 10, 2025 • 1 irish-quant/HuggingFaceTB-SmolLM-1.7B-3bit 2B • Updated Jun 10, 2025 • 1 irish-quant/HuggingFaceTB-SmolLM-1.7B-4bit 2B • Updated Jun 10, 2025 • 1 irish-quant/HuggingFaceTB-SmolLM-1.7B-8bit 2B • Updated Jun 10, 2025 • 1
Google Gemma 2 irish-quant/google-gemma-2-2b-2bit 3B • Updated Jun 12, 2025 irish-quant/google-gemma-2-2b-3bit 2B • Updated Jun 12, 2025 irish-quant/google-gemma-2-2b-4bit 3B • Updated Jun 12, 2025 • 1 irish-quant/google-gemma-2-2b-8bit 3B • Updated Jun 12, 2025
Google Gemma 3 irish-quant/google-gemma-3-1b-it-4bit 1.0B • Updated Jun 12, 2025 • 1 irish-quant/google-gemma-3-1b-pt-4bit 1.0B • Updated Jun 12, 2025 irish-quant/google-gemma-3-1b-it-8bit 1.0B • Updated Jun 30, 2025 • 1 irish-quant/google-gemma-3-1b-pt-8bit 1.0B • Updated Jun 30, 2025
DeepSeek-R1-Distill irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-70B-4bit 71B • Updated Jun 12, 2025 irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-2bit 8B • Updated Jun 12, 2025 irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-3bit 8B • Updated Jun 12, 2025 irish-quant/deepseek-ai-DeepSeek-R1-Distill-Llama-8B-4bit 8B • Updated Jun 12, 2025
Yi-1.5 This collection houses GPTQ quants of Yi-1.5 6B and 9B base and chat models. irish-quant/01-ai-Yi-1.5-6B-3bit 6B • Updated Jun 10, 2025 irish-quant/01-ai-Yi-1.5-6B-2bit 6B • Updated Jun 10, 2025 irish-quant/01-ai-Yi-1.5-6B-4bit 6B • Updated Jun 10, 2025 irish-quant/01-ai-Yi-1.5-6B-8bit 6B • Updated Jun 10, 2025 • 1
