Inference Providers
Active filters: aqlm
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-1Bit-1x16-hf
Text Generation
• 2B • Updated • 21
• 1
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf
Text Generation
• 2B • Updated • 34
• 8
ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf
Text Generation
• 2B • Updated • 23
• 3
galqiwi/Meta-Llama-3.1-8B-AQLM-2x8g8-NO-TUNE
3B • Updated • 5
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-2x8-hf
Text Generation
• 3B • Updated • 37
• 2
ISTA-DASLab/Mistral-Nemo-Instruct-2407-AQLM-PV-2Bit-1x16-hf
3B • Updated • 20
• 3
ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16
Text Generation
• 11B • Updated • 71
• 18
ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16
Text Generation
• 11B • Updated • 70
• 45
ISTA-DASLab/Llama-3.2-3B-AQLM-PV-2Bit-2x8
Text Generation
• 1B • Updated • 21
ISTA-DASLab/Llama-3.2-1B-AQLM-PV-2Bit-2x8
Text Generation
• 0.5B • Updated • 29
ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8
Text Generation
• 0.5B • Updated • 23
• 1
ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8
Text Generation
• 1B • Updated • 18
Text Generation
• 0.7B • Updated • 12
7B • Updated • 8
Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-1x15
Text Generation
• 1B • Updated • 7
Devy1/CodeLlama-7b-hf-AQLM-3bit-rnd-2x12
Text Generation
• 2B • Updated • 9
Devy1/CodeLlama-7b-hf-AQLM-4bit-rnd-2x15
Text Generation
• 2B • Updated • 7
Devy1/CodeLlama-7b-hf-AQLM-8bit-rnd-4x15
Text Generation
• 4B • Updated • 7
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-rnd-1x15
Text Generation
• 1B • Updated • 11
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-rnd-2x12
Text Generation
• 2B • Updated • 12
Devy1/DeepSeek-Coder-6.7b-base-AQLM-4bit-rnd-2x15
Text Generation
• 2B • Updated • 9
Devy1/DeepSeek-Coder-6.7b-base-AQLM-8bit-rnd-4x15
Text Generation
• 4B • Updated • 10
Devy1/CodeLlama-7b-hf-AQLM-2bit-code-1x15
Text Generation
• 1B • Updated • 8
Devy1/CodeLlama-7b-hf-AQLM-2bit-code-finetuned-1x15
Text Generation
• 1B • Updated • 7
Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-1x15
Text Generation
• 1B • Updated • 7
Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-finetuned-1x15
Text Generation
• 1B • Updated • 7
Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-finetuned-1x15
Text Generation
• 1B • Updated • 10
Devy1/CodeLlama-7b-hf-AQLM-3bit-code-2x12
Text Generation
• 2B • Updated • 7
Devy1/CodeLlama-7b-hf-AQLM-3bit-code-finetuned-2x12
Text Generation
• 2B • Updated • 7
Devy1/CodeLlama-7b-hf-AQLM-3bit-mixed-2x12
Text Generation
• 2B • Updated • 6