Inference Providers
Active filters: aqlm
ISTA-DASLab/Qwen2-72B-AQLM-PV-1bit-1x16
Text Generation
• 12B • Updated • 7
azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16
Text Generation
• 2B • Updated • 12
• 13
ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-1Bit-1x16-hf
Text Generation
• 2B • Updated • 95
• 1
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-1Bit-1x16-hf
Text Generation
• 2B • Updated • 46
• 1
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf
Text Generation
• 2B • Updated • 196
• 8
ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf
Text Generation
• 2B • Updated • 1.38k
• 3
galqiwi/Meta-Llama-3.1-8B-AQLM-2x8g8-NO-TUNE
3B • Updated • 1
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-2x8-hf
Text Generation
• 3B • Updated • 55
• 2
ISTA-DASLab/Mistral-Nemo-Instruct-2407-AQLM-PV-2Bit-1x16-hf
3B • Updated • 4
• 3
ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16
Text Generation
• 11B • Updated • 12
• 18
ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16
Text Generation
• 11B • Updated • 44
• 45
ISTA-DASLab/Llama-3.2-3B-AQLM-PV-2Bit-2x8
Text Generation
• 1B • Updated • 5
ISTA-DASLab/Llama-3.2-1B-AQLM-PV-2Bit-2x8
Text Generation
• 0.5B • Updated • 3
ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8
Text Generation
• 0.5B • Updated • 9
• 1
ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8
Text Generation
• 1B • Updated • 3
Text Generation
• Updated • 2
7B • Updated • 3
Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-1x15
Text Generation
• 1B • Updated • 1
Devy1/CodeLlama-7b-hf-AQLM-3bit-rnd-2x12
Text Generation
• 2B • Updated • 2
Devy1/CodeLlama-7b-hf-AQLM-4bit-rnd-2x15
Text Generation
• 2B • Updated • 2
Devy1/CodeLlama-7b-hf-AQLM-8bit-rnd-4x15
Text Generation
• 4B • Updated • 3
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-rnd-1x15
Text Generation
• 1B • Updated • 1
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-rnd-2x12
Text Generation
• 2B • Updated • 1
Devy1/DeepSeek-Coder-6.7b-base-AQLM-4bit-rnd-2x15
Text Generation
• 2B • Updated • 2
Devy1/DeepSeek-Coder-6.7b-base-AQLM-8bit-rnd-4x15
Text Generation
• 4B • Updated • 5
Devy1/CodeLlama-7b-hf-AQLM-2bit-code-1x15
Text Generation
• 1B • Updated • 3
Devy1/CodeLlama-7b-hf-AQLM-2bit-code-finetuned-1x15
Text Generation
• 1B • Updated • 1
Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-1x15
Text Generation
• 1B • Updated • 3
Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-finetuned-1x15
Text Generation
• 1B • Updated • 1
Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-finetuned-1x15
Text Generation
• 1B • Updated • 4