Inference Providers
Active filters: aqlm
ISTA-DASLab/Qwen2-72B-AQLM-PV-2bit-1x16
Text Generation
• 12B • Updated • 6
ISTA-DASLab/Qwen2-72B-AQLM-PV-1bit-1x16
Text Generation
• 12B • Updated • 5
azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16
Text Generation
• 2B • Updated • 23
• 13
ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-1Bit-1x16-hf
Text Generation
• 2B • Updated • 10
• 1
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-1Bit-1x16-hf
Text Generation
• 2B • Updated • 7
• 1
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf
Text Generation
• 2B • Updated • 84
• 8
ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf
Text Generation
• 2B • Updated • 12
• 3
galqiwi/Meta-Llama-3.1-8B-AQLM-2x8g8-NO-TUNE
3B • Updated • 1
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-2x8-hf
Text Generation
• 3B • Updated • 106
• 2
ISTA-DASLab/Mistral-Nemo-Instruct-2407-AQLM-PV-2Bit-1x16-hf
3B • Updated • 12
• 3
ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16
Text Generation
• 11B • Updated • 16
• 18
ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16
Text Generation
• 11B • Updated • 16
• 45
ISTA-DASLab/Llama-3.2-3B-AQLM-PV-2Bit-2x8
Text Generation
• 1B • Updated • 7
ISTA-DASLab/Llama-3.2-1B-AQLM-PV-2Bit-2x8
Text Generation
• 0.5B • Updated • 9
ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8
Text Generation
• 0.5B • Updated • 7
• 1
ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8
Text Generation
• 1B • Updated • 10
Text Generation
• 0.7B • Updated • 6
7B • Updated • 5
Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-1x15
Text Generation
• 1B • Updated • 11
Devy1/CodeLlama-7b-hf-AQLM-3bit-rnd-2x12
Text Generation
• 2B • Updated • 15
Devy1/CodeLlama-7b-hf-AQLM-4bit-rnd-2x15
Text Generation
• 2B • Updated • 10
Devy1/CodeLlama-7b-hf-AQLM-8bit-rnd-4x15
Text Generation
• 4B • Updated • 7
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-rnd-1x15
Text Generation
• 1B • Updated • 12
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-rnd-2x12
Text Generation
• 2B • Updated • 20
Devy1/DeepSeek-Coder-6.7b-base-AQLM-4bit-rnd-2x15
Text Generation
• 2B • Updated • 12
Devy1/DeepSeek-Coder-6.7b-base-AQLM-8bit-rnd-4x15
Text Generation
• 4B • Updated • 13
Devy1/CodeLlama-7b-hf-AQLM-2bit-code-1x15
Text Generation
• 1B • Updated • 8
Devy1/CodeLlama-7b-hf-AQLM-2bit-code-finetuned-1x15
Text Generation
• 1B • Updated • 6
Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-1x15
Text Generation
• 1B • Updated • 11
Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-finetuned-1x15
Text Generation
• 1B • Updated • 8