Inference Providers
Active filters: aqlm
azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16
Text Generation
• 2B • Updated • 18
• 13
ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-1Bit-1x16-hf
Text Generation
• 2B • Updated • 10
• 1
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-1Bit-1x16-hf
Text Generation
• 2B • Updated • 15
• 1
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-1x16-hf
Text Generation
• 2B • Updated • 86
• 8
ISTA-DASLab/Meta-Llama-3.1-8B-AQLM-PV-2Bit-1x16-hf
Text Generation
• 2B • Updated • 78
• 3
galqiwi/Meta-Llama-3.1-8B-AQLM-2x8g8-NO-TUNE
3B • Updated • 9
ISTA-DASLab/Meta-Llama-3.1-8B-Instruct-AQLM-PV-2Bit-2x8-hf
Text Generation
• 3B • Updated • 13
• 2
ISTA-DASLab/Mistral-Nemo-Instruct-2407-AQLM-PV-2Bit-1x16-hf
3B • Updated • 11
• 3
ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16
Text Generation
• 11B • Updated • 15
• 18
ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16
Text Generation
• 11B • Updated • 24
• 45
ISTA-DASLab/Llama-3.2-3B-AQLM-PV-2Bit-2x8
Text Generation
• 1B • Updated • 4
ISTA-DASLab/Llama-3.2-1B-AQLM-PV-2Bit-2x8
Text Generation
• 0.5B • Updated • 6
ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8
Text Generation
• 0.5B • Updated • 4
• 1
ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8
Text Generation
• 1B • Updated • 9
Text Generation
• Updated • 4
7B • Updated • 5
Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-1x15
Text Generation
• 1B • Updated • 4
Devy1/CodeLlama-7b-hf-AQLM-3bit-rnd-2x12
Text Generation
• 2B • Updated • 1
Devy1/CodeLlama-7b-hf-AQLM-4bit-rnd-2x15
Text Generation
• 2B • Updated • 1
Devy1/CodeLlama-7b-hf-AQLM-8bit-rnd-4x15
Text Generation
• 4B • Updated • 2
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-rnd-1x15
Text Generation
• 1B • Updated • 7
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-rnd-2x12
Text Generation
• 2B • Updated • 2
Devy1/DeepSeek-Coder-6.7b-base-AQLM-4bit-rnd-2x15
Text Generation
• 2B • Updated • 2
Devy1/DeepSeek-Coder-6.7b-base-AQLM-8bit-rnd-4x15
Text Generation
• 4B • Updated • 3
Devy1/CodeLlama-7b-hf-AQLM-2bit-code-1x15
Text Generation
• 1B • Updated • 7
Devy1/CodeLlama-7b-hf-AQLM-2bit-code-finetuned-1x15
Text Generation
• 1B • Updated • 5
Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-1x15
Text Generation
• 1B • Updated • 5
Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-finetuned-1x15
Text Generation
• 1B • Updated • 6
Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-finetuned-1x15
Text Generation
• 1B • Updated • 4
Devy1/CodeLlama-7b-hf-AQLM-3bit-code-2x12
Text Generation
• 2B • Updated • 2