Inference Providers
Active filters: autogptq
ldilov/stablelm-tuned-alpha-7b-4bit-128g-descact-sym-true-sequential
Text Generation
• 2B • Updated • 7
flozi00/OpenAssistant-falcon-40B-4-bits-autogptq
Text Generation
• Updated • 2
• 2
hugging-quants/Meta-Llama-3.1-405B-Instruct-GPTQ-INT4
Text Generation
• 410B • Updated • 153
• 16
hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4
Text Generation
• 71B • Updated • 9.43k
• 23
hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4
Text Generation
• 8B • Updated • 24k
• 42
fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_gptq-int4-gs128-asym
Text Generation
• 2B • Updated • 8
fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_gptq-int4-gs128-sym
Text Generation
• 2B • Updated • 1
fbaldassarri/TinyLlama_TinyLlama_v1.1-autogptq-int4-gs128-sym
Text Generation
• 1B • Updated • 1
fbaldassarri/TinyLlama_TinyLlama_v1.1-autogptq-int4-gs128-asym
Text Generation
• 1B • Updated • 3
fbaldassarri/EleutherAI_pythia-70m-deduped-autogptq-int4-gs128-sym
Text Generation
• 70.4M • Updated • 2
fbaldassarri/EleutherAI_pythia-70m-deduped-autogptq-int4-gs128-asym
Text Generation
• 70.4M • Updated fbaldassarri/EleutherAI_pythia-14m-autogptq-int4-gs128-asym
Text Generation
• 14.1M • Updated • 1
fbaldassarri/EleutherAI_pythia-14m-autogptq-int4-gs128-sym
Text Generation
• 14.1M • Updated • 2
fbaldassarri/EleutherAI_pythia-31m-autogptq-int4-gs128-asym
Text Generation
• 30.5M • Updated • 2
fbaldassarri/EleutherAI_pythia-31m-autogptq-int4-gs128-sym
Text Generation
• 30.5M • Updated • 1
fbaldassarri/EleutherAI_pythia-70m-autogptq-int4-gs128-asym
Text Generation
• 70.4M • Updated fbaldassarri/EleutherAI_pythia-70m-autogptq-int4-gs128-sym
Text Generation
• 70.4M • Updated • 2
fbaldassarri/EleutherAI_pythia-1b-deduped-autogptq-int4-gs128-asym
Text Generation
• 1B • Updated fbaldassarri/EleutherAI_pythia-1b-deduped-autogptq-int4-gs128-sym
Text Generation
• 1B • Updated • 1
fbaldassarri/EleutherAI_pythia-1b-autogptq-int4-gs128-asym
Text Generation
• 1B • Updated • 2
fbaldassarri/EleutherAI_pythia-1b-autogptq-int4-gs128-sym
Text Generation
• 1B • Updated • 1
fbaldassarri/EleutherAI_pythia-160m-autogptq-int4-gs128-asym
Text Generation
• 0.2B • Updated • 1
fbaldassarri/EleutherAI_pythia-160m-autogptq-int4-gs128-sym
Text Generation
• 0.2B • Updated • 1
fbaldassarri/EleutherAI_pythia-160m-deduped-autogptq-int4-gs128-asym
Text Generation
• 0.2B • Updated fbaldassarri/EleutherAI_pythia-160m-deduped-autogptq-int4-gs128-sym
Text Generation
• 0.2B • Updated fbaldassarri/EleutherAI_pythia-410m-deduped-autogptq-int4-gs128-asym
Text Generation
• 0.4B • Updated fbaldassarri/EleutherAI_pythia-410m-deduped-autogptq-int4-gs128-sym
Text Generation
• 0.4B • Updated • 4
fbaldassarri/EleutherAI_pythia-410m-autogptq-int4-gs128-asym
Text Generation
• 0.4B • Updated • 1
fbaldassarri/EleutherAI_pythia-410m-autogptq-int4-gs128-sym
Text Generation
• 0.4B • Updated • 2
fbaldassarri/EleutherAI_pythia-1.4b-deduped-autogptq-int4-gs128-asym
Text Generation
• 1B • Updated • 1