Inference Providers
Active filters: autogptq
fbaldassarri/EleutherAI_pythia-12b-deduped-autogptq-int4-gs128-sym
Text Generation
• 12B • Updated • 6
fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_gptq-int4-gs128-asym
Text Generation
• 0.4B • Updated • 8
fbaldassarri/HuggingFaceTB_SmolLM2-360M-auto_gptq-int4-gs128-sym
Text Generation
• 0.4B • Updated • 5
fbaldassarri/allenai_OLMo-2-1124-7B-Instruct-autogptq-int4-gs128-asym
Text Generation
• 7B • Updated • 2
fbaldassarri/allenai_OLMo-2-1124-7B-Instruct-autogptq-int4-gs128-sym
Text Generation
• 7B • Updated • 1
fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autogptq-int4-gs128-asym
Text Generation
• 0.4B • Updated • 2
fbaldassarri/sapienzanlp_Minerva-350M-base-v1.0-autogptq-int4-gs128-sym
Text Generation
• 0.4B • Updated • 1
fbaldassarri/sapienzanlp_Minerva-7B-base-v1.0-autogptq-int4-gs128-asym
Text Generation
• 7B • Updated • 5
fbaldassarri/sapienzanlp_Minerva-7B-base-v1.0-autogptq-int4-gs128-sym
Text Generation
• 7B • Updated • 2
fbaldassarri/sapienzanlp_Minerva-7B-instruct-v1.0-autogptq-int4-gs128-asym
Text Generation
• 7B • Updated • 2
fbaldassarri/sapienzanlp_Minerva-7B-instruct-v1.0-autogptq-int4-gs128-sym
Text Generation
• 7B • Updated • 1
fbaldassarri/sapienzanlp_Minerva-1B-base-v1.0-autogptq-int4-gs128-asym
Text Generation
• 1B • Updated • 1
fbaldassarri/sapienzanlp_Minerva-3B-base-v1.0-autogptq-int4-gs128-asym
Text Generation
• 3B • Updated • 6
fbaldassarri/sapienzanlp_Minerva-1B-base-v1.0-autogptq-int4-gs128-sym
Text Generation
• 1B • Updated • 1
fbaldassarri/sapienzanlp_Minerva-3B-base-v1.0-autogptq-int4-gs128-sym
Text Generation
• 3B • Updated • 3
fbaldassarri/iGeniusAI_Italia-9B-Instruct-v0.1-autogptq-int4-gs128-asym
Text Generation
• 8B • Updated • 1
fbaldassarri/iGeniusAI_Italia-9B-Instruct-v0.1-autogptq-int4-gs128-sym
Text Generation
• 8B • Updated • 2
fbaldassarri/meta-llama_Llama-3.2-1B-auto_gptq-int8-gs128-sym
Text Generation
• 1B • Updated • 10
fbaldassarri/meta-llama_Llama-3.2-1B-auto_gptq-int8-gs128-asym
Text Generation
• 1B • Updated • 4
fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int8-gs128-asym
Text Generation
• 1B • Updated • 5
fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int8-gs128-sym
Text Generation
• 1B • Updated • 6
fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs128-asym
Text Generation
• 3B • Updated • 5
fbaldassarri/meta-llama_Llama-3.2-3B-auto_gptq-int8-gs128-sym
Text Generation
• 3B • Updated • 8
fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs128-asym
Text Generation
• 3B • Updated • 5
fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int8-gs128-sym
Text Generation
• 3B • Updated • 4
fbaldassarri/allenai_OLMo-2-1124-13B-autogptq-int4-gs128-asym
Text Generation
• 14B • Updated • 2
fbaldassarri/allenai_OLMo-2-1124-13B-autogptq-int4-gs128-sym
Text Generation
• 14B • Updated • 1
fbaldassarri/allenai_OLMo-2-1124-13B-Instruct-autogptq-int4-gs128-asym
Text Generation
• 14B • Updated • 1
fbaldassarri/allenai_OLMo-2-1124-13B-Instruct-autogptq-int4-gs128-sym
Text Generation
• 14B • Updated • 3
fbaldassarri/mistralai_Mistral-7B-v0.3-autogptq-int4-gs128-asym
Text Generation
• 7B • Updated • 4