Inference Providers
Active filters: auto-awq
fbaldassarri/tiiuae_Falcon3-7B-Instruct-autoawq-int4-gs128-sym
Text Generation
• 7B • Updated • 7
fbaldassarri/tiiuae_Falcon3-10B-Instruct-autoawq-int4-gs128-asym
Text Generation
• 10B • Updated • 5
fbaldassarri/tiiuae_Falcon3-10B-Instruct-autoawq-int4-gs128-sym
Text Generation
• 10B • Updated • 6
fbaldassarri/iGeniusAI_Italia-9B-Instruct-v0.1-autoawq-int4-gs64-asym
Text Generation
• 8B • Updated • 5
fbaldassarri/iGeniusAI_Italia-9B-Instruct-v0.1-autoawq-int4-gs64-sym
Text Generation
• 8B • Updated • 3
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoawq-int4-gs128-asym
Text Generation
• 24B • Updated • 6
fbaldassarri/mistralai_Mistral-Small-24B-Instruct-2501-autoawq-int4-gs128-sym
Text Generation
• 24B • Updated • 2
fbaldassarri/mistralai_Mistral-Small-24B-Base-2501-autoawq-int4-gs128-asym
Text Generation
• 24B • Updated • 2
fbaldassarri/mistralai_Mistral-Small-24B-Base-2501-autoawq-int4-gs128-sym
Text Generation
• 24B • Updated • 4
fbaldassarri/openlm-research_open_llama_7b_v2-autoawq-int4-gs128-asym
Text Generation
• 7B • Updated • 3
fbaldassarri/openlm-research_open_llama_7b_v2-autoawq-int4-gs128-sym
Text Generation
• 7B • Updated • 2
fbaldassarri/openlm-research_open_llama_3b_v2-autoawq-int4-gs64-asym
Text Generation
• 3B • Updated • 2
fbaldassarri/openlm-research_open_llama_3b_v2-autoawq-int4-gs64-sym
Text Generation
• 3B • Updated • 6
fbaldassarri/openlm-research_open_llama_7b_v2-autoawq-int4-gs64-asym
Text Generation
• 7B • Updated • 2
fbaldassarri/openlm-research_open_llama_7b_v2-autoawq-int4-gs64-sym
Text Generation
• 7B • Updated • 2
fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-SFT-autoawq-int4-gs128-asym
Text Generation
• 8B • Updated • 7
fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-SFT-autoawq-int4-gs128-sym
Text Generation
• 8B • Updated • 6
fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-DPO-autoawq-int4-gs128-asym
Text Generation
• 8B • Updated • 9
fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-DPO-autoawq-int4-gs128-sym
Text Generation
• 8B • Updated • 4
fbaldassarri/ibm-granite_granite-3.2-2b-instruct-autoawq-int4-gs128-asym
Text Generation
• 3B • Updated • 7
fbaldassarri/ibm-granite_granite-3.2-2b-instruct-autoawq-int4-gs128-sym
Text Generation
• 3B • Updated • 7
fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs128-asym
Text Generation
• 3B • Updated • 10
fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs128-sym
Text Generation
• 3B • Updated • 9
fbaldassarri/ibm-granite_granite-3.3-2b-base-autoawq-int4-gs128-asym
Text Generation
• 3B • Updated • 6
fbaldassarri/ibm-granite_granite-3.3-2b-base-autoawq-int4-gs128-sym
Text Generation
• 3B • Updated • 9
fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs64-asym
Text Generation
• 3B • Updated • 8
fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs64-sym
Text Generation
• 3B • Updated • 7
fbaldassarri/ibm-granite_granite-3.3-2b-base-autoawq-int4-gs64-asym
Text Generation
• 3B • Updated • 6
fbaldassarri/ibm-granite_granite-3.3-2b-base-autoawq-int4-gs64-sym
Text Generation
• 3B • Updated • 8
fbaldassarri/allenai_Llama-3.1-Tulu-3-8B-DPO-autoawq-int4-gs64-asym
Text Generation
• 8B • Updated • 7