-
-
-
-
-
-
Inference Providers
Active filters: 4-bit
TheBloke/Mistral-7B-AEZAKMI-v1-AWQ
Text Generation
• 7B • Updated
• 13
• 1
TheBloke/LeoScorpius-GreenNode-Alpaca-7B-v1-AWQ
Text Generation
• 7B • Updated
• 1
TheBloke/LeoScorpius-GreenNode-Alpaca-7B-v1-GPTQ
Text Generation
• 7B • Updated
• 1
TheBloke/LeoScorpius-GreenNode-Platypus-7B-v1-GPTQ
Text Generation
• 7B • Updated
• 1
TheBloke/LeoScorpius-GreenNode-Platypus-7B-v1-AWQ
Text Generation
• 7B • Updated
• 2
• 1
TheBloke/SOLAR-Platypus-10.7B-v2-GPTQ
Text Generation
• 11B • Updated
• 2
• 1
TheBloke/SOLAR-Platypus-10.7B-v2-AWQ
Text Generation
• 11B • Updated
• 2
Text Generation
• 7B • Updated
• 3
Text Generation
• 7B • Updated
• 1
Text Generation
• 7B • Updated
• 1
• 1
Text Generation
• 7B • Updated
• 1
• 3
KnutJaegersberg/nllb-moe-54b-4bit
Translation
• 55B • Updated
• 45
• 5
mahihossain666/llama-2-70b-hf-quantized-4bits-GPTQ
Text Generation
• 69B • Updated
dvijay/mistral-alpaca2k-3e-lora
Text Generation
• Updated
• 2
• 1
TheBloke/Starling-LM-alpha-8x7B-MoE-GPTQ
Text Generation
• 47B • Updated
• 11
• 2
TheBloke/8x7B-MoE-test-NOT-MIXTRAL-GPTQ
Text Generation
• 38B • Updated
• 8
• 2
csdc-atl/buffer-baichuan2-13B-rag-awq-int4
Text Generation
• 14B • Updated
• 2
• 2
TheBloke/Chupacabra-8x7B-MoE-GPTQ
Text Generation
• 47B • Updated
• 2
• 1
TheBloke/Falkor-8x7B-MoE-GPTQ
Text Generation
• 47B • Updated
• 1
• 1
cmeraki/OpenHathi-7B-Hi-v0.1-Base-gptq
Text Generation
• 1B • Updated
• 3
TheBloke/go-bruins-v2.1.1-GPTQ
Text Generation
• 7B • Updated
TheBloke/go-bruins-v2.1.1-AWQ
Text Generation
• 7B • Updated
• 1
• 1
TheBloke/Mixtral-Fusion-4x7B-Instruct-v0.1-GPTQ
Text Generation
• 24B • Updated
• 8
• 2
TheBloke/PiVoT-10.7B-Mistral-v0.2-RP-AWQ
Text Generation
• 11B • Updated
• 2
• 2
TheBloke/PiVoT-10.7B-Mistral-v0.2-RP-GPTQ
Text Generation
• 11B • Updated
• 2
Text Generation
• 36B • Updated
• 2
• 1
NobodyExistsOnTheInternet/mistral-sysmsg-test
Text Generation
• Updated
• 4
TheBloke/PlatYi-34B-Llama-Q-v3-GPTQ
Text Generation
• 34B • Updated
• 1
TheBloke/PlatYi-34B-Llama-Q-v3-AWQ
Text Generation
• 34B • Updated
• 1
TheBloke/BigPlap-8x20B-GPTQ
Text Generation
• 112B • Updated
• 1