-
-
-
-
-
-
Inference Providers
Active filters: 4-bit
TheBloke/ARIA-70B-V2-GPTQ
Text Generation
• 69B • Updated
• 11
• 4
Text Generation
• 69B • Updated
• 1
• 2
casperhansen/starcoderbase-1b-awq
Text Generation
• Updated
TheBloke/Falcon-180B-Chat-AWQ
Text Generation
• 180B • Updated
• 5
• 8
Text Generation
• Updated
• 1
TheBloke/StellarX-4B-V0.2-GPTQ
Text Generation
• 3B • Updated
• 13
• 1
TheBloke/Xwin-LM-13B-V0.1-GPTQ
Text Generation
• 13B • Updated
• 34
• 18
TheBloke/Xwin-LM-13B-V0.1-AWQ
Text Generation
• 13B • Updated
• 4
• 6
TheBloke/MAmmoTH-Coder-34B-AWQ
Text Generation
• 34B • Updated
• 4
• 1
TheBloke/MAmmoTH-Coder-34B-GPTQ
Text Generation
• 34B • Updated
• 3
• 2
Text Generation
• 69B • Updated
• 3
• 1
TheBloke/MAmmoTH-70B-GPTQ
Text Generation
• 69B • Updated
• 3
CJ-gyuwonpark/filtering-platypus-13b
Updated
totally-not-an-llm/EverythingLM-13b-V3-peft
Updated
• 2
• 1
Veer15/bloomz-3b-4bit-quant
Text Generation
• Updated
TheBloke/Inkbot-13B-4k-GPTQ
Text Generation
• 13B • Updated
• 3
• 3
TheBloke/Inkbot-13B-4k-AWQ
Text Generation
• 13B • Updated
• 1
• 3
TheBloke/Xwin-LM-7B-V0.1-AWQ
Text Generation
• 7B • Updated
• 1
• 2
TheBloke/Xwin-LM-7B-V0.1-GPTQ
Text Generation
• 7B • Updated
• 7
• 8
TheBloke/Xwin-LM-70B-V0.1-GPTQ
Text Generation
• 69B • Updated
• 16
• 36
TheBloke/Xwin-LM-70B-V0.1-AWQ
Text Generation
• 69B • Updated
• 10
• 14
Cartinoe5930/llama-2-13B-GPTQ
Text Generation
• Updated
• 1
TheBlokeAI/jackfram_llama-68m-GPTQ
Text Generation
• 68.1M • Updated
• 117
• 1
csdc-atl/internlm-chat-20b-GPTQ-Int4
Text Generation
• 20B • Updated
• 1
• 2
Mahmoud22/llama-7B-chat-gptq
Text Generation
• 7B • Updated
TheBloke/Buddy-7B-v0.2-AWQ
Text Generation
• 7B • Updated
• 2
TheBloke/Buddy-7B-v0.2-GPTQ
Text Generation
• 7B • Updated
• 2
• 1
TheBloke/Airoboros-L2-70b-2.2.1-GPTQ
Text Generation
• 69B • Updated
• 4
• 4
TheBloke/Airoboros-L2-70b-2.2.1-AWQ
Text Generation
• 69B • Updated
• 1
Text Generation
• Updated
• 1