-
-
-
-
-
-
Inference Providers
Active filters: 4-bit
Text Generation
• 7B • Updated
• 4
mayflowergmbh/SauerkrautLM-SOLAR-Instruct-awq
Text Generation
• 11B • Updated
• 5
• 2
ludis/tsukasa-7b-qlora-gptq
Text Generation
• Updated
Text Generation
• 7B • Updated
• 1
TheBloke/bun_mistral_7b_v2-GPTQ
Text Generation
• 7B • Updated
• 3
• 2
TheBloke/bun_mistral_7b_v2-AWQ
Text Generation
• 7B • Updated
• 6
• 2
TheBloke/Mixtral_7Bx2_MoE-GPTQ
Text Generation
• 13B • Updated
• 6
• 8
TheBloke/Mixtral_7Bx2_MoE-AWQ
Text Generation
• 13B • Updated
• 3
• 2
TheBloke/Valkyrie-V1-GPTQ
Text Generation
• 7B • Updated
• 1
Text Generation
• 7B • Updated
• 1
TheBloke/LUNA-SOLARkrautLM-Instruct-AWQ
Text Generation
• 11B • Updated
• 2
TheBloke/LUNA-SOLARkrautLM-Instruct-GPTQ
Text Generation
• 11B • Updated
• 3
• 2
begangowsik/opt-125m-gptq-4bit-54
Text Generation
• 0.1B • Updated
• 1
TheBloke/Sensei-7B-V1-GPTQ
Text Generation
• 7B • Updated
• 6
• 2
TheBloke/Sensei-7B-V1-AWQ
Text Generation
• 7B • Updated
• 1
• 2
bandhit/typhoon-7b-q4-bnb_cuda-ts-1703352224
Text Generation
• 7B • Updated
• 4
• 1
TheBloke/Orca2myth7.2-AWQ
Text Generation
• 20B • Updated
• 2
• 3
TheBloke/Orca2myth7.2-GPTQ
Text Generation
• 20B • Updated
• 1
• 4
harmtech/Stheno-v2-Delta-GPTQ
Text Generation
• Updated
• 1
• 1
nlpchallenges/chatbot-qa-path
TheBloke/dolphin-2_6-phi-2-GPTQ
Text Generation
• 3B • Updated
• 12
• 2
TheBloke/SauerkrautLM-UNA-SOLAR-Instruct-GPTQ
Text Generation
• 11B • Updated
• 2
• 3
TheBloke/SauerkrautLM-UNA-SOLAR-Instruct-AWQ
Text Generation
• 11B • Updated
• 1
• 1
Depie/llama2-2-chat-7b-ToTTo
Updated
Text Generation
• 7B • Updated
• 3
Text Generation
• 7B • Updated
• 6
• 4
TheBloke/LMCocktail-10.7B-v1-GPTQ
Text Generation
• 11B • Updated
• 2
TheBloke/LMCocktail-10.7B-v1-AWQ
Text Generation
• 11B • Updated
• 2
• 1
TheBloke/Instruct_Mixtral-8x7B-v0.1_Dolly15K-AWQ
Text Generation
• 47B • Updated
• 1
TheBloke/Instruct_Mixtral-8x7B-v0.1_Dolly15K-GPTQ
Text Generation
• 47B • Updated
• 2