Inference Providers
Active filters: 4-bit
TheBloke/CaPlatTessDolXaBoros-Yi-34B-200K-DARE-Ties-HighDensity-AWQ
Text Generation
• 34B • Updated • 5
• 1
danny0122/stablelm-base-alpha-3b-gptq-4bits
Text Generation
• 4B • Updated • 2
TheBloke/Marcoroni-7B-v2-GPTQ
Text Generation
• 7B • Updated • 4
TheBloke/Marcoroni-7B-v3-GPTQ
Text Generation
• 7B • Updated • 5
TheBloke/CaPlatTessDolXaBoros-Yi-34B-200K-DARE-Ties-HighDensity-GPTQ
Text Generation
• 34B • Updated • 6
• 1
TheBloke/Merged-AGI-7B-AWQ
Text Generation
• 7B • Updated • 5
TheBloke/Merged-AGI-7B-GPTQ
Text Generation
• 7B • Updated • 8
• 1
TheBloke/open-instruct-human-mix-65B-AWQ
Text Generation
• 65B • Updated • 5
TheBloke/open-instruct-human-mix-65B-GPTQ
Text Generation
• 65B • Updated • 8
danny0122/Llama-2-7b-hf-gptq-4bits
Text Generation
• 7B • Updated • 2
TheBloke/Nethena-20B-Glued-GPTQ
Text Generation
• 20B • Updated • 6
• 1
TheBloke/Nethena-20B-Glued-AWQ
Text Generation
• 20B • Updated • 5
• 2
danny0122/Llama-2-7b-hf-gptq-4bitssafe
Text Generation
• 7B • Updated • 1
Text Generation
• 11B • Updated • 3
Text Generation
• 11B • Updated • 8
• 1
TheBloke/leo-hessianai-70B-chat-GPTQ
Text Generation
• 69B • Updated • 5
• 1
TheBloke/leo-hessianai-70B-chat-AWQ
Text Generation
• 69B • Updated • 5
• 1
danny0122/stablelm-base-alpha-3b-gptq-4bitssafe
Text Generation
• 4B • Updated • 2
jamesdborin/llama2-13b-chat-4bit-AWQ
Text Generation
• 13B • Updated • 4
• 1
jamesdborin/llama2-70b-chat-4bit-AWQ
Text Generation
• 69B • Updated • 3
• 1
jamesdborin/llama2-7b-base-4bit-AWQ
Text Generation
• 7B • Updated • 2
jamesdborin/llama2-13b-base-4bit-AWQ
Text Generation
• 13B • Updated • 4
jamesdborin/llama2-70b-base-4bit-AWQ
Text Generation
• 69B • Updated • 1
Chat-Error/Rose-Kimiko-20B
Updated • 5
• 2
Weni/ZeroShot-3.1.1-Mistral-7b-Multilanguage-3.0.3-AWQ
Text Generation
• 7B • Updated • 2
TheBloke/OpenHermes-2.5-neural-chat-v3-3-Slerp-GPTQ
Text Generation
• 7B • Updated • 7
• 3
TheBloke/OpenHermes-2.5-neural-chat-v3-3-Slerp-AWQ
Text Generation
• 7B • Updated • 8
• 1
TheBlokeAI/Mixtral-tiny-GPTQ
Text Generation
• 0.2B • Updated • 93
• 3
TheBloke/leo-hessianai-70B-AWQ
Text Generation
• 69B • Updated • 3
TheBloke/leo-hessianai-70B-GPTQ
Text Generation
• 69B • Updated • 10