Inference Providers
Active filters: 8-bit
Text Generation
• 8B • Updated RichardErkhov/scb10x_-_typhoon-7b-8bits
Text Generation
• 7B • Updated RichardErkhov/aloobun_-_bun_mistral_7b_v2-8bits
Text Generation
• 7B • Updated MaziyarPanahi/Yi-1.5-6B-Chat-GGUF
Text Generation
• 6B • Updated • 84.8k
• 9
RichardErkhov/nvidia_-_Llama3-ChatQA-1.5-8B-8bits
Text Generation
• 8B • Updated MaziyarPanahi/Yi-1.5-9B-Chat-GGUF
Text Generation
• 9B • Updated • 177
• 4
MaziyarPanahi/Yi-1.5-34B-Chat-GGUF
Text Generation
• 34B • Updated • 83
• 5
RichardErkhov/google_-_recurrentgemma-2b-it-8bits
Text Generation
• 3B • Updated RichardErkhov/beomi_-_KoAlpaca-Polyglot-5.8B-8bits
Text Generation
• 6B • Updated RichardErkhov/shenzhi-wang_-_Llama3-8B-Chinese-Chat-8bits
Text Generation
• 8B • Updated RichardErkhov/rinna_-_llama-3-youko-8b-8bits
Text Generation
• 8B • Updated • 2
BigHuggyD/jukofyork_Deep-Miqu-103B-8.0bpw-h8-exl2
Text Generation
• Updated • 3
• 1
jan-hq/Yi-1.5-6B-Chat-bnb-8bit
Text Generation
• 6B • Updated RichardErkhov/google_-_recurrentgemma-2b-8bits
Text Generation
• 3B • Updated • 1
1024m/EXALT-1A-LLAMA3-5A-4bit
Text Generation
• 5B • Updated • 2
shershen/Llama3-Hermes-2-Pro-GPTQ-8bit
Text Generation
• 8B • Updated • 1
xianke9/llama-3-8b-bnb-4bit-zh-merged_4b
Text Generation
• 5B • Updated RichardErkhov/TeeZee_-_Bielik-SOLAR-LIKE-10.7B-Instruct-v0.1-8bits
Text Generation
• 11B • Updated FuturisticVibes/L3-Arcania-4x8b-8.0bpw-h8-exl2
Text Generation
• Updated • 1
ImagineIt/Alpha-merged-gptq
Text Generation
• Updated • 2
ikeno-ada/base-japanese-product-classification-Quanto-8bit
Text Classification
• 0.1B • Updated WlappaAI/dracor-ru-small-lora
intelpen/Meta-llama-3-8B-GPTQ-8Bits-wikitext2
Text Generation
• 8B • Updated • 1
CNBOOMBOOM/quant-gptq-hivetalk-8bits-10k-v4
Text Generation
• 7B • Updated • 2
CNBOOMBOOM/quant-gptq-hivetalk-8bits-10k-v3
Text Generation
• 7B • Updated deepak2009thakur/Llama-2-7b-chat-finetune_troubleshooting
Text Generation
• Updated • 1
antoniolopez00/llama3-quantized-GPTQ
Text Generation
• 8B • Updated ss93/llama-2-7b-custom-8bit-GPTQ
Text Generation
• 7B • Updated RichardErkhov/TIGER-Lab_-_MAmmoTH2-7B-8bits
Text Generation
• 7B • Updated RichardErkhov/mlabonne_-_NeuralMonarch-7B-8bits
Text Generation
• 7B • Updated