Inference Providers
Active filters: 8-bit
RichardErkhov/rinna_-_llama-3-youko-8b-8bits
Text Generation
• 8B • Updated • 4
BigHuggyD/jukofyork_Deep-Miqu-103B-8.0bpw-h8-exl2
Text Generation
• Updated • 4
• 1
jan-hq/Yi-1.5-6B-Chat-bnb-8bit
Text Generation
• 6B • Updated • 5
RichardErkhov/google_-_recurrentgemma-2b-8bits
Text Generation
• 3B • Updated • 19
1024m/EXALT-1A-LLAMA3-5A-4bit
Text Generation
• 5B • Updated shershen/Llama3-Hermes-2-Pro-GPTQ-8bit
Text Generation
• 8B • Updated • 6
xianke9/llama-3-8b-bnb-4bit-zh-merged_4b
Text Generation
• 5B • Updated • 3
RichardErkhov/TeeZee_-_Bielik-SOLAR-LIKE-10.7B-Instruct-v0.1-8bits
Text Generation
• 11B • Updated • 3
FuturisticVibes/L3-Arcania-4x8b-8.0bpw-h8-exl2
Text Generation
• Updated • 4
• 1
ImagineIt/Alpha-merged-gptq
Text Generation
• Updated • 6
ikeno-ada/base-japanese-product-classification-Quanto-8bit
Text Classification
• 0.1B • Updated • 6
WlappaAI/dracor-ru-small-lora
intelpen/Meta-llama-3-8B-GPTQ-8Bits-wikitext2
Text Generation
• 8B • Updated • 3
CNBOOMBOOM/quant-gptq-hivetalk-8bits-10k-v4
Text Generation
• 7B • Updated • 4
CNBOOMBOOM/quant-gptq-hivetalk-8bits-10k-v3
Text Generation
• 7B • Updated • 4
deepak2009thakur/Llama-2-7b-chat-finetune_troubleshooting
Text Generation
• Updated • 6
antoniolopez00/llama3-quantized-GPTQ
Text Generation
• 8B • Updated • 5
ss93/llama-2-7b-custom-8bit-GPTQ
Text Generation
• 7B • Updated • 4
RichardErkhov/TIGER-Lab_-_MAmmoTH2-7B-8bits
Text Generation
• 7B • Updated • 4
RichardErkhov/mlabonne_-_NeuralMonarch-7B-8bits
Text Generation
• 7B • Updated • 4
RichardErkhov/gradientai_-_Llama-3-8B-Instruct-Gradient-4194k-8bits
Text Generation
• 8B • Updated • 4
RichardErkhov/ibm-granite_-_granite-8b-code-instruct-8bits
Text Generation
• 8B • Updated • 4
RichardErkhov/unsloth_-_Hermes-2-Pro-Mistral-7B-8bits
Text Generation
• 7B • Updated • 5
RichardErkhov/amazingvince_-_Not-WizardLM-2-7B-8bits
Text Generation
• 7B • Updated • 3
RichardErkhov/Undi95_-_Meta-Llama-3-8B-hf-8bits
Text Generation
• 8B • Updated • 4
Dhanu459/LLama3_8B_MarketingTemplate_M12_Lora
Text Generation
• 5B • Updated • 4
RichardErkhov/froggeric_-_WestLake-10.7B-v2-8bits
Text Generation
• 11B • Updated • 3
FuturisticVibes/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss-8.0bpw-h8-exl2
Text Generation
• Updated • 4
• 1
Shaleen123/llama3-science-8bit
Text Generation
• 8B • Updated • 4
RichardErkhov/NeuralNovel_-_Panda-7B-v0.1-8bits
Text Generation
• 7B • Updated • 73
• 1