-
-
-
-
-
-
Inference Providers
Active filters: 4-bit
TheBloke/Mistral-7B-OpenOrca-oasst_top1_2023-08-25-v1-GPTQ
Text Generation
• 7B • Updated
• 4
• 1
wizcat/internlm-chat-7b-v1_1-gptq
Feature Extraction
• 7B • Updated
• 1
TheBloke/Augmental-ReMM-13B-AWQ
Text Generation
• 13B • Updated
• 4
• 1
TheBloke/Augmental-ReMM-13B-GPTQ
Text Generation
• 13B • Updated
• 1
• 3
TheBloke/Noromaid-13B-v0.1-GPTQ
Text Generation
• 13B • Updated
• 4
TheBloke/Noromaid-13B-v0.1-AWQ
Text Generation
• 13B • Updated
• 44
• 1
mohan007/Qwen-VL-Chat-Int4
Text Generation
• 10B • Updated
• 4
ranchlai/llama2-70B-gptq-4bit-512g
Text Generation
• Updated
• 1
NobodyExistsOnTheInternet/llama-2-7b-unchat
Text Generation
• Updated
• 1
NobodyExistsOnTheInternet/llama-2-13b-unchat
Updated
TheBloke/Nous-Capybara-34B-AWQ
Text Generation
• 34B • Updated
• 8
• 13
TheBloke/Nous-Capybara-34B-GPTQ
Text Generation
• 34B • Updated
• 11
• 20
TheBloke/dolphin-2_2-yi-34b-AWQ
Text Generation
• 34B • Updated
• 8
• 12
TheBloke/dolphin-2_2-yi-34b-GPTQ
Text Generation
• 34B • Updated
• 12
• 9
TheBloke/Noromaid-13B-v0.1.1-AWQ
Text Generation
• 13B • Updated
• 3
• 3
TheBloke/Synatra-7B-v0.3-RP-AWQ
Text Generation
• 7B • Updated
• 4
• 1
TheBloke/speechless-mistral-dolphin-orca-platypus-samantha-7B-AWQ
Text Generation
• 7B • Updated
• 5
• 3
haoranz/open_llama_13b-int4
Text Generation
• 13B • Updated
• 1
TheBloke/Synatra-7B-v0.3-RP-GPTQ
Text Generation
• 7B • Updated
• 5
• 6
TheBloke/Noromaid-13B-v0.1.1-GPTQ
Text Generation
• 13B • Updated
• 3
TheBloke/speechless-mistral-dolphin-orca-platypus-samantha-7B-GPTQ
Text Generation
• 7B • Updated
• 9
• 1
DonatePlz/openchat_3.5-16k-merged-AWQ
Text Generation
• 7B • Updated
• 12
• 1
TheBloke/Claire-7B-0.1-GPTQ
Text Generation
• 7B • Updated
• 8
• 1
TheBlokeAI/llama-68m-GPTQ-sharded
Text Generation
• 68.1M • Updated
• 48
TheBloke/TransNormerLLM-7B-GPTQ
Text Generation
• 7B • Updated
• 5
• 5
TheBloke/Claire-7B-0.1-AWQ
Text Generation
• 7B • Updated
• 4
• 2
TheBloke/opus-v0-70B-GPTQ
Text Generation
• 69B • Updated
• 4
• 1
Text Generation
• 69B • Updated
• 3
• 1
TheBloke/Python-Code-13B-AWQ
Text Generation
• 13B • Updated
• 5
• 1
TheBloke/Python-Code-33B-AWQ
Text Generation
• 33B • Updated
• 4
• 1