Inference Providers
Active filters: 4-bit
TheBloke/Augmental-ReMM-13B-AWQ
Text Generation
• 13B • Updated • 8
• 1
TheBloke/Augmental-ReMM-13B-GPTQ
Text Generation
• 13B • Updated • 7
• 3
TheBloke/Noromaid-13B-v0.1-GPTQ
Text Generation
• 13B • Updated • 6
• 4
TheBloke/Noromaid-13B-v0.1-AWQ
Text Generation
• 13B • Updated • 6
• 1
mohan007/Qwen-VL-Chat-Int4
Text Generation
• 10B • Updated • 7
ranchlai/llama2-70B-gptq-4bit-512g
Text Generation
• Updated • 6
NobodyExistsOnTheInternet/llama-2-7b-unchat
Text Generation
• Updated • 5
NobodyExistsOnTheInternet/llama-2-13b-unchat
TheBloke/Nous-Capybara-34B-AWQ
Text Generation
• 34B • Updated • 60
• 13
TheBloke/Nous-Capybara-34B-GPTQ
Text Generation
• 34B • Updated • 57
• 20
TheBloke/dolphin-2_2-yi-34b-AWQ
Text Generation
• 34B • Updated • 52
• 12
TheBloke/dolphin-2_2-yi-34b-GPTQ
Text Generation
• 34B • Updated • 11
• 9
TheBloke/Noromaid-13B-v0.1.1-AWQ
Text Generation
• 13B • Updated • 6
• 3
TheBloke/Synatra-7B-v0.3-RP-AWQ
Text Generation
• 7B • Updated • 7
• 1
TheBloke/speechless-mistral-dolphin-orca-platypus-samantha-7B-AWQ
Text Generation
• 7B • Updated • 6
• 3
haoranz/open_llama_13b-int4
Text Generation
• 13B • Updated • 6
TheBloke/Synatra-7B-v0.3-RP-GPTQ
Text Generation
• 7B • Updated • 9
• 6
TheBloke/Noromaid-13B-v0.1.1-GPTQ
Text Generation
• 13B • Updated • 8
• 3
TheBloke/speechless-mistral-dolphin-orca-platypus-samantha-7B-GPTQ
Text Generation
• 7B • Updated • 8
• 1
DonatePlz/openchat_3.5-16k-merged-AWQ
Text Generation
• 7B • Updated • 9
• 1
TheBloke/Claire-7B-0.1-GPTQ
Text Generation
• 7B • Updated • 15
• 1
TheBlokeAI/llama-68m-GPTQ-sharded
Text Generation
• 68.1M • Updated • 187
TheBloke/TransNormerLLM-7B-GPTQ
Text Generation
• 7B • Updated • 11
• 5
TheBloke/Claire-7B-0.1-AWQ
Text Generation
• 7B • Updated • 9
• 2
TheBloke/opus-v0-70B-GPTQ
Text Generation
• 69B • Updated • 4
• 1
Text Generation
• 69B • Updated • 7
• 1
TheBloke/Python-Code-13B-AWQ
Text Generation
• 13B • Updated • 7
• 1
TheBloke/Python-Code-33B-AWQ
Text Generation
• 33B • Updated • 6
• 1
TheBloke/Python-Code-13B-GPTQ
Text Generation
• 13B • Updated • 6
• 1
TheBloke/ShiningValiantXS-AWQ
Text Generation
• 13B • Updated • 5