Inference Providers
Active filters: 4-bit
iproskurina/opt-350m-GPTQ-4bit-g128
Text Generation
• 95.6M • Updated • 13
iproskurina/opt-1.3b-GPTQ-4bit-g128
Text Generation
• 0.4B • Updated • 10
iproskurina/opt-2.7b-GPTQ-4bit-g128
Text Generation
• 0.6B • Updated • 4
iproskurina/opt-6.7b-GPTQ-4bit-g128
Text Generation
• 1B • Updated • 8
ybelkada/llava-1.5-7b-hf-awq
Image-Text-to-Text
• 7B • Updated • 210
• 2
TheBloke/LlamaGuard-7B-AWQ
Text Generation
• 7B • Updated • 13
• 4
marcsun13/Mixtral-tiny-GPTQ
Text Generation
• 0.2B • Updated • 6
TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ
Text Generation
• 47B • Updated • 5.43k
• 141
TheBloke/LlamaGuard-7B-GPTQ
Text Generation
• 7B • Updated • 10
• 2
marcsun13/Mixtral-8x7B-v0.1-GPTQ
Text Generation
• 47B • Updated • 3
HydraIndicLM/mistral-MoQlora-punjabi-expert
Text Generation
• Updated • 2
HydraIndicLM/mistral-MoQlora-tamil-expert
Text Generation
• Updated • 4
TheBloke/mixtral-8x7b-v0.1-AWQ
Text Generation
• 47B • Updated • 207
• 11
TheBloke/Mixtral-8x7B-Instruct-v0.1-AWQ
Text Generation
• 47B • Updated • 1.6k
• 59
TheBloke/Mistral-7B-Instruct-v0.2-GPTQ
Text Generation
• 7B • Updated • 56.2k
• 55
TheBloke/Mistral-7B-Instruct-v0.2-AWQ
Text Generation
• 7B • Updated • 139k
• 52
TheBloke/Clover3-17B-GPTQ
Text Generation
• 17B • Updated • 6
• 4
Text Generation
• 17B • Updated • 6
• 3
TheBloke/Rogue-Rose-103b-v0.2-GPTQ
Text Generation
• 103B • Updated • 10
• 1
TheBloke/Rogue-Rose-103b-v0.2-AWQ
Text Generation
• 103B • Updated • 7
• 5
TheBloke/dopeystableplats-3b-v1-GPTQ
Text Generation
• 3B • Updated • 6
TheBloke/neural-chat-7B-v3-3-AWQ
Text Generation
• 7B • Updated • 396
TheBloke/neural-chat-7B-v3-3-GPTQ
Text Generation
• 7B • Updated • 25
• 3
Text Generation
• 7B • Updated • 29
• 1
Text Generation
• 7B • Updated • 15
• 1
Text Generation
• 7B • Updated • 10
• 1
Text Generation
• 7B • Updated • 7
• 1
Text Generation
• 7B • Updated • 3
Text Generation
• 7B • Updated • 4
iproskurina/opt-13b-GPTQ-4bit-g128
Text Generation
• 2B • Updated • 4