Inference Providers
Active filters: 3-bit
DrNicefellow/Qwen2.5-14B-Instruct-3.0bpw-exl2
DrNicefellow/Qwen2.5-Math-7B-Instruct-3.0bpw-exl2
iproskurina/Mistral-7B-v0.1-GPTQ-3bit-g128
Text Generation
• 1.0B • Updated • 9
iproskurina/Mistral-7B-v0.1-GPTQ-3bit-g64
Text Generation
• 1B • Updated • 8
MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF
Text Generation
• 3B • Updated • 180k
• 15
MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF
Text Generation
• 1B • Updated • 183k
• 18
BigHuggyD/gghfez_SmartMaid-123b_exl2_3.0bpw_h6
Xu-Ouyang/Llama-3.2-1B-int3-GPTQ-wikitext2
Text Generation
• 1B • Updated • 5
Xu-Ouyang/Llama-3.2-3B-int3-GPTQ-wikitext2
Text Generation
• 3B • Updated • 4
Xu-Ouyang/Qwen2.5-0.5B-int3-GPTQ-wikitext2
Text Generation
• 0.5B • Updated • 7
Xu-Ouyang/Qwen2.5-1.5B-int3-GPTQ-wikitext2
Text Generation
• 1B • Updated • 4
Xu-Ouyang/Qwen2.5-7B-int3-GPTQ-wikitext2
Text Generation
• 7B • Updated • 4
schnapper79/lumikabra-behemoth-123b-exl2-3.0bpw
Text Generation
• Updated • 7
Jellon/New-Dawn-Llama-3-70B-32K-v1.0-3bpw
Text Generation
• Updated • 8
• 1
BigHuggyD/TheDrummer_Behemoth-123B-v1_exl2_3.0bpw_h6
schnapper79/lumikabra_behemoth_195b-exl2-3.0bpw
Text Generation
• Updated • 6
schnapper79/lumikabra_behemoth_195B_v2-exl2-3.0bpw
Text Generation
• Updated • 5
MaziyarPanahi/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF
Text Generation
• 71B • Updated • 821
• 3
MaziyarPanahi/Meraj-Mini-GGUF
Text Generation
• 8B • Updated • 686
• 2
bigstorm/Llama-3.1-Nemotron-70B-Instruct-HF-3.0bpw-6hb-exl2
Text Generation
• Updated • 8
MaziyarPanahi/llama-3.2-Korean-Bllossom-3B-GGUF
Text Generation
• 3B • Updated • 125
• 1
MaziyarPanahi/Llama-3.2-3B-Instruct-uncensored-GGUF
Text Generation
• 4B • Updated • 1.56k
• 6
MaziyarPanahi/Llama-3.2-3B-Overthinker-GGUF
Text Generation
• 3B • Updated • 189
• 1
MaziyarPanahi/Llama-3.1-8B-Lexi-Uncensored-V2-GGUF
Text Generation
• 8B • Updated • 630
• 2
MaziyarPanahi/Llama3.1-8B-Chinese-Chat-GGUF
Text Generation
• 8B • Updated • 477
• 1
MaziyarPanahi/Chocolatine-3B-Instruct-DPO-Revised-GGUF
Text Generation
• 4B • Updated • 270
MaziyarPanahi/Chocolatine-3B-Instruct-DPO-v1.2-GGUF
Text Generation
• 4B • Updated • 43
MaziyarPanahi/Phi-3-mini-4K-instruct-cpo-simpo-GGUF
Text Generation
• 4B • Updated • 136
MaziyarPanahi/Nemotron-Mini-4B-Instruct-GGUF
Text Generation
• 4B • Updated • 357
• 1
Jellon/Qwen2.5-72B-Instruct-abliterated-exl2-3bpw
Text Generation
• Updated • 11
• 1