Inference Providers
Active filters: 4bit
ModelCloud/internlm-2.5-7b-chat-1m-gptq-4bit
Feature Extraction
• 8B • Updated • 2
legraphista/NuminaMath-7B-TIR-IMat-GGUF
Text Generation
• 7B • Updated • 315
• 1
legraphista/mathstral-7B-v0.1-IMat-GGUF
Text Generation
• 7B • Updated • 469
Text Generation
• Updated • 2
ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit
Text Generation
• 12B • Updated • 34
• 5
legraphista/Athene-70B-IMat-GGUF
Text Generation
• 71B • Updated • 841
• 3
ModelCloud/gemma-2-27b-it-gptq-4bit
Text Generation
• 28B • Updated • 472
• 12
legraphista/Mistral-Nemo-Instruct-2407-IMat-GGUF
Text Generation
• 12B • Updated • 510
• 2
legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF
Text Generation
• 8B • Updated • 1.11k
• 6
ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit
Text Generation
• 8B • Updated • 165
• 4
ModelCloud/Meta-Llama-3.1-8B-gptq-4bit
Text Generation
• 8B • Updated • 29
legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF
Text Generation
• 71B • Updated • 1.17k
• 11
ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit
Text Generation
• 71B • Updated • 40
• 4
legraphista/Llama-Guard-3-8B-IMat-GGUF
Text Generation
• 8B • Updated • 5.89k
• 5
legraphista/Mistral-Large-Instruct-2407-IMat-GGUF
Text Generation
• 123B • Updated • 403
• 29
jhangmez/CHATPRG-v0.2.1-Meta-Llama-3.1-8B-bnb-4bit-lora-adapters
Text Generation
• Updated jhangmez/CHATPRG-v0.2.1-Meta-Llama-3.1-8B-bnb-4bit-q4_k_m
Text Generation
• 8B • Updated • 65
• 1
ModelCloud/Mistral-Large-Instruct-2407-gptq-4bit
Text Generation
• 123B • Updated • 38
• 1
legraphista/Meta-Llama-3.1-8B-Instruct-abliterated-IMat-GGUF
Text Generation
• 8B • Updated • 502
• 1
ModelCloud/Meta-Llama-3.1-405B-Instruct-gptq-4bit
Text Generation
• 410B • Updated • 5
• 2
legraphista/gemma-2-2b-it-IMat-GGUF
Text Generation
• 3B • Updated • 847
• 2
legraphista/gemma-2-2b-IMat-GGUF
Text Generation
• 3B • Updated • 738
• 1
thesven/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
• 7B • Updated • 6
• 1
legraphista/Palmyra-Fin-70B-32K-IMat-GGUF
Text Generation
• 71B • Updated • 836
• 10
legraphista/internlm2_5-1_8b-chat-IMat-GGUF
Text Generation
• 2B • Updated • 379
legraphista/internlm2_5-20b-chat-IMat-GGUF
Text Generation
• 20B • Updated • 592
legraphista/shieldgemma-2b-IMat-GGUF
Text Generation
• 3B • Updated • 1.84k
legraphista/shieldgemma-9b-IMat-GGUF
Text Generation
• 9B • Updated • 520
legraphista/shieldgemma-27b-IMat-GGUF
Text Generation
• 27B • Updated • 730
• 1
legraphista/Qwen2-Math-1.5B-Instruct-IMat-GGUF
Text Generation
• 2B • Updated • 268