Models

ReallyFloppyPenguin/DeepSWE-Preview-GGUF

33B • Updated Jul 8, 2025 • 49

crazymaker1122/Llama-3.3-8B-Instruct-awq-direct

Text Generation • 8B • Updated Jul 9, 2025 • 10

steampunque/Llama-3.1-8B-Instruct-Hybrid-GGUF

8B • Updated Jan 13 • 6

steampunque/Llama-3.3-70B-Instruct-Hybrid-GGUF

71B • Updated Jul 11, 2025 • 8

steampunque/ultravox-v0_5-llama-3_3-70b-Hybrid-GGUF

Updated Jul 10, 2025 • 1

steampunque/ultravox-v0_6-llama-3_3-70b-Hybrid-GGUF

Updated Jul 10, 2025 • 8

magicunicorn/gemma-3-27b-npu-quantized

Text Generation • Updated Jul 10, 2025 • 1

rs-test/llama-scout-fp8

Image-Text-to-Text • 109B • Updated Jul 11, 2025 • 2

Makatia/mistral-7b-instruct-v0.2.Q8_0-Q8_0.gguf

7B • Updated Jul 13, 2025 • 5

Makatia/microsoft_Phi-3-mini-4k-instruct_onnx_rpi

Updated Jul 13, 2025

Makatia/TinyLlama_TinyLlama-1.1B-Chat-v1.0_onnx

Updated Jul 14, 2025 • 2

ramblingpolymath/Qwen3-32B-W8A8

Text Generation • 33B • Updated Aug 2, 2025 • 7

steampunque/Deepseek-R1-Distill-Llama-8B-Hybrid-GGUF

8B • Updated Jan 13 • 38

ramblingpolymath/Qwen3-14B-W8A8

Text Generation • 15B • Updated Aug 3, 2025 • 2

ramblingpolymath/Qwen3-8B-W8A8

Text Generation • 8B • Updated Aug 3, 2025 • 2

ramblingpolymath/Qwen3-4B-W8A8

Text Generation • 4B • Updated Aug 2, 2025 • 2

RedHatAI/Kimi-K2-Instruct-quantized.w4a16

Text Generation • 146B • Updated 23 days ago • 142 • 12

adamrb/mpt-30b-chat-w4a16-gptq

30B • Updated Jul 15, 2025

adamrb/mpt-30b-chat-w8a8-gptq

30B • Updated Jul 15, 2025 • 2

ramblingpolymath/qwen3-30B-A3B-w8a8

Text Generation • 31B • Updated Aug 2, 2025 • 22

ramblingpolymath/Qwen3-0.6B-W8A8

Text Generation • 0.8B • Updated Aug 3, 2025 • 27

tachyphylaxis/DeepSeek-R1-0528-FP4

Text Generation • 397B • Updated Jul 18, 2025 • 4

SandLogicTechnologies/MedGemma-4B-IT-GGUF

4B • Updated Jul 29, 2025 • 127 • 5

PJEDeveloper/Mistral_Nemo_Instruct_2407-F16.gguf-Q4_K_M

12B • Updated Jul 23, 2025 • 1

sdurgi/bert_emotion_response_classifier_quantized

Text Classification • Updated Jul 19, 2025 • 1

Hariprasath28/orpheus-3b-4bit-AWQ

Text Generation • 3B • Updated Jul 19, 2025 • 1.95k

mirekphd/whisper-large-v3-onnx-fp16

Automatic Speech Recognition • Updated Jul 19, 2025

mirekphd/whisper-large-v3-onnx-w8a16-dynamic

Automatic Speech Recognition • Updated Jul 19, 2025

mirekphd/whisper-large-v3-onnx-w4a16-dynamic

Automatic Speech Recognition • Updated Jul 19, 2025

steampunque/Qwen2.5-VL-32B-Instruct-Hybrid-GGUF

33B • Updated Nov 20, 2025 • 9