Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

20,898

Base only

Active filters: quantized

afrideva/gpt2-small-danish-GGUF

Text Generation • 0.2B • Updated Dec 28, 2023 • 688

afrideva/DialoGPT-medium-Oshiwambo-Bot-GGUF

Text Generation • 0.2B • Updated Dec 28, 2023 • 550

afrideva/Smol-Llama-101M-Chat-v1-GGUF

Text Generation • 0.1B • Updated Dec 29, 2023 • 341 • 3

afrideva/japanese-mistral-300m-base-GGUF

Text Generation • 0.4B • Updated Dec 29, 2023 • 707 • 2

afrideva/japanese-mistral-300m-instruction-GGUF

Text Generation • 0.4B • Updated Dec 29, 2023 • 263

solidrust/Noromaid-7B-0.4-DPO-AWQ

Text Generation • 7B • Updated Mar 2, 2024 • 26 • 1

MaziyarPanahi/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 17 • 1

ProphetOfBostrom/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-HQQ

Text Generation • Updated Mar 5, 2024 • 17 • 6

MaziyarPanahi/Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 12 • 1

MaziyarPanahi/dolphin-2.1-mistral-7b-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 16 • 1

MaziyarPanahi/komt-mistral-7b-v1-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 15

MaziyarPanahi/OpenHermes-2-Mistral-7B-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 13 • 1

MaziyarPanahi/WizardLM-70B-V1.0-GPTQ

Text Generation • 10B • Updated Jan 15, 2024 • 17 • 1

MaziyarPanahi/distilabeled-Hermes-2.5-Mistral-7B-GPTQ

Text Generation • 1B • Updated Jan 14, 2024 • 13

afrideva/phi-2-code-instruct-GGUF

Text Generation • 3B • Updated Jan 16, 2024 • 509 • 1

afrideva/Llama-68M-Chat-v1-GGUF

Text Generation • 68M • Updated Jan 17, 2024 • 385 • 2

afrideva/Walter-Phi-GGUF

Text Generation • 1B • Updated Jan 17, 2024 • 336 • 1

MaziyarPanahi/MoMo-70B-lora-1.8.6-DPO-GPTQ

Text Generation • 12B • Updated Jan 18, 2024 • 13 • 1

MaziyarPanahi/MoMo-70B-lora-1.8.4-DPO-GPTQ

Text Generation • 12B • Updated Jan 18, 2024 • 15 • 1

MaziyarPanahi/neural-chat-7b-v3-3-Slerp-GPTQ

Text Generation • 1B • Updated Jan 18, 2024 • 8

MaziyarPanahi/neural-chat-7b-v3-3-GPTQ

Text Generation • 1B • Updated Jan 18, 2024 • 13 • 1

MaziyarPanahi/Turdus-GPTQ

Text Generation • 1B • Updated Jan 18, 2024 • 11 • 5

MaziyarPanahi/UNA-34Beagles-32K-bf16-v1-GPTQ

Text Generation • 5B • Updated Mar 4, 2024 • 38 • 3

MaziyarPanahi/openchat-3.5-0106-GPTQ

Text Generation • 1B • Updated Jan 19, 2024 • 17 • 2

MaziyarPanahi/Nous-Hermes-2-Mixtral-8x7B-DPO-GPTQ

Text Generation • 6B • Updated Jan 19, 2024 • 16 • 1

afrideva/dolphin-2_6-phi-2_oasst2_chatML_V2-GGUF

Text Generation • 3B • Updated Jan 19, 2024 • 453 • 5

MaziyarPanahi/zephyr-7b-beta-GPTQ

Text Generation • 1B • Updated Jan 19, 2024 • 15 • 1

afrideva/TinyLlama-haiku-dpo-v.0.1-GGUF

Text Generation • 1B • Updated Jan 19, 2024 • 642

MaziyarPanahi/Breeze-7B-Instruct-v0_1-GPTQ

Text Generation • 1B • Updated Jan 19, 2024 • 12 • 2

afrideva/tinyllama-python-GGUF

Text Generation • 1B • Updated Jan 20, 2024 • 445