Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

16,057

Base only

Active filters: quantized

afrideva/phi-2-chat-turkish-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 349 • 3

afrideva/phi-2-chat-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 235 • 1

afrideva/LMCocktail-phi-2-v1-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 313

afrideva/Llama-160M-Chat-v1-GGUF

Text Generation • 0.2B • Updated Dec 21, 2023 • 259 • 2

afrideva/llama-160m-GGUF

Text Generation • 0.2B • Updated Dec 21, 2023 • 113

afrideva/phi-1_5_dolly_instruction_polish-GGUF

Text Generation • 1B • Updated Dec 22, 2023 • 193 • 2

afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF

Text Generation • 3B • Updated Dec 22, 2023 • 548 • 2

afrideva/phi-2_LogiCoT_finetuned-GGUF

Text Generation • 3B • Updated Dec 22, 2023 • 302

afrideva/open-llama-3b-v2-instruct-GGUF

Text Generation • 3B • Updated Dec 24, 2023 • 466 • 1

afrideva/phi-2_dolly_instruction_polish-GGUF

Text Generation • 3B • Updated Dec 24, 2023 • 365 • 1

afrideva/smol-3b-GGUF

Text Generation • 3B • Updated Dec 25, 2023 • 101

afrideva/Astrea-RP-v1-3B-GGUF

Text Generation • 3B • Updated Dec 26, 2023 • 136 • 3

afrideva/MiniChat-2-3B-GGUF

Text Generation • 3B • Updated Dec 27, 2023 • 162 • 1

afrideva/Mixtral-GQA-400m-v2-GGUF

Text Generation • 2B • Updated Dec 27, 2023 • 240 • 1

afrideva/smol_llama-220M-GQA-GGUF

Text Generation • 0.2B • Updated Dec 27, 2023 • 128

afrideva/tinycodellama-1.3b-3k-GGUF

Text Generation • 1B • Updated Dec 27, 2023 • 279

afrideva/RocketZephyr-3b-GGUF

Text Generation • 3B • Updated Dec 27, 2023 • 77 • 1

afrideva/TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF

Text Generation • 1B • Updated Dec 28, 2023 • 238 • 1

afrideva/tinycodellama-1.3b-5k-GGUF

Text Generation • 1B • Updated Dec 28, 2023 • 59

afrideva/gpt2-turkish-128-token-GGUF

Text Generation • 0.2B • Updated Dec 28, 2023 • 147 • 2

afrideva/gpt2-small-danish-GGUF

Text Generation • 0.2B • Updated Dec 28, 2023 • 151

afrideva/DialoGPT-medium-Oshiwambo-Bot-GGUF

Text Generation • 0.2B • Updated Dec 28, 2023 • 431

afrideva/Smol-Llama-101M-Chat-v1-GGUF

Text Generation • 0.1B • Updated Dec 29, 2023 • 209 • 3

afrideva/japanese-mistral-300m-base-GGUF

Text Generation • 0.4B • Updated Dec 29, 2023 • 632 • 2

afrideva/japanese-mistral-300m-instruction-GGUF

Text Generation • 0.4B • Updated Dec 29, 2023 • 95

solidrust/Noromaid-7B-0.4-DPO-AWQ

Text Generation • 7B • Updated Mar 2, 2024 • 13 • 1

MaziyarPanahi/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 20 • 1

ProphetOfBostrom/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-HQQ

Text Generation • Updated Mar 5, 2024 • 21 • 6

MaziyarPanahi/Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 14 • 1

MaziyarPanahi/dolphin-2.1-mistral-7b-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 12 • 1