Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

11,628

Base only

Active filters: quantized

afrideva/phi-2-chat-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 99 • 1

afrideva/LMCocktail-phi-2-v1-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 58

afrideva/Llama-160M-Chat-v1-GGUF

Text Generation • 0.2B • Updated Dec 21, 2023 • 181 • 2

afrideva/llama-160m-GGUF

Text Generation • 0.2B • Updated Dec 21, 2023 • 75

afrideva/phi-1_5_dolly_instruction_polish-GGUF

Text Generation • 1B • Updated Dec 22, 2023 • 141 • 2

afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF

Text Generation • 3B • Updated Dec 22, 2023 • 227 • 2

afrideva/phi-2_LogiCoT_finetuned-GGUF

Text Generation • 3B • Updated Dec 22, 2023 • 50

afrideva/open-llama-3b-v2-instruct-GGUF

Text Generation • 3B • Updated Dec 24, 2023 • 184 • 1

afrideva/phi-2_dolly_instruction_polish-GGUF

Text Generation • 3B • Updated Dec 24, 2023 • 80 • 1

afrideva/smol-3b-GGUF

Text Generation • 3B • Updated Dec 25, 2023 • 27

afrideva/Astrea-RP-v1-3B-GGUF

Text Generation • 3B • Updated Dec 26, 2023 • 264 • 3

afrideva/MiniChat-2-3B-GGUF

Text Generation • 3B • Updated Dec 27, 2023 • 49 • 1

afrideva/Mixtral-GQA-400m-v2-GGUF

Text Generation • 2B • Updated Dec 27, 2023 • 113 • 1

afrideva/smol_llama-220M-GQA-GGUF

Text Generation • 0.2B • Updated Dec 27, 2023 • 18

afrideva/tinycodellama-1.3b-3k-GGUF

Text Generation • 1B • Updated Dec 27, 2023 • 21

afrideva/RocketZephyr-3b-GGUF

Text Generation • 3B • Updated Dec 27, 2023 • 7 • 1

afrideva/TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF

Text Generation • 1B • Updated Dec 28, 2023 • 149 • 1

afrideva/tinycodellama-1.3b-5k-GGUF

Text Generation • 1B • Updated Dec 28, 2023 • 19

afrideva/gpt2-turkish-128-token-GGUF

Text Generation • 0.2B • Updated Dec 28, 2023 • 721 • 2

afrideva/gpt2-small-danish-GGUF

Text Generation • 0.2B • Updated Dec 28, 2023 • 133

afrideva/DialoGPT-medium-Oshiwambo-Bot-GGUF

Text Generation • 0.2B • Updated Dec 28, 2023 • 119

afrideva/Smol-Llama-101M-Chat-v1-GGUF

Text Generation • 0.1B • Updated Dec 29, 2023 • 357 • 3

afrideva/japanese-mistral-300m-base-GGUF

Text Generation • 0.4B • Updated Dec 29, 2023 • 165

afrideva/japanese-mistral-300m-instruction-GGUF

Text Generation • 0.4B • Updated Dec 29, 2023 • 98

solidrust/Noromaid-7B-0.4-DPO-AWQ

Text Generation • 7B • Updated Mar 2, 2024 • 6 • 1

MaziyarPanahi/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 46 • 1

ProphetOfBostrom/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-HQQ

Text Generation • Updated Mar 5, 2024 • 28 • 6

MaziyarPanahi/Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 3 • 1

MaziyarPanahi/dolphin-2.1-mistral-7b-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 2 • 1

MaziyarPanahi/komt-mistral-7b-v1-GPTQ

Text Generation • 1B • Updated Jan 13, 2024 • 2