Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,785

Base only

Active filters: llama-cpp

hus960/Stanta-Lelemon-Maid-7B-Q4_K_M-GGUF

7B • Updated Apr 27, 2024 • 8

hus960/Mini-Mixtral-v0.2-Q4_K_M-GGUF

13B • Updated Apr 27, 2024 • 17

nakcnx/llama-3-8b-sql-synthetic_text_to_sql-Q5_K_M-GGUF

8B • Updated Apr 28, 2024 • 22

MoMonir/Llama-3-8B-Instruct-262k-GGUF

Text Generation • 8B • Updated Apr 28, 2024 • 11

BasedBots/Yarn-Mistral-7b-128k-Q8_0-GGUF

7B • Updated Apr 28, 2024 • 15

SilverFan/IceCoffeeRP-7b-Q6_K-GGUF

7B • Updated Apr 28, 2024 • 7

MoMonir/Meta-Llama-Guard-2-8B-GGUF

Text Generation • 8B • Updated Apr 28, 2024 • 18

MoMonir/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-GGUF

13B • Updated Apr 28, 2024 • 7

seawolf2357/cerberus-llama-3-8b-instruct-gguf

Text Generation • 8B • Updated May 14, 2024 • 52

seawolf2357/Phi-3-mini-128k-instruct-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 28, 2024 • 115

hus960/base-7b-v0.2-Q4_K_M-GGUF

7B • Updated Apr 28, 2024 • 14

FPHam/Marvin_TheGrumpyOldAssistant_13B-HF-Q8_0-GGUF

13B • Updated Apr 28, 2024 • 41

hus960/Nxcode-CQ-7B-orpo-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 28, 2024 • 2

FPHam/Marvin_TheGrumpyOldAssistant_13B-HF-Q5_K_M-GGUF

13B • Updated Apr 28, 2024 • 5 • 1

FPHam/Marvin_TheGrumpyOldAssistant_13B-HF-Q4_K_M-GGUF

13B • Updated Apr 28, 2024 • 4

FPHam/Writing_Partner_Mistral_7B-Q5_K_M-GGUF

7B • Updated Apr 28, 2024 • 7

FPHam/Sarah_StoryTeller_13b_HF-Q6_K-GGUF

13B • Updated Apr 28, 2024 • 13 • 1

FPHam/Autolycus-Mistral_7B-Q6_K-GGUF

7B • Updated Apr 28, 2024 • 6

FPHam/Karen_TheEditor_V2_CREATIVE_Mistral_7B-Q6_K-GGUF

7B • Updated Apr 28, 2024 • 23 • 1

hus960/Experiment30-7B-Q4_K_M-GGUF

Text Generation • 7B • Updated Apr 28, 2024 • 5

wendys-llc/unsloth-attempt-Q8_0-GGUF

Text Generation • 8B • Updated Apr 28, 2024 • 9

hus960/jaskier-7b-dpo-v6.1-Q4_K_M-GGUF

7B • Updated Apr 28, 2024 • 5

hus960/multimaster-7b-v6-Q4_K_M-GGUF

35B • Updated Apr 28, 2024 • 9

wendys-llc/llama3-8b-receipts-v2-Q8_0-GGUF

8B • Updated Apr 28, 2024 • 17

reach-vb/Phi-3-mini-4k-instruct-Q8_0-GGUF

Text Generation • 4B • Updated May 27, 2024 • 52

naskimed/BugsPredv3.1-Q4_K_M-GGUF

7B • Updated Apr 29, 2024 • 4

itayl/HebrewLlama-Q5_K_M-GGUF

1B • Updated Apr 29, 2024 • 9

bowersjames/phillama-3.8b-v1-Q5_K_M-GGUF

Text Generation • 4B • Updated Apr 29, 2024 • 36

itayl/Hebrew-Mistral-7B_Chat-Q5_K_M-GGUF

8B • Updated Apr 29, 2024 • 10

itayl/Hebrew-Mistral-7B_Chat-Q4_K_M-GGUF

8B • Updated Apr 29, 2024 • 11