Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

21,853

Full-text search

Active filters: llama-cpp

oceansweep/c4ai-command-r-v01-Q8_0-GGUF

35B • Updated Apr 25, 2024 • 25

sosoai/hansoldeco-beomi-Llama-3-Open-Ko-8B-Instruct-preview-Q4_K_M-GGUF

8B • Updated Apr 25, 2024 • 11

sosoai/hansoldeco-beomi-Llama-3-Open-Ko-8B-Instruct-preview-pytorch-v0.1-Q4_0-GGUF

8B • Updated Apr 25, 2024 • 7

sosoai/llama3-8b-16k-test-Q4_K_S-GGUF

8B • Updated Apr 25, 2024 • 3

hus960/DownSide-2x7B-Toxic-TOM-RP-TruthyDPO-Q4_K_M-GGUF

13B • Updated Apr 25, 2024 • 2

vectorventures/Llama-3-8b-64k-PoSE-Q6_K-GGUF

Text Generation • 8B • Updated Apr 25, 2024 • 2

hus960/Raiden-16x3.43B-Q4_K_M-GGUF

36B • Updated Apr 25, 2024 • 1 • 1

hus960/PsychoOrca_32x1.1B_MoE_bf16-Q4_K_M-GGUF

Text Generation • 25B • Updated Apr 25, 2024 • 4

LaurensVdP/Mistral-7B-Instruct-v0.2-Q8_0-GGUF

Text Generation • 7B • Updated Apr 25, 2024

hus960/MistralTrix8x9B-Q2_K-GGUF

58B • Updated Apr 25, 2024

nullt3r/Llama-3-8b-64k-PoSE-Q8_0-GGUF

Text Generation • 8B • Updated Apr 25, 2024 • 5

nullt3r/Meta-Llama-3-8B-Instruct-64k-PoSE-Q8_0-GGUF

Text Generation • 8B • Updated Apr 25, 2024 • 3

n00854180t/BuRPris-Remix-7B-Q4_K_M-GGUF

7B • Updated Apr 26, 2024 • 3

n00854180t/BuRPris-Remix-7B-Q6_K-GGUF

7B • Updated Apr 26, 2024

n00854180t/BuRPris-Remix-7B-Q8_0-GGUF

7B • Updated Apr 26, 2024

MoMonir/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • 8B • Updated Apr 26, 2024 • 9

jsfs11/meta-LLama3-8b-PruneME-TEST-22_30-GGUF

6B • Updated Apr 26, 2024 • 1

RachidAR/Llama-3-8B-saiga-suzume-ties-Q6_K-GGUF-OLD

Text Generation • 8B • Updated Apr 26, 2024 • 3 • 2

RachidAR/saiga_llama3_8b-Q6_K-GGUF

8B • Updated Jun 30, 2024 • 13

RachidAR/llama-3-indotuned-v0-Q6_K-GGUF

8B • Updated Apr 26, 2024

RachidAR/Waktaverse-Llama-3-KO-8B-Instruct-Q6_K-GGUF

8B • Updated Apr 26, 2024 • 7

sosoai/hansoldeco-beomi-llama3-open-ko-8b-64k-test-Q8_0-GGUF

8B • Updated Apr 26, 2024

Fadikkop/TinyLlama-1.1B-Chat-v1.0-german-Q4_K_M-GGUF

1B • Updated Apr 26, 2024 • 10

RachidAR/Llama-3-8B-Instruct-DPO-v0.3-Q6_K-GGUF

Text Generation • 8B • Updated Apr 26, 2024 • 4

Fadikkop/openbuddy-openllama-3b-v10-bf16-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 15

nuojohnchen/Apollo-7B-Q4_K_M-GGUF

9B • Updated Apr 26, 2024 • 2

itayl/Hebrew-Mistral-7B-Q5_K_M-GGUF

8B • Updated Apr 26, 2024 • 7 • 1

sbawa/TinyLlama-1.1B-Chat-v1.0-intel-dpo-Q4_K_M-GGUF

1B • Updated Apr 26, 2024 • 51 • 1

n00854180t/ErisMaidFlame-7B-Q4_K_M-GGUF

7B • Updated Apr 26, 2024 • 6 • 1

n00854180t/ErisMaidFlame-7B-Q8_0-GGUF

7B • Updated Apr 26, 2024 • 1