Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

24,775

Base only

Active filters: llama-cpp

lkraven/Llama-3-Aplite-Instruct-4x8B-Q6_K-GGUF

Text Generation • 25B • Updated Apr 22, 2024 • 15

Bessa/llava-llama-3-8b-v1_1-Q4_K_M-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 25

Bessa/llava-llama-3-8b-v1_1-Q5_K_M-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 20 • 1

MoMonir/dolphin-2.9-llama3-8b-GGUF

8B • Updated Apr 25, 2024 • 47 • 1

RaincloudAi/llava-llama-3-8b-v1_1-Q4_K_M-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 49 • 2

djward888/llava-llama-3-8b-v1_1-Q6_K-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 29

djward888/llava-llama-3-8b-v1_1-Q8_0-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 26 • 6

djward888/llava-llama-3-8b-v1_1-Q5_K_M-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 30 • 2

djward888/llava-llama-3-8b-v1_1-Q5_K_S-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 29

djward888/llava-llama-3-8b-v1_1-Q5_0-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 20

djward888/llava-llama-3-8b-v1_1-Q4_K_M-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 36

djward888/llava-llama-3-8b-v1_1-Q4_K_S-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 23 • 1

djward888/llava-llama-3-8b-v1_1-Q4_0-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 39

djward888/llava-llama-3-8b-v1_1-Q3_K_L-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 28

djward888/llava-llama-3-8b-v1_1-Q3_K_M-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 28

djward888/llava-llama-3-8b-v1_1-Q3_K_S-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 24 • 1

djward888/llava-llama-3-8b-v1_1-Q2_K-GGUF

Image-Text-to-Text • 8B • Updated Apr 22, 2024 • 28 • 1

JermemyHaschal/Phigments12-Q6_K-GGUF

3B • Updated Apr 22, 2024 • 8

sosoai/hansoldeco-llama3-70B-8bit-v0.1-Q2_K-GGUF

71B • Updated Apr 23, 2024 • 8

extractio/Llama-3-8B-16K-Q6_K-GGUF

8B • Updated Apr 23, 2024 • 16 • 2

NikolayKozloff/Llama-3-8B-Omnibus-1-PL-v01-INSTRUCT-GGUF

Text Generation • 8B • Updated Apr 23, 2024 • 14 • 1

NikolayKozloff/Llama-3-Open-Ko-8B-Instruct-preview-GGUF

Text Generation • 8B • Updated Apr 23, 2024 • 16 • 1

jeiku/Kei_Llama3_8B-Q4_K_M-GGUF

8B • Updated Apr 23, 2024 • 26

stormchaser/llava-llama-3-8b-v1_1-Q6_K-GGUF

Image-Text-to-Text • 8B • Updated Apr 23, 2024 • 43

hus960/Unsafe-Llama-3-8B-Q4_K_M-GGUF

8B • Updated Apr 23, 2024 • 19

hus960/Llama-3-8b.UNLEASHED-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 23, 2024 • 30 • 3

hus960/Llama-3-SLERP-8B-Q4_K_M-GGUF

8B • Updated Apr 23, 2024 • 8

hus960/openbuddy-qwen1.5-14b-v21.1-32k-Q4_K_M-GGUF

Text Generation • 14B • Updated Apr 23, 2024 • 11 • 2

RachidAR/Llama-3-8B-Instruct-Physics-5k-Scar-Q6_K-GGUF

8B • Updated Apr 23, 2024 • 8

RachidAR/ablation-model-fineweb-v1-Q6_K-GGUF

2B • Updated Apr 23, 2024 • 17 • 1