Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,548

Full-text search

Active filters: meta

fbaldassarri/meta-llama_Llama-3.1-8B-auto_awq-int4-gs128-asym

Text Generation • 8B • Updated Dec 8, 2024 • 1

bullerwins/Llama-3.3-70B-Instruct-exl2_4.0bpw

Text Generation • Updated Dec 8, 2024

bullerwins/Llama-3.3-70B-Instruct-exl2_5.0bpw

Text Generation • Updated Dec 8, 2024

bullerwins/Llama-3.3-70B-Instruct-exl2_6.0bpw

Text Generation • Updated Dec 8, 2024

bullerwins/Llama-3.3-70B-Instruct-exl2_8.0bpw

Text Generation • Updated Dec 8, 2024

tensorblock/calme-2.3-llama3-70b-GGUF

Text Generation • 71B • Updated Jan 27 • 21

SYNERDATA/SYNERDATA-Meta-LLaMA-3.1-8b-Instruct-128k-Q8_0.GGUF

Text Generation • 8B • Updated Dec 9, 2024 • 1

bullerwins/Llama-3.3-70B-Instruct-exl2_3.0bpw

Text Generation • Updated Dec 9, 2024

bullerwins/Llama-3.3-70B-Instruct-exl2_4.5bpw

Text Generation • Updated Dec 9, 2024

bullerwins/Llama-3.3-70B-Instruct-exl2_5.5bpw

Text Generation • Updated Dec 9, 2024

bullerwins/Llama-3.3-70B-Instruct-exl2_6.5bpw

Text Generation • Updated Dec 9, 2024

bullerwins/Llama-3.3-70B-Instruct-exl2_3.5bpw

Text Generation • Updated Dec 9, 2024

tensorblock/Llama-3-8B-Instruct-DPO-v0.3-GGUF

Text Generation • 8B • Updated Jan 27 • 1

fbaldassarri/meta-llama_Llama-3.1-8B-auto_awq-int4-gs128-sym

Text Generation • 8B • Updated Dec 9, 2024

tensorblock/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • 71B • Updated Jan 27 • 13

pedantic2025/Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Dec 9, 2024 • 5

pedantic2025/Llama-3.1-8B-Instruct-Q3_K_M-GGUF

Text Generation • 8B • Updated Dec 9, 2024 • 3

Infermatic/Llama-3.3-70B-Instruct-FP8-Dynamic

Text Generation • Updated Dec 9, 2024 • 984 • 2

fbaldassarri/meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-sym

Text Generation • 8B • Updated Dec 9, 2024 • 2 • 2

tensorblock/calme-2.4-llama3-70b-GGUF

Text Generation • 71B • Updated Jan 27 • 27

MoreWrong/study_budyMerged

Text Generation • 8B • Updated Dec 10, 2024 • 2

mradermacher/urllm-ko-7b-GGUF

7B • Updated Dec 17, 2024 • 63

mradermacher/urllm-ko-7b-i1-GGUF

7B • Updated Dec 10, 2024 • 209

amd/Llama-3.1-8B-awq-g128-int4-asym-fp16-onnx-hybrid

Text Generation • Updated Jun 23, 2025 • 7

hierholzer/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 11, 2024 • 97 • 1

mradermacher/Llama-3-13B-Instruct-v0.1-GGUF

13B • Updated Dec 11, 2024 • 72

mradermacher/Llama-3-16B-Instruct-v0.1-GGUF

17B • Updated Dec 11, 2024 • 64

mradermacher/NeuralTau-Functions-v1-GGUF

8B • Updated Jun 24, 2025 • 104

huihui-ai/Llama-3.3-70B-Instruct-abliterated

Text Generation • 71B • Updated Dec 12, 2024 • 3.4k • 66

mradermacher/Llama-3-16B-Instruct-v0.1-i1-GGUF

17B • Updated Dec 11, 2024 • 105