Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,822

Base only

Active filters: ro

agkavin/t5-small-Q8_0-GGUF

Translation • 60.5M • Updated Nov 21, 2024 • 11 • 2

cnmoro/tangled-llama-33m-32k-instruct-v0.1-fix

33.3M • Updated Feb 3, 2025 • 3 • 1

tensorblock/aya-23-8B-GGUF

8B • Updated Jan 27 • 95

utter-project/EuroLLM-9B

Text Generation • 9B • Updated Dec 9, 2024 • 574 • 166

mnsoylemez/flan_t5_finetuned_further_projectmanagement

0.2B • Updated Nov 26, 2024

Moatasem444/aya-expanse-4b-exl2

Text Generation • Updated Mar 24, 2025

huggingkot/aya-expanse-8b-Q4_K_M-GGUF

8B • Updated Nov 25, 2024 • 11

tensorblock/aya-expanse-8b-GGUF

8B • Updated Jan 27 • 37 • 3

jonyee/flan-t5-large-Q4_K_M-GGUF

0.8B • Updated Nov 26, 2024 • 13

tensorblock/aya-expanse-32b-ungated-GGUF

32B • Updated Jan 27 • 52 • 1

mradermacher/Teuken-7B-instruct-commercial-v0.4-GGUF

7B • Updated Nov 26, 2024 • 480 • 5

mradermacher/Teuken-7B-instruct-research-v0.4-GGUF

7B • Updated Feb 19, 2025 • 115 • 2

mradermacher/Teuken-7B-instruct-commercial-v0.4-i1-GGUF

7B • Updated Nov 26, 2024 • 486 • 1

KnutJaegersberg/Teuken-7B-instruct-commercial-v0.4-Q8_0-GGUF

Text Generation • 7B • Updated Nov 26, 2024 • 7 • 1

KnutJaegersberg/Teuken-7B-instruct-research-v0.4-Q8_0-GGUF

Text Generation • 7B • Updated Nov 26, 2024 • 8

quveex/flan2

77M • Updated Nov 26, 2024 • 4

NikolayKozloff/Teuken-7B-instruct-research-v0.4-Q8_0-GGUF

Text Generation • 7B • Updated Nov 26, 2024 • 5 • 1

NikolayKozloff/Teuken-7B-instruct-commercial-v0.4-Q8_0-GGUF

Text Generation • 7B • Updated Nov 26, 2024 • 14 • 4

mradermacher/Teuken-7B-instruct-research-v0.4-i1-GGUF

7B • Updated Nov 26, 2024 • 838 • 2

cristianadam/Teuken-7B-instruct-commercial-v0.4-Q6_K-GGUF

Text Generation • 7B • Updated Nov 26, 2024 • 7 • 1

KnutJaegersberg/Teuken-7B-instruct-commercial-v0.4-8.0bpw-exl2

Text Generation • Updated Nov 26, 2024 • 5

bartowski/Teuken-7B-instruct-research-v0.4-GGUF

Text Generation • 7B • Updated Nov 26, 2024 • 1.35k • 4

tensorblock/aya-expanse-32b-GGUF

32B • Updated Jan 27 • 54 • 4

KnutJaegersberg/Teuken-7B-instruct-research-v0.4-8.0bpw-exl2

Text Generation • Updated Nov 26, 2024 • 3

KnutJaegersberg/Teuken-7B-instruct-research-v0.4-Q4_K_M-GGUF

Text Generation • 7B • Updated Nov 26, 2024 • 10 • 1

KnutJaegersberg/Teuken-7B-instruct-commercial-v0.4-Q4_K_M-GGUF

Text Generation • 7B • Updated Nov 26, 2024 • 20 • 2

QuantFactory/Teuken-7B-instruct-research-v0.4-GGUF

Text Generation • 7B • Updated Nov 27, 2024 • 266 • 2

tensorblock/Quble_Test_Model_v1_Pretrain-GGUF

Text Generation • 0.2B • Updated Jan 27 • 41

beansandbytes/Teuken-7B-instruct-commercial-v0.4-Q4_K_M-GGUF

Text Generation • 7B • Updated Nov 27, 2024 • 8 • 1

kp-forks/whisper-large-v3-turbo

Automatic Speech Recognition • 0.8B • Updated Oct 4, 2024 • 7