Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,219

Base only

Active filters: nl

tensorblock/CohereLabs_aya-23-35B-GGUF

35B • Updated Jan 27 • 32

mlx-community/aya-expanse-8b-8bit

Text Generation • 2B • Updated Apr 29, 2025 • 43

tensorblock/ChocoLlama_ChocoLlama-2-7B-instruct-GGUF

7B • Updated Jan 27 • 45

nhe-ai/Llasa-1B-Multilingual-mlx-8Bit

Text-to-Speech • 0.4B • Updated Apr 29, 2025 • 3

nhe-ai/Llasa-1B-Multilingual-mlx-4Bit

Text-to-Speech • 0.2B • Updated Apr 29, 2025 • 1

tensorblock/CohereLabs_aya-23-8B-GGUF

8B • Updated Jan 27 • 25

kyutai/dactory-models

Updated Apr 30, 2025 • 2

kyutai/helium-1-2b

Text Generation • 2B • Updated Apr 30, 2025 • 1.62k • 55

kyutai/helium-1-2b-books

Text Generation • 2B • Updated Apr 30, 2025 • 55 • 2

kyutai/helium-1-2b-hum

Text Generation • 2B • Updated Apr 30, 2025 • 42 • 1

kyutai/helium-1-2b-life

Text Generation • 2B • Updated Apr 30, 2025 • 52 • 2

kyutai/helium-1-2b-main

Text Generation • 2B • Updated Apr 30, 2025 • 73 • 3

kyutai/helium-1-2b-pop

Text Generation • 2B • Updated Apr 30, 2025 • 49 • 4

kyutai/helium-1-2b-science

Text Generation • 2B • Updated Apr 30, 2025 • 50 • 3

kyutai/helium-1-2b-stem

Text Generation • 2B • Updated Apr 30, 2025 • 56 • 2

kyutai/helium-1-2b-wiki

Text Generation • 2B • Updated Apr 30, 2025 • 53 • 1

ggml-org/Nomic-Embed-Text-V2-GGUF

Sentence Similarity • 0.5B • Updated Apr 30, 2025 • 2.43k • 17

eyassa/nomic-embed-text-v2-moe-Q8_0-GGUF

Sentence Similarity • 0.5B • Updated Apr 30, 2025 • 67

Pendrokar/xvapitch_skyrim

Text-to-Speech • Updated Jun 8, 2025 • 2

NikolayKozloff/helium-1-2b-science-Q8_0-GGUF

Text Generation • 2B • Updated Apr 30, 2025 • 17 • 2

NikolayKozloff/helium-1-2b-Q8_0-GGUF

Text Generation • 2B • Updated Apr 30, 2025 • 9 • 3

tensorblock/Unbabel_TowerInstruct-13B-v0.1-GGUF

Translation • 13B • Updated Jan 27 • 72

fbaldassarri/internlm_internlm3-8b-instruct-autoround-int4-gs128-asym

Text Generation • 2B • Updated Apr 30, 2025 • 17

fbaldassarri/internlm_internlm3-8b-instruct-autoround-int4-gs128-sym

Text Generation • 2B • Updated Apr 30, 2025 • 10

fbaldassarri/internlm_internlm3-8b-instruct-autogptq-int4-gs128-asym

Text Generation • 9B • Updated Apr 30, 2025 • 9

fbaldassarri/internlm_internlm3-8b-instruct-autogptq-int4-gs128-sym

Text Generation • 9B • Updated Apr 30, 2025 • 9

fbaldassarri/internlm_internlm3-8b-instruct-autoawq-int4-gs128-asym

Text Generation • 9B • Updated Apr 30, 2025 • 12

fbaldassarri/internlm_internlm3-8b-instruct-autoawq-int4-gs128-sym

Text Generation • 9B • Updated Apr 30, 2025 • 14

fbaldassarri/internlm_internlm3-8b-instruct-autoround-int4-gs64-asym

Text Generation • 2B • Updated Apr 30, 2025 • 13

fbaldassarri/internlm_internlm3-8b-instruct-autoround-int4-gs64-sym

Text Generation • 2B • Updated Apr 30, 2025 • 11