Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

7,200

Base only

Active filters: nl

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int4-gs128-sym

Text Generation • 0.4B • Updated Apr 20, 2025 • 11

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int4-gs128-asym

Text Generation • 3B • Updated Apr 20, 2025 • 10

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int4-gs128-sym

Text Generation • 3B • Updated Apr 20, 2025 • 10

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoawq-int4-gs128-asym

Text Generation • 3B • Updated Apr 20, 2025 • 10

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoawq-int4-gs128-sym

Text Generation • 3B • Updated Apr 20, 2025 • 8

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int8-gs128-asym

Text Generation • 0.7B • Updated Apr 20, 2025 • 13

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int8-gs128-sym

Text Generation • 0.7B • Updated Apr 20, 2025 • 9

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int8-gs128-asym

Text Generation • 3B • Updated Apr 20, 2025 • 7

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int8-gs128-sym

Text Generation • 3B • Updated Apr 20, 2025 • 9

Hyphonical/aya-expanse-8b-Q4_K_M-GGUF

8B • Updated Apr 21, 2025 • 19

mlx-community/Llama-OuteTTS-1.0-1B-4bit

Text-to-Speech • 0.2B • Updated May 19, 2025 • 134 • 1

mlx-community/Llama-OuteTTS-1.0-1B-3bit

Text-to-Speech • 0.2B • Updated May 19, 2025 • 22 • 1

mlx-community/Llama-OuteTTS-1.0-1B-6bit

Text-to-Speech • 0.3B • Updated May 19, 2025 • 13 • 1

mlx-community/Llama-OuteTTS-1.0-1B-8bit

Text-to-Speech • 0.4B • Updated May 19, 2025 • 22 • 1

rntc/cometkiwi-pubmed

Translation • Updated Apr 22, 2025 • 5

mlx-community/Llama-OuteTTS-1.0-1B-fp16

Text-to-Speech • 1B • Updated May 19, 2025 • 27 • 3

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int4-gs64-asym

Text Generation • 0.4B • Updated Apr 22, 2025 • 11

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int4-gs64-sym

Text Generation • 0.4B • Updated Apr 22, 2025 • 12

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int4-gs64-asym

Text Generation • 3B • Updated Apr 22, 2025 • 13

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autogptq-int4-gs64-sym

Text Generation • 3B • Updated Apr 22, 2025 • 12

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs64-asym

Text Generation • 3B • Updated Apr 22, 2025 • 11

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoawq-int4-gs64-sym

Text Generation • 3B • Updated Apr 22, 2025 • 10

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int4-gs64-asym

Text Generation • 0.4B • Updated Apr 22, 2025 • 9

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoround-int4-gs64-sym

Text Generation • 0.4B • Updated Apr 22, 2025 • 10

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int4-gs64-asym

Text Generation • 3B • Updated Apr 22, 2025 • 13

fbaldassarri/ibm-granite_granite-3.3-2b-base-autogptq-int4-gs64-sym

Text Generation • 3B • Updated Apr 22, 2025 • 12

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoawq-int4-gs64-asym

Text Generation • 3B • Updated Apr 22, 2025 • 9

fbaldassarri/ibm-granite_granite-3.3-2b-base-autoawq-int4-gs64-sym

Text Generation • 3B • Updated Apr 22, 2025 • 10

Derur/piper-tts-models

Updated Apr 23, 2025 • 3

fbaldassarri/ibm-granite_granite-3.3-2b-instruct-autoround-int8-gs64-asym

Text Generation • 0.8B • Updated Apr 23, 2025 • 10