Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,214

Base only

Active filters: on-device

XXXXyu/bitnet_b1_58-3B-vlut-gguf

Text Generation • 3B • Updated Jan 1 • 71

bisonnetworking/MediPhi-Instruct-mlx-4bit

Text Generation • 0.6B • Updated Dec 30, 2025 • 13

XXXXyu/Llama3-8B-1.58-100B-tokens-vlut-gguf

Text Generation • 8B • Updated Jan 1 • 82

cstr/nllb-200-coreml-128

Translation • Updated 14 days ago • 12

cstr/nllb-200-coreml-256

Translation • Updated 14 days ago • 31

uralstech/Qwen-2.5-1.5B-KCC-LiteRT-LM

Text Generation • Updated Dec 30, 2025 • 67

blackcloud1199/SmolLM2-1.7B-Executorch-Q8DA4W

Updated Dec 31, 2025 • 21

blackcloud1199/Qwen2.5-1.5B-Executorch-Q8DA4W

Updated Dec 31, 2025 • 21

ndlanier/gutsignal-food-parser-tinyllama-1.1b

1B • Updated Jan 6 • 44 • 1

ndlanier/gutsignal-food-parser-llama-3.2-1b

1B • Updated Jan 6 • 11

ndlanier/gutsignal-food-parser-llama-3.2-3b

3B • Updated Jan 6 • 12

vijayk-huggingface/orchestrix-actions

Text Generation • Updated Jan 8 • 7

Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-8bit

Text Generation • 0.4B • Updated Jan 17 • 14

Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-4bit

Text Generation • 0.2B • Updated Jan 6 • 9

bradyclarke/Lightning-1.7B-mlx-fp16

Text Generation • 2B • Updated Jan 7 • 12

bradyclarke/Lightning-1.7B-mlx-8Bit

Text Generation • 0.5B • Updated Jan 7 • 17

bradyclarke/Lightning-1.7B-mlx-4Bit

Text Generation • 0.3B • Updated Jan 7 • 15

bradyclarke/Lightning-1.7B-mlx-6Bit

Text Generation • 0.4B • Updated Jan 7 • 6

bradyclarke/Lightning-1.7B-mlx-5Bit

Text Generation • 0.3B • Updated Jan 7 • 10

bradyclarke/Lightning-1.7B-mlx-nvfp4

Text Generation • 0.4B • Updated Jan 7 • 12

bradyclarke/Lightning-1.7B-mlx-mxfp4

Text Generation • 0.3B • Updated Jan 7 • 9

charlesfeng1/qwen3-0.6b-notifai

0.6B • Updated Jan 8 • 9 • 1

mii-llm/nesso-4B

Text Generation • 4B • Updated Feb 2 • 535 • • 10

Irfanuruchi/Qwen2.5-0.5B-Instruct-MLX-4bit

Text Generation • 77.3M • Updated Jan 17 • 19

Irfanuruchi/Qwen2.5-0.5B-Instruct-MLX-8bit

Text Generation • 0.1B • Updated Jan 17 • 17

goodpixelltd/t5-grammar-coreml

Text Generation • Updated Jan 10

ndlanier/gutsignal-food-parser-tinyllama-1.1b-mlx

1B • Updated Jan 11 • 15

ndlanier/gutsignal-food-parser-llama-3.2-1b-mlx

1B • Updated Jan 11 • 8

ndlanier/gutsignal-food-parser-llama-3.2-3b-mlx

3B • Updated Jan 11 • 11

Irfanuruchi/Phi-4-mini-instruct-MLX-4bit

Text Generation • 0.6B • Updated Jan 17 • 10