Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

931

Base only

Active filters: on-device

blackcloud1199/Llama-3.2-3B-Executorch-Q8DA4W

Updated Dec 26, 2025 • 15

XXXXyu/Falcon3-1B-Instruct-1.58bit-vlut-gguf

Text Generation • 2B • Updated Jan 1 • 72

XXXXyu/bitnet_b1_58-3B-vlut-gguf

Text Generation • 3B • Updated Jan 1 • 82

bisonnetworking/MediPhi-Instruct-mlx-4bit

Text Generation • 0.6B • Updated Dec 30, 2025 • 24

XXXXyu/Llama3-8B-1.58-100B-tokens-vlut-gguf

Text Generation • 8B • Updated Jan 1 • 43

cstr/nllb-200-coreml-128

Translation • Updated Dec 29, 2025 • 27

cstr/nllb-200-coreml-256

Translation • Updated Dec 29, 2025 • 23

uralstech/Qwen-2.5-1.5B-KCC-LiteRT-LM

Text Generation • Updated Dec 30, 2025 • 26

blackcloud1199/SmolLM2-1.7B-Executorch-Q8DA4W

Updated Dec 31, 2025 • 8

blackcloud1199/Qwen2.5-1.5B-Executorch-Q8DA4W

Updated Dec 31, 2025 • 7

ndlanier/gutsignal-food-parser-tinyllama-1.1b

1B • Updated Jan 6 • 46 • 1

ndlanier/gutsignal-food-parser-llama-3.2-1b

1B • Updated Jan 6 • 13

ndlanier/gutsignal-food-parser-llama-3.2-3b

3B • Updated Jan 6 • 10

vijayk-huggingface/orchestrix-actions

Text Generation • Updated Jan 8 • 6

Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-8bit

Text Generation • 0.4B • Updated Jan 17 • 10

Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-4bit

Text Generation • 0.2B • Updated Jan 6 • 18

bradyclarke/Lightning-1.7B-mlx-fp16

Text Generation • 2B • Updated Jan 7 • 4

bradyclarke/Lightning-1.7B-mlx-8Bit

Text Generation • 0.5B • Updated Jan 7 • 2

bradyclarke/Lightning-1.7B-mlx-4Bit

Text Generation • 0.3B • Updated Jan 7 • 1

bradyclarke/Lightning-1.7B-mlx-6Bit

Text Generation • 0.4B • Updated Jan 7 • 1

bradyclarke/Lightning-1.7B-mlx-5Bit

Text Generation • 0.3B • Updated Jan 7 • 4

bradyclarke/Lightning-1.7B-mlx-nvfp4

Text Generation • 0.4B • Updated Jan 7 • 10

bradyclarke/Lightning-1.7B-mlx-mxfp4

Text Generation • 0.3B • Updated Jan 7 • 4

charlesfeng1/qwen3-0.6b-notifai

0.6B • Updated Jan 8 • 2 • 1

mii-llm/nesso-4B

Text Generation • 4B • Updated Feb 2 • 68 • • 9

Irfanuruchi/Qwen2.5-0.5B-Instruct-MLX-4bit

Text Generation • 77.3M • Updated Jan 17 • 25

Irfanuruchi/Qwen2.5-0.5B-Instruct-MLX-8bit

Text Generation • 0.1B • Updated Jan 17 • 8

goodpixelltd/t5-grammar-coreml

Text Generation • Updated Jan 10

ndlanier/gutsignal-food-parser-tinyllama-1.1b-mlx

1B • Updated Jan 11 • 23

ndlanier/gutsignal-food-parser-llama-3.2-1b-mlx

1B • Updated Jan 11 • 4