Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

938

Base only

Active filters: on-device

XXXXyu/Falcon3-1B-Instruct-1.58bit-vlut-gguf

Text Generation • 2B • Updated Jan 1 • 70

XXXXyu/bitnet_b1_58-3B-vlut-gguf

Text Generation • 3B • Updated Jan 1 • 77

bisonnetworking/MediPhi-Instruct-mlx-4bit

Text Generation • 0.6B • Updated Dec 30, 2025 • 24

XXXXyu/Llama3-8B-1.58-100B-tokens-vlut-gguf

Text Generation • 8B • Updated Jan 1 • 41

cstr/nllb-200-coreml-128

Translation • Updated Dec 29, 2025 • 27

cstr/nllb-200-coreml-256

Translation • Updated Dec 29, 2025 • 23

uralstech/Qwen-2.5-1.5B-KCC-LiteRT-LM

Text Generation • Updated Dec 30, 2025 • 27

blackcloud1199/SmolLM2-1.7B-Executorch-Q8DA4W

Updated Dec 31, 2025 • 12

blackcloud1199/Qwen2.5-1.5B-Executorch-Q8DA4W

Updated Dec 31, 2025 • 9

ndlanier/gutsignal-food-parser-tinyllama-1.1b

1B • Updated Jan 6 • 46 • 1

ndlanier/gutsignal-food-parser-llama-3.2-1b

1B • Updated Jan 6 • 13

ndlanier/gutsignal-food-parser-llama-3.2-3b

3B • Updated Jan 6 • 10

vijayk-huggingface/orchestrix-actions

Text Generation • Updated Jan 8 • 6

Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-8bit

Text Generation • 0.4B • Updated Jan 17 • 10

Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-4bit

Text Generation • 0.2B • Updated Jan 6 • 17

bradyclarke/Lightning-1.7B-mlx-fp16

Text Generation • 2B • Updated Jan 7 • 4

bradyclarke/Lightning-1.7B-mlx-8Bit

Text Generation • 0.5B • Updated Jan 7 • 2

bradyclarke/Lightning-1.7B-mlx-4Bit

Text Generation • 0.3B • Updated Jan 7 • 1

bradyclarke/Lightning-1.7B-mlx-6Bit

Text Generation • 0.4B • Updated Jan 7 • 1

bradyclarke/Lightning-1.7B-mlx-5Bit

Text Generation • 0.3B • Updated Jan 7 • 3

bradyclarke/Lightning-1.7B-mlx-nvfp4

Text Generation • 0.4B • Updated Jan 7 • 10

bradyclarke/Lightning-1.7B-mlx-mxfp4

Text Generation • 0.3B • Updated Jan 7 • 3

charlesfeng1/qwen3-0.6b-notifai

0.6B • Updated Jan 8 • 2 • 1

mii-llm/nesso-4B

Text Generation • 4B • Updated Feb 2 • 66 • • 9

Irfanuruchi/Qwen2.5-0.5B-Instruct-MLX-4bit

Text Generation • 77.3M • Updated Jan 17 • 27

Irfanuruchi/Qwen2.5-0.5B-Instruct-MLX-8bit

Text Generation • 0.1B • Updated Jan 17 • 8

goodpixelltd/t5-grammar-coreml

Text Generation • Updated Jan 10

ndlanier/gutsignal-food-parser-tinyllama-1.1b-mlx

1B • Updated Jan 11 • 23

ndlanier/gutsignal-food-parser-llama-3.2-1b-mlx

1B • Updated Jan 11 • 4

ndlanier/gutsignal-food-parser-llama-3.2-3b-mlx

3B • Updated Jan 11 • 14