Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,195

Base only

Active filters: on-device

TitleOS/Lightning-1.7B-Q4_K_M-GGUF

Text Generation • 2B • Updated Dec 11, 2025 • 22

TitleOS/Lightning-1.7B-Q8_0-GGUF

Text Generation • 2B • Updated Dec 11, 2025 • 20 • 2

bartowski/TitleOS_Lightning-1.7B-GGUF

Text Generation • 2B • Updated Dec 11, 2025 • 650 • 2

alexgusevski/Lightning-1.7B-q2-mlx

Text Generation • 0.2B • Updated Dec 11, 2025 • 7

alexgusevski/Lightning-1.7B-q3-mlx

Text Generation • 0.2B • Updated Dec 11, 2025 • 6

alexgusevski/Lightning-1.7B-q4-mlx

Text Generation • 0.3B • Updated Dec 11, 2025 • 9

alexgusevski/Lightning-1.7B-q6-mlx

Text Generation • 0.4B • Updated Dec 11, 2025 • 8

alexgusevski/Lightning-1.7B-q8-mlx

Text Generation • 0.5B • Updated Dec 11, 2025 • 6

alexgusevski/Lightning-1.7B-mlx

Text Generation • 2B • Updated Dec 11, 2025 • 14 • 1

gocharlie-ai/charlie-micro-ov

Text Generation • Updated Dec 18, 2025 • 7

Yagna1/functiongemma-270m-mobile-actions

Text Generation • 0.3B • Updated Dec 21, 2025 • 17 • 1

DMindAI/DMind-3-nano

Text Generation • Updated Mar 4 • 57

Thorge-AI/functiongemma-270m-it-mobile-actions.litertlm

Updated Dec 21, 2025 • 3

blackcloud1199/Llama-3.2-1B-Executorch-SpinQuant

Updated Dec 26, 2025 • 9

blackcloud1199/Llama-3.2-3B-Executorch-Q8DA4W

Updated Dec 26, 2025 • 8

XXXXyu/Falcon3-1B-Instruct-1.58bit-vlut-gguf

Text Generation • 2B • Updated Jan 1 • 70

XXXXyu/bitnet_b1_58-3B-vlut-gguf

Text Generation • 3B • Updated Jan 1 • 72

bisonnetworking/MediPhi-Instruct-mlx-4bit

Text Generation • 0.6B • Updated Dec 30, 2025 • 13

XXXXyu/Llama3-8B-1.58-100B-tokens-vlut-gguf

Text Generation • 8B • Updated Jan 1 • 85

cstr/nllb-200-coreml-128

Translation • Updated 12 days ago • 12

cstr/nllb-200-coreml-256

Translation • Updated 12 days ago • 27

uralstech/Qwen-2.5-1.5B-KCC-LiteRT-LM

Text Generation • Updated Dec 30, 2025 • 67

blackcloud1199/SmolLM2-1.7B-Executorch-Q8DA4W

Updated Dec 31, 2025 • 19

blackcloud1199/Qwen2.5-1.5B-Executorch-Q8DA4W

Updated Dec 31, 2025 • 21

ndlanier/gutsignal-food-parser-tinyllama-1.1b

1B • Updated Jan 6 • 45 • 1

ndlanier/gutsignal-food-parser-llama-3.2-1b

1B • Updated Jan 6 • 11

ndlanier/gutsignal-food-parser-llama-3.2-3b

3B • Updated Jan 6 • 12

vijayk-huggingface/orchestrix-actions

Text Generation • Updated Jan 8 • 7

Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-8bit

Text Generation • 0.4B • Updated Jan 17 • 14

Irfanuruchi/Qwen2.5-1.5B-Instruct-MLX-4bit

Text Generation • 0.2B • Updated Jan 6 • 9