Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

885

Base only

Active filters: on-device

raining-codes/Qwen3-1.7B-LOMO-q4f16_1-MLC

Text Generation • Updated Oct 20, 2025 • 2

Apex-X/PRODIGY-LAB-SARA

Text Generation • 1B • Updated Oct 23, 2025 • 7 • 1

raining-codes/Qwen3-1.7B-LOMO-q4f16_1-MLC2

Text Generation • Updated Oct 21, 2025 • 1

mradermacher/PRODIGY-LAB-SARA-GGUF

Text Generation • 1B • Updated Oct 24, 2025 • 126

aoiandroid/Breeze-ASR-25_coreml

Automatic Speech Recognition • Updated Oct 22, 2025 • 7

TheStageAI/thewhisper-large-v3

Automatic Speech Recognition • 2B • Updated Dec 13, 2025 • 21 • 2

bhismaperkasa/gemma-3-1B-it-form-generator-q4_4096-tflite

Updated Nov 7, 2025 • 3

Apolo81/granite-4-350m-map-commands-gguf

Text Generation • 0.4B • Updated Nov 8, 2025 • 51 • 1

gyoyeonahn/MuseEye

Other • Updated Nov 13, 2025

argmaxinc/parakeetkit-litert-pro

Automatic Speech Recognition • Updated 6 days ago • 21.7k

kontextdev/agent-gemma

Image-Text-to-Text • 5B • Updated Mar 23 • 5 • 3

kontextdev/embeddinggemma-300m-litertlm

Feature Extraction • Updated Nov 27, 2025 • 134

pkhairkh/qwen3-coreml-palettized

Text Generation • Updated Apr 17 • 25 • 2

TitleOS/Lightning-1.7B-LoRA

Text Generation • Updated Dec 11, 2025

TitleOS/Lightning-1.7B

Text Generation • 2B • Updated Dec 11, 2025 • 6 • • 4

TitleOS/Lightning-1.7B-Q4_K_M-GGUF

Text Generation • 2B • Updated Dec 11, 2025 • 11

TitleOS/Lightning-1.7B-Q8_0-GGUF

Text Generation • 2B • Updated Dec 11, 2025 • 6 • 2

bartowski/TitleOS_Lightning-1.7B-GGUF

Text Generation • 2B • Updated Dec 11, 2025 • 815 • 2

alexgusevski/Lightning-1.7B-q2-mlx

Text Generation • 0.2B • Updated Dec 11, 2025 • 2

alexgusevski/Lightning-1.7B-q3-mlx

Text Generation • 0.2B • Updated Dec 11, 2025 • 1

alexgusevski/Lightning-1.7B-q4-mlx

Text Generation • 0.3B • Updated Dec 11, 2025 • 2

alexgusevski/Lightning-1.7B-q6-mlx

Text Generation • 0.4B • Updated Dec 11, 2025 • 2

alexgusevski/Lightning-1.7B-q8-mlx

Text Generation • 0.5B • Updated Dec 11, 2025 • 1

alexgusevski/Lightning-1.7B-mlx

Text Generation • 2B • Updated Dec 11, 2025 • 6 • • 1

gocharlie-ai/charlie-micro-ov

Text Generation • Updated Dec 18, 2025 • 1

Yagna1/functiongemma-270m-mobile-actions

Text Generation • 0.3B • Updated Dec 21, 2025 • 10 • 1

DMindAI/DMind-3-nano

Text Generation • Updated Mar 4 • 1 • 57

Thorge-AI/functiongemma-270m-it-mobile-actions.litertlm

Updated Dec 21, 2025 • 3

blackcloud1199/Llama-3.2-1B-Executorch-SpinQuant

Updated Dec 26, 2025 • 19

blackcloud1199/Llama-3.2-3B-Executorch-Q8DA4W

Updated Dec 26, 2025 • 14