Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,221

Base only

Active filters: on-device

Bombek1/xlm-roberta-base-litert

Feature Extraction • Updated Jan 12 • 20

mii-llm/nesso-4B-GGUF

Text Generation • 4B • Updated Jan 18 • 78

deepsky-ia/TinyLlama-1.1B-Chat-v1.0-GGUF-MacQuantized

Text Generation • 1B • Updated Jul 1 • 31 • 1

DexopT/gemma-3-1b-it-heretic-extreme-uncensored-abliterated-MNN

Text Generation • Updated Jan 16 • 24 • 1

DexopT/L3-Dark-Planet-8B-HERETIC-Uncensored-Abliterated-MNN

Text Generation • Updated Jan 16 • 14

DexopT/DS-R1-Qwen3-8B-ArliAI-RpR-v4-Small-MNN

Text Generation • Updated Jan 16 • 5

DexopT/DarkSapling-7B-v2.0-MNN

Text Generation • Updated Jan 16 • 15

Irfanuruchi/SmolLM-360M-Instruct-MLX-3bit

Text Generation • 45.3M • Updated Jan 17 • 12

Irfanuruchi/SmolLM-360M-Instruct-MLX-5bit

Text Generation • 67.9M • Updated Jan 17 • 10

Irfanuruchi/SmolLM-1.7B-Instruct-MLX-4bit

Text Generation • 0.3B • Updated Jan 17 • 104 • 1

mhylle/gemma3-270m-mist-9liner-bilingual-gguf

Text Generation • 0.3B • Updated Jan 19 • 8

mhylle/ministral-3b-mist-9liner-bilingual-gguf

Text Generation • 3B • Updated Jan 19 • 16

InspiratioNULL/CLIP-VIT-B-32-DataComp.XL-CoreML

Zero-Shot Image Classification • Updated Jan 20

macmacmacmac/gemma-3n-E2B-it-pte

Text Generation • Updated Jan 22 • 2

macmacmacmac/gemma-3n-E4B-it-pte

Text Generation • Updated Jan 22 • 3

ndlanier/gutsignal-food-ner-coreml

Token Classification • Updated Jan 25

jc-builds/triposr-ios

Image-to-3D • Updated Jul 3 • 8

DexopT/Qwen2.5-Coder-3B-Instruct-abliterated-MNN

Text Generation • Updated Jan 27 • 165

pkhairkh/bytedance-dolphin1.5-coreml

Image-Text-to-Text • Updated Jan 28 • 8

FluidInference/pocket-tts-coreml

Text-to-Speech • Updated Jul 11 • 825 • 7

SuperPauly/Gemmasutra_LiteRT-LM

Text Generation • Updated Feb 1 • 7

jjjunho/Qwen3-4B-Instruct-2507-MLC

Text Generation • Updated Feb 1

vikramlingam/gemma-3-270m-it-mlc-webgpu

Text Generation • Updated Feb 1

Mati83moni/functiongemma-270m-it-mobile-actions

Text Generation • 0.3B • Updated Feb 2 • 11 • 1

dipeshmajithia/Mirror-80M-MoE

Text Generation • Updated Feb 5

dipeshmajithia/Mirror-80M-MoE-GGUF

Text Generation • 81.1M • Updated Feb 5 • 6

PaulCamacho/mobanon-models

Token Classification • Updated Feb 17 • 3

gigibot/turkish-pretrained-model

Updated Feb 11 • 2

xuanwulab/HaS_Text_0209_0.6B_Q4

Text Generation • 0.6B • Updated Mar 4 • 186 • 1

xuanwulab/HaS_Image_0209_FP32

Image Segmentation • Updated Mar 3 • 57 • 3