Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

86

Base only

Active filters: layer-pruning

StargazerLabs/Qwen3.8-23B-Mini-Me-4bit

Image-Text-to-Text • 4B • Updated 8 days ago • 601 • 5

torchsnow/Qwen3.8-23B-Mini-Me-bf16-Q3_K_M-GGUF

Image-Text-to-Text • 22B • Updated 8 days ago • 293 • 1

dimitry-none/Qwen3.8-23B-Mini-Me-bf16-Q4_K_M-GGUF

Image-Text-to-Text • 22B • Updated 8 days ago • 575 • 1

ecyas/Qwen3.8-9B-Instruct-Turbo-Q8_0-GGUF

Text Generation • 11B • Updated 1 day ago • 1

ecyas/Qwen3.8-9B-Instruct-Turbo-Q5_K_M-GGUF

Text Generation • 11B • Updated 1 day ago • 1

Mercity/Qwen3-8B-LaCo-Pruned

Text Generation • 6B • Updated Apr 16 • 12 • 1

Mercity/Qwen3-8B-LaCo-30L

Text Generation • 7B • Updated Dec 30, 2025 • 12

safal312/BI-Mistral-7layers-SGR-Dolci

Text Generation • 6B • Updated Feb 3 • 11

safal312/Iterative-Qwen-7layers-SGR-Dolci

Text Generation • 6B • Updated Feb 3 • 95

safal312/BI-Llama-8layers-SGR-Dolci

Text Generation • 6B • Updated Feb 3 • 8

safal312/BI-Gemma-7layers-SGR-Dolci

Text Generation • 2B • Updated Feb 3 • 9

mradermacher/BI-Gemma-7layers-SGR-Dolci-GGUF

2B • Updated Feb 4 • 50

mradermacher/BI-Mistral-7layers-SGR-Dolci-GGUF

6B • Updated Feb 4 • 57

mradermacher/BI-Llama-8layers-SGR-Dolci-GGUF

6B • Updated Feb 4 • 96

gomyk/intent-student-L6_uniform

Sentence Similarity • 25.7M • Updated Mar 20 • 20

gomyk/intent-student-L4_uniform

Sentence Similarity • 22.2M • Updated Mar 20 • 49

gomyk/intent-student-L3_uniform

Sentence Similarity • 0.1B • Updated Mar 20 • 34

gomyk/intent-student-L6_top

Sentence Similarity • 0.1B • Updated Mar 20 • 36

gomyk/intent-student-L4_top

Sentence Similarity • 0.1B • Updated Mar 20 • 20

gomyk/intent-student-L6_bottom

Sentence Similarity • 25.7M • Updated Mar 20 • 34

gomyk/intent-student-L2_ends

Sentence Similarity • 99.9M • Updated Mar 20 • 46

gomyk/intent-student-L6_uniform_distilled

Sentence Similarity • 25.7M • Updated Mar 20 • 84

gomyk/intent-student-L4_uniform_distilled

Sentence Similarity • 22.2M • Updated Mar 20 • 82

gomyk/intent-student-L6_bottom_distilled

Sentence Similarity • 25.7M • Updated Mar 20 • 34

gomyk/intent-student-L6_bottom_distilled_v2

Sentence Similarity • 25.7M • Updated Mar 20 • 31

gomyk/intent-student-L3_compact

Sentence Similarity • 13.3M • Updated Mar 20 • 48

gomyk/intent-student-L4_compact

Sentence Similarity • 15.1M • Updated Mar 20 • 51

gomyk/intent-student-L6_compact

Sentence Similarity • 18.7M • Updated Mar 20 • 46

gomyk/intent-student-L6_compact_distilled

Sentence Similarity • 18.7M • Updated Mar 20 • 32

gomyk/modernbert-student-modernbert_L6_uniform

Sentence Similarity • 46.1M • Updated Mar 23 • 37