Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

model-compression

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

115

Base only

Active filters: model-compression

MoNE-Pruning/DeepSeek-V2-Lite-MoNE-48-zyda2-1000

Text Generation • 12B • Updated Feb 28 • 4

MoNE-Pruning/DeepSeek-V2-Lite-MoNE-48-zyda2-100

Text Generation • 12B • Updated Feb 28 • 8

MoNE-Pruning/Qwen2-57B-A14B-MoNE-48-zyda2-100

Text Generation • 45B • Updated Feb 28 • 9

MoNE-Pruning/Qwen2-57B-A14B-Instruct-MoNE-48-math-100

Text Generation • 45B • Updated Mar 2 • 8

MoNE-Pruning/Qwen2-57B-A14B-Instruct-MoNE-48-gsm8k-100

Text Generation • 45B • Updated Mar 2 • 3

animeshakr/oct-retinal-weights

Image Classification • Updated Apr 14 • 6 • 2

robotflowlabs/FORGE-Nano-Benchmark

Robotics • Updated Mar 19

alonsopg/qwen2audio-selected-layer-codec-q2

alonsopg/qwen2audio-selected-layer-codec-q3

gomyk/qwen3-student-qwen3_compressed

Sentence Similarity • 12.4M • Updated Mar 26 • 4

gomyk/qwen3-student-qwen3_compressed_distilled

Sentence Similarity • 12.4M • Updated Mar 26 • 2

gomyk/me5s-student-me5s_compressed

Sentence Similarity • 13.3M • Updated Mar 27 • 4

gomyk/me5s-student-me5s_compressed_distilled

Sentence Similarity • 13.3M • Updated Mar 27 • 22

gomyk/gte-student-gte_compressed

Sentence Similarity • 12.8M • Updated Mar 27 • 3

gomyk/gte-student-gte_compressed_distilled

Sentence Similarity • 12.8M • Updated Mar 27 • 30

gomyk/gemma-student-gemma_emb_compressed

Sentence Similarity • 12.5M • Updated Mar 27 • 13

gomyk/gemma-student-gemma_emb_compressed_distilled

Sentence Similarity • 12.5M • Updated Mar 27 • 6

gomyk/gemma-student-gemma_emb_mrl_distilled_128d

Sentence Similarity • 11.2M • Updated Mar 30 • 3

gomyk/jina-v5-student-jina_v5_compressed_distilled_v2

Sentence Similarity • 19.3M • Updated Mar 31 • 3

gomyk/jina-v5-student-jina_v5_compressed_distilled_10ep

Sentence Similarity • 19.3M • Updated Mar 31 • 4

gomyk/jina-v5-student-jina_v5_compressed_distilled_trainonly

Sentence Similarity • 19.3M • Updated Apr 1 • 19

gomyk/jina-v5-student-jina_v5_compressed

Sentence Similarity • 19.1M • Updated Apr 1 • 3

gomyk/jina-v5-student-jina_v5_compressed_distilled

Sentence Similarity • 19.1M • Updated Apr 1 • 24 • 1

gomyk/jina-v5-h256-distilled

Sentence Similarity • 17M • Updated Apr 2 • 4

gomyk/jina-v5-h256-lora-classification

Text Classification • Updated Apr 6

gomyk/jina-v5-h256-lora-classification-universal

Text Classification • Updated Apr 6

gomyk/jina-v5-h256-lora-clf-merged

Sentence Similarity • 17M • Updated Apr 6 • 18

iLearn-Lab/ICMR25-HMKD

Scalai/scal-lite-60b-code-math

Text Generation • 76B • Updated Apr 13 • 10

MLliu6/Qwen3-VL-2B-Instruct-AWQ-W4A16

Image-Text-to-Text • 2B • Updated Apr 17 • 19