Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

vector-quantization

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

78

Base only

Active filters: vector-quantization

Wojtekb30/Motion-RVQ-263d-reconstructor-humanML

Updated Jun 5 • 4

KikoCis/vq-llm-compression

maniac-11111/gemma-4-26B-A4B-it-mach-e8

0.5B • Updated Jun 24 • 9

aquaman164/GLM-5.2-VQ-Arith

Text Generation • 52B • Updated Jun 27 • 27

aquaman164/GLM-5.2-VQ-1.7bit-JA

Text Generation • 49B • Updated Jun 28 • 18

ShuaiAnwo/pore-codec-rsqf42c12a-510

Feature Extraction • 1.55M • Updated Jun 29 • 11

ShuaiAnwo/pore-codec-rsq742c12a-513

Feature Extraction • 1.17M • Updated Jun 30 • 9

ShuaiAnwo/pore-codec-rsq742c12a-514

Feature Extraction • 1.17M • Updated Jun 30 • 14

ShuaiAnwo/pore-codec-rsq742c12a-516

Feature Extraction • 1.17M • Updated Jun 30 • 10

ShuaiAnwo/pore-codec-rsqf42c12a-517

Feature Extraction • 1.55M • Updated Jun 30 • 11

ShuaiAnwo/PoreBERT-DNA-VQI-110M-530

Fill-Mask • 90.2M • Updated Jul 7 • 10

ShuaiAnwo/PoreBERT-DNA-VQI-007M-526

Feature Extraction • 7.37M • Updated Jul 7 • 14

aquaman164/GLM-5.2-VQ-1.9bit

Text Generation • 50B • Updated Jul 8 • 18

aquaman164/MiniMax-M3-VQ-2.4bit

Text Generation • 39B • Updated Jul 11 • 32

0x4C57/openeden-codebook-base-model

rdtand/Hy3-295B-A21B-prismaquant-gridbook-2.9bit-vllm

Text Generation • 104B • Updated Jul 28 • 24 • 3

rdtand/Qwen3.6-27B-prismaquant-gridbook-5.5bit-vllm

Image-Text-to-Text • 20B • Updated Jul 28 • 103 • 6

goals4292/ArcVQ-VAE

rdtand/Laguna-S-2.1-prismaquant-gridbook-6bit-vllm

Text Generation • 85B • Updated Jul 28 • 91 • 8

Pier-Jean/Qwen3-4B-LLVQ-2bit

scdrand23/ReVQom

baai-brain/brainmu-tokenizer

Feature Extraction • 0.7B • Updated Aug 17 • 2 • 1

TheDrainFlorist/Qwen3.5-397B-A17B-VQ-2.2bpw

Text Generation • 46B • Updated 4 days ago • 1.93k

TheDrainFlorist/Qwen3.5-397B-A17B-VQ-2.4bpw

Text Generation • 113B • Updated 4 days ago • 1.91k

TheDrainFlorist/Qwen3.5-397B-A17B-VQ-3.1bpw

Text Generation • 50B • Updated 4 days ago • 2.02k

TheDrainFlorist/Qwen3.6-35B-A3B-VQ-4.6bpw

Text Generation • 7B • Updated 5 days ago • 1.91k

TheDrainFlorist/Qwen3.6-35B-A3B-VQ-3.4bpw

Text Generation • 6B • Updated 5 days ago • 1.87k

TheDrainFlorist/gemma-4-26b-a4b-it-VQ-6.2bpw

Image-Text-to-Text • 7B • Updated 5 days ago • 469

TheDrainFlorist/gemma-4-e4b-it-VQ-PLE

Image-Text-to-Text • 6B • Updated 5 days ago • 265

Jiahao-Wang/openvla-7b-libero-spatial-vq-b3-k1024-b64-r32-50k-seed7-v1

Robotics • 8B • Updated Aug 21 • 9