vllm-project/tiny-random-BambaForCausalLM
Text Generation • 33.1M • Updated • 2.05k
CI
Models used in vLLM CI, last updated 2026-10-30. Checkpoints from personal accounts are copied here to reduce supply-chain risk.
-
-
vllm-project/tiny-random-LlamaForCausalLM
Text Generation • 1.06M • Updated • 153k • 2 -
vllm-project/tiny-random-Gemma2ForCausalLM
Text Generation • 8.44M • Updated • 50.6k • 1 -
vllm-project/Ilama-3.2-1B
Text Generation • 1B • Updated • 15.3k -
vllm-project/tiny-random-DeepseekV2ForCausalLM
Text Generation • 59.8M • Updated • 4.01k
vllm-project/tiny-qwen3-moe-fp8-per-block
20.3M • UpdatedNote Copied from https://hf.co/Adamji/tiny-qwen3-moe-fp8-per-block (commit c60911a)
vllm-project/Qwen3-30B-A3B-MXFP8
31B • UpdatedNote Copied from https://hf.co/AliEdalati97/Qwen3-30B-A3B-MXFP8 (commit 4a0ff6b)
vllm-project/FireRedASR2-LLM-vllm
Automatic Speech Recognition • UpdatedNote Copied from https://hf.co/allendou/FireRedASR2-LLM-vllm (commit 24078c3)
vllm-project/skywork-qwen3-0.6b-reward-lora
UpdatedNote Copied from https://hf.co/AmirMohseni/skywork-qwen3-0.6b-reward-lora (commit b7025ea)
vllm-project/colqwen3.5-4.5B-v3
Visual Document Retrieval • 5B • UpdatedNote Copied from https://hf.co/athrael-soju/colqwen3.5-4.5B-v3 (commit c4ea4b9)
vllm-project/ColUltraVBERT
Visual Document Retrieval • 0.3B • UpdatedNote Copied from https://hf.co/athrael-soju/ColUltraVBERT (commit 486d2f2)
vllm-project/Qwen3-0.6B-finetuned
0.6B • UpdatedNote Copied from https://hf.co/bd2lcco/Qwen3-0.6B-finetuned (commit 263add1)
vllm-project/qwen2.5-0.5b-modelopt-fp8-pb-wo
0.5B • UpdatedNote Copied from https://hf.co/CedricHwang/qwen2.5-0.5b-modelopt-fp8-pb-wo (commit 62bb490)
vllm-project/qwen2.5-0.5b-modelopt-fp8-pc-pt
0.5B • UpdatedNote Copied from https://hf.co/CedricHwang/qwen2.5-0.5b-modelopt-fp8-pc-pt (commit d9c8737)
vllm-project/self_cognition_Alice
UpdatedNote Copied from https://hf.co/charent/self_cognition_Alice (commit e260d82)
vllm-project/self_cognition_Bob
UpdatedNote Copied from https://hf.co/charent/self_cognition_Bob (commit b752160)
vllm-project/whisper-small-mandarin-lora
UpdatedNote Copied from https://hf.co/chengyili2005/whisper-small-mandarin-lora (commit 892d846)
vllm-project/Qwen3.5-0.8B-text-only
0.8B • UpdatedNote Copied from https://hf.co/codecho/Qwen3.5-0.8B-text-only (commit e0385f0)
vllm-project/Qwen3.5-35B-A3B-text-only
34B • UpdatedNote Copied from https://hf.co/codecho/Qwen3.5-35B-A3B-text-only (commit 504ce4f)
vllm-project/TinyLlama-1.1B-Chat-v1.0-W4A8-e2e
1B • UpdatedNote Copied from https://hf.co/czhu-cohere/TinyLlama-1.1B-Chat-v1.0-W4A8-e2e (commit 0e76f58)
vllm-project/deepseek-v3-random
4B • UpdatedNote Copied from https://hf.co/eagle618/deepseek-v3-random (commit b1d566c)
vllm-project/eagle-deepseek-v3-random
2B • UpdatedNote Copied from https://hf.co/eagle618/eagle-deepseek-v3-random (commit 8bafb3e)
vllm-project/gemma4-e2b-it-lora-pokemon
UpdatedNote Copied from https://hf.co/EpochEcho/gemma4-e2b-it-lora-pokemon (commit dce75fa)
vllm-project/qwen2.5-3b-vl-lora-vision-connector
UpdatedNote Copied from https://hf.co/EpochEcho/qwen2.5-3b-vl-lora-vision-connector (commit 861cbed)
vllm-project/qwen3-4b-vl-lora-vision-connector
UpdatedNote Copied from https://hf.co/EpochEcho/qwen3-4b-vl-lora-vision-connector (commit 32e223f)
vllm-project/deepseek_r1_3_layers_mxfp4
8B • UpdatedNote Copied from https://hf.co/fxmarty/deepseek_r1_3_layers_mxfp4 (commit c89081d)
vllm-project/Llama-3.1-70B-Instruct-2-layers-mxfp6
3B • UpdatedNote Copied from https://hf.co/fxmarty/Llama-3.1-70B-Instruct-2-layers-mxfp6 (commit fbce05a)
vllm-project/qwen1.5_moe_a2.7b_chat_w_fp4_a_fp6_e2m3
7B • UpdatedNote Copied from https://hf.co/fxmarty/qwen1.5_moe_a2.7b_chat_w_fp4_a_fp6_e2m3 (commit f002048)
vllm-project/qwen1.5_moe_a2.7b_chat_w_fp6_e3m2_a_fp6_e3m2
11B • UpdatedNote Copied from https://hf.co/fxmarty/qwen1.5_moe_a2.7b_chat_w_fp6_e3m2_a_fp6_e3m2 (commit ed8c2a6)
vllm-project/qwen_1.5-moe-a2.7b-mxfp4
7B • UpdatedNote Copied from https://hf.co/fxmarty/qwen_1.5-moe-a2.7b-mxfp4 (commit a9a4cfb)
vllm-project/Qwen3Guard-NewZealand-Classification-0.6B
Text Classification • UpdatedNote Copied from https://hf.co/geoffmunn/Qwen3Guard-NewZealand-Classification-0.6B (commit 1faa670)
vllm-project/Qwen3Guard-StarTrek-Classification-0.6B
Text Classification • UpdatedNote Copied from https://hf.co/geoffmunn/Qwen3Guard-StarTrek-Classification-0.6B (commit 6116253)
vllm-project/QQQ-Llama-3-8b-g128
2B • UpdatedNote Copied from https://hf.co/HandH1998/QQQ-Llama-3-8b-g128 (commit 51340bb)
vllm-project/small_qwen3_5_20b
20B • UpdatedNote Copied from https://hf.co/imdatta0/small_qwen3_5_20b (commit 801d554)
vllm-project/Qwen3-8B-fp-w8g128x128-for-ut
8B • UpdatedNote Copied from https://hf.co/INC4AI/Qwen3-8B-fp-w8g128x128-for-ut (commit 7447c94)
vllm-project/Qwen3-8B-MXFP8-AR
8B • UpdatedNote Copied from https://hf.co/INC4AI/Qwen3-8B-MXFP8-AR (commit 8403c04)
vllm-project/deepseek-vl2-tiny
Image-Text-to-Text • 3B • UpdatedNote Copied from https://hf.co/Isotr0py/deepseek-vl2-tiny (commit cca6d50)
vllm-project/Qwen3-0.6B-Meow-LoRA
Text Generation • UpdatedNote Copied from https://hf.co/Jackmin108/Qwen3-0.6B-Meow-LoRA (commit 59211b2)
vllm-project/Qwen3-0.6B-Woof-LoRA
Text Generation • UpdatedNote Copied from https://hf.co/Jackmin108/Qwen3-0.6B-Woof-LoRA (commit de7747c)
vllm-project/Qwen2.5-1.5B-apeach
Text Classification • 2B • UpdatedNote Copied from https://hf.co/jason9693/Qwen2.5-1.5B-apeach (commit 615164d)
vllm-project/baichuan-7b-lora-zero-regex
UpdatedNote Copied from https://hf.co/jeeejeee/baichuan-7b-lora-zero-regex (commit 68f6fe7)
vllm-project/baichuan7b-text2sql-spider
UpdatedNote Copied from https://hf.co/jeeejeee/baichuan7b-text2sql-spider (commit f47fc8d)
vllm-project/baichuan7b-zero-init
UpdatedNote Copied from https://hf.co/jeeejeee/baichuan7b-zero-init (commit 9fd014b)
vllm-project/chatglm3-text2sql-spider
UpdatedNote Copied from https://hf.co/jeeejeee/chatglm3-text2sql-spider (commit 40b6719)
vllm-project/gpt-oss-20b-lora-adapter-text2sql
UpdatedNote Copied from https://hf.co/jeeejeee/gpt-oss-20b-lora-adapter-text2sql (commit 350316a)
vllm-project/ilama-text2sql-spider
UpdatedNote Copied from https://hf.co/jeeejeee/ilama-text2sql-spider (commit c31e1d6)
vllm-project/llama32-3b-text2sql-spider
UpdatedNote Copied from https://hf.co/jeeejeee/llama32-3b-text2sql-spider (commit 1e3fef0)
vllm-project/minicpmv25-lora-pokemon
UpdatedNote Copied from https://hf.co/jeeejeee/minicpmv25-lora-pokemon (commit 296306d)
vllm-project/olmoe-instruct-text2sql-spider
UpdatedNote Copied from https://hf.co/jeeejeee/olmoe-instruct-text2sql-spider (commit 173c24a)
vllm-project/qwen2-vl-lora-pokemon
UpdatedNote Copied from https://hf.co/jeeejeee/qwen2-vl-lora-pokemon (commit c7df814)
vllm-project/qwen25-vl-lora-pokemon
UpdatedNote Copied from https://hf.co/jeeejeee/qwen25-vl-lora-pokemon (commit 2d1df9e)
vllm-project/qwen3-moe-text2sql-spider
UpdatedNote Copied from https://hf.co/jeeejeee/qwen3-moe-text2sql-spider (commit 9050939)
vllm-project/qwen35-4b-all-linear-pokemon-lora
UpdatedNote Copied from https://hf.co/jeeejeee/qwen35-4b-all-linear-pokemon-lora (commit 7ab1bfe)
vllm-project/qwen35-4b-text-only-sql-lora
UpdatedNote Copied from https://hf.co/jeeejeee/qwen35-4b-text-only-sql-lora (commit db59908)
vllm-project/qwen36-35ba3b-2d-weights-poken-lora
UpdatedNote Copied from https://hf.co/jeeejeee/qwen36-35ba3b-2d-weights-poken-lora (commit 40c36e6)
vllm-project/qwen36-35ba3b-moe-all-linear-poken-lora
UpdatedNote Copied from https://hf.co/jeeejeee/qwen36-35ba3b-moe-all-linear-poken-lora (commit 576fb09)
vllm-project/smollm-135m-lora-fineweb-faroese
Text Generation • UpdatedNote Copied from https://hf.co/jekunz/smollm-135m-lora-fineweb-faroese (commit e55c7de)
vllm-project/Qwen3-0.6B-GPTQ-Int4
Text Generation • 0.6B • UpdatedNote Copied from https://hf.co/JunHowie/Qwen3-0.6B-GPTQ-Int4 (commit b9d8700)
vllm-project/deepseek_mtp_draft_random
11B • UpdatedNote Copied from https://hf.co/luccafong/deepseek_mtp_draft_random (commit 09d3d08)
vllm-project/deepseek_mtp_main_random
6B • UpdatedNote Copied from https://hf.co/luccafong/deepseek_mtp_main_random (commit 6686238)
vllm-project/gemma-4-26B-AWQ
26B • UpdatedNote Copied from https://hf.co/mattbucci/gemma-4-26B-AWQ (commit cfe71af)
vllm-project/Llama-4-Scout-17B-16E-Instruct-2-layers-mxfp4
4B • UpdatedNote Copied from https://hf.co/mawong-amd/Llama-4-Scout-17B-16E-Instruct-2-layers-mxfp4 (commit be15711)
vllm-project/granite-20b-functioncalling-FP8-KV
20B • UpdatedNote Copied from https://hf.co/mbayser/granite-20b-functioncalling-FP8-KV (commit b46a2d2)
vllm-project/Kimi-K3-pruned75
Image-Text-to-Text • 737B • UpdatedNote Copied from https://hf.co/mgoin/Kimi-K3-pruned75 (commit 3c8e22f)
vllm-project/Minitron-4B-Base-FP8
4B • UpdatedNote Copied from https://hf.co/mgoin/Minitron-4B-Base-FP8 (commit e2f62cf)
vllm-project/Qwen3-0.6B-MXFP8
0.6B • UpdatedNote Copied from https://hf.co/mgoin/Qwen3-0.6B-MXFP8 (commit ab26a96)
vllm-project/LoRA-Llama-3.2-1B-tool-vllm-ci
UpdatedNote Copied from https://hf.co/minpeter/LoRA-Llama-3.2-1B-tool-vllm-ci (commit 4d16780)
vllm-project/EAGLE-Llama-4-Scout-17B-16E-Instruct
3B • UpdatedNote Copied from https://hf.co/morgendave/EAGLE-Llama-4-Scout-17B-16E-Instruct (commit 58ba52e)
vllm-project/Qwen2.5-VL-7B-for-VideoCls
8B • UpdatedNote Copied from https://hf.co/muziyongshixin/Qwen2.5-VL-7B-for-VideoCls (commit 976a251)
vllm-project/Qwen3-0.6B-AWQ
0.6B • UpdatedNote Copied from https://hf.co/Orion-zhen/Qwen3-0.6B-AWQ (commit 9f607be)
vllm-project/opt-125m-bnb-4bit
0.1B • UpdatedNote Copied from https://hf.co/poedator/opt-125m-bnb-4bit (commit f267cab)
vllm-project/qwen2vl-flickr-lora-language
Text Generation • UpdatedNote Copied from https://hf.co/prashanth058/qwen2vl-flickr-lora-language (commit 9a9b9bd)
vllm-project/qwen2vl-flickr-lora-tower
Text Generation • UpdatedNote Copied from https://hf.co/prashanth058/qwen2vl-flickr-lora-tower (commit bdf3869)
vllm-project/qwen2vl-flickr-lora-tower-connector
Text Generation • UpdatedNote Copied from https://hf.co/prashanth058/qwen2vl-flickr-lora-tower-connector (commit 852d920)
vllm-project/qwen-linear-algebra-coder
Text Generation • UpdatedNote Copied from https://hf.co/premjatin/qwen-linear-algebra-coder (commit f016ab8)
vllm-project/qwen2.5-vl-7b-eagle3-sgl
0.9B • UpdatedNote Copied from https://hf.co/Rayzl/qwen2.5-vl-7b-eagle3-sgl (commit 38d2bc0)
vllm-project/Kimi-K3-8L-dummy
UpdatedNote Copied from https://hf.co/riverclouds/Kimi-K3-8L-dummy (commit e91fcd8)
vllm-project/Kimi-K3-DSpark-for-8L-dummy
UpdatedNote Copied from https://hf.co/riverclouds/Kimi-K3-DSpark-for-8L-dummy (commit d74b4f4)
vllm-project/mixtral-lora
UpdatedNote Copied from https://hf.co/SangBinCho/mixtral-lora (commit 8cb2c9c)
vllm-project/Qwen2-7B-Instruct-embed-base
Text Classification • 7B • UpdatedNote Copied from https://hf.co/ssmits/Qwen2-7B-Instruct-embed-base (commit e86f50b)
vllm-project/Qwen3-4B-Instruct-2507-GPTQ-Int4
Text Generation • 4B • UpdatedNote Copied from https://hf.co/superjob/Qwen3-4B-Instruct-2507-GPTQ-Int4 (commit c3786b9)
vllm-project/llama_tweet_ptune
UpdatedNote Copied from https://hf.co/swapnilbp/llama_tweet_ptune (commit ad7faa5)
vllm-project/gemma-2b-it-GPTQ
Text Generation • 3B • UpdatedNote Copied from https://hf.co/TechxGenus/gemma-2b-it-GPTQ (commit 60eca81)
vllm-project/Llama-2-7B-Chat-GPTQ
Text Generation • 7B • UpdatedNote Copied from https://hf.co/TheBloke/Llama-2-7B-Chat-GPTQ (commit d5ad931)
vllm-project/OpenHermes-2.5-Mistral-7B-AWQ
7B • UpdatedNote Copied from https://hf.co/TheBloke/OpenHermes-2.5-Mistral-7B-AWQ (commit a0e39e3)
vllm-project/TinyLlama-1.1B-Chat-v0.3-AWQ
1B • UpdatedNote Copied from https://hf.co/TheBloke/TinyLlama-1.1B-Chat-v0.3-AWQ (commit d87af94)
vllm-project/TinyLlama-1.1B-Chat-v1.0-AWQ
1B • UpdatedNote Copied from https://hf.co/TheBloke/TinyLlama-1.1B-Chat-v1.0-AWQ (commit 2e78382)
vllm-project/TinyLlama-1.1B-Chat-v1.0-GPTQ
1B • UpdatedNote Copied from https://hf.co/TheBloke/TinyLlama-1.1B-Chat-v1.0-GPTQ (commit 9d4580a)
vllm-project/zephyr-7b-beta-lora
Text Generation • UpdatedNote Copied from https://hf.co/typeof/zephyr-7b-beta-lora (commit 0af61c5)
vllm-project/DeepSeek-V2-Lite-Chat-All-LoRA
UpdatedNote Copied from https://hf.co/wuchen01/DeepSeek-V2-Lite-Chat-All-LoRA (commit 2d66f69)
vllm-project/llama-2-7b-sql-lora-test
UpdatedNote Copied from https://hf.co/yard1/llama-2-7b-sql-lora-test (commit 0dfa347)
vllm-project/fbopt-350m-8bit
0.3B • UpdatedNote Copied from https://hf.co/yec019/fbopt-350m-8bit (commit 305f804)
vllm-project/mamba2-codestral-v0.1-tiny-random
Text Generation • 527k • UpdatedNote Copied from https://hf.co/yujiepan/mamba2-codestral-v0.1-tiny-random (commit a69055f)
vllm-project/DeepSeek-V3-4layers-MTP-FP8
7B • UpdatedNote Copied from https://hf.co/ZixiQi/DeepSeek-V3-4layers-MTP-FP8 (commit 6553d61)
-
AngelSlim/Qwen3-1.7B_eagle3
Updated • 71k • 8 -
AngelSlim/Qwen3-8B_eagle3
Updated • 2.18k • 1 -
ATH-MaaS/Ovis1.6-Gemma2-9B
Image-Text-to-Text • 10B • Updated • 4.05k • 273 -
ATH-MaaS/Ovis1.6-Llama3.2-3B
Image-Text-to-Text • 4B • Updated • 7.11k • 50 -
ATH-MaaS/Ovis2-1B
Image-Text-to-Text • 1B • Updated • 9.9k • 98 -
ATH-MaaS/Ovis2.5-2B
Image-Text-to-Text • 3B • Updated • 8.36k • 203 -
ATH-MaaS/Ovis2.6-30B-A3B
Image-Text-to-Text • 31B • Updated • 6.58k • 164 -
axolotl-ai-co/tiny-mixtral-30m
29.6M • Updated • 27.7k -
cyankiwi/gemma-4-26B-A4B-it-AWQ-4bit
Image-Text-to-Text • 26B • Updated • 945k • 111
vllm-project/NeuroBERT-NER
Token Classification • 9.53M • UpdatedNote Copied from https://hf.co/boltuix/NeuroBERT-NER (commit fdc13cd)
vllm-project/xlm-roberta-base-ner-hrl
0.3B • UpdatedNote Copied from https://hf.co/Davlan/xlm-roberta-base-ner-hrl (commit 253f557)
vllm-project/electrical-ner-ModernBERT-base
Token Classification • 0.1B • UpdatedNote Copied from https://hf.co/disham993/electrical-ner-ModernBERT-base (commit 94a0f59)
vllm-project/llama-7b
7B • UpdatedNote Copied from https://hf.co/huggyllama/llama-7b (commit 4782ad2)
vllm-project/e5-base
Sentence Similarity • 0.1B • UpdatedNote Copied from https://hf.co/intfloat/e5-base (commit b533fe4)
vllm-project/e5-large
Sentence Similarity • 0.3B • UpdatedNote Copied from https://hf.co/intfloat/e5-large (commit 4dc6d85)
vllm-project/e5-mistral-7b-instruct
Feature Extraction • 7B • UpdatedNote Copied from https://hf.co/intfloat/e5-mistral-7b-instruct (commit d62cc44)
vllm-project/e5-small
Sentence Similarity • 33.4M • UpdatedNote Copied from https://hf.co/intfloat/e5-small (commit e272f30)
vllm-project/multilingual-e5-base
Sentence Similarity • 0.3B • UpdatedNote Copied from https://hf.co/intfloat/multilingual-e5-base (commit d128750)
vllm-project/multilingual-e5-large
Feature Extraction • 0.6B • UpdatedNote Copied from https://hf.co/intfloat/multilingual-e5-large (commit 3d7cfbd)
vllm-project/multilingual-e5-large-instruct
Feature Extraction • 0.6B • UpdatedNote Copied from https://hf.co/intfloat/multilingual-e5-large-instruct (commit 274baa4)
vllm-project/multilingual-e5-small
Sentence Similarity • 0.1B • UpdatedNote Copied from https://hf.co/intfloat/multilingual-e5-small (commit 614241f)
vllm-project/llama-160m
Text Generation • 0.2B • UpdatedNote Copied from https://hf.co/JackFram/llama-160m (commit aca9b68)
vllm-project/llama-68m
Text Generation • UpdatedNote Copied from https://hf.co/JackFram/llama-68m (commit 9de8453)
vllm-project/roberta-large-ner-english
0.4B • UpdatedNote Copied from https://hf.co/Jean-Baptiste/roberta-large-ner-english (commit 8f3abc1)
vllm-project/VideoLLaMA3-2B-Image-HF
Image-Text-to-Text • 2B • UpdatedNote Copied from https://hf.co/lkhl/VideoLLaMA3-2B-Image-HF (commit 8694f8c)
vllm-project/slovak-gpt-j-405M
UpdatedNote Copied from https://hf.co/Milos/slovak-gpt-j-405M (commit ce46daa)
vllm-project/dse-qwen2-2b-mrl-v1
Visual Document Retrieval • UpdatedNote Copied from https://hf.co/MrLight/dse-qwen2-2b-mrl-v1 (commit 3fde446)
vllm-project/sentiment-polish-gpt2-small
0.1B • UpdatedNote Copied from https://hf.co/nie3e/sentiment-polish-gpt2-small (commit 0f42779)
vllm-project/xlm-roberta-base-language-detection
0.3B • UpdatedNote Copied from https://hf.co/papluca/xlm-roberta-base-language-detection (commit 9865598)
vllm-project/multi-label-class-classification-on-github-issues
UpdatedNote Copied from https://hf.co/Rami/multi-label-class-classification-on-github-issues (commit 2d82089)
vllm-project/e5-v
Sentence Similarity • 8B • UpdatedNote Copied from https://hf.co/royokong/e5-v (commit 684c4c9)
vllm-project/gte-base
Sentence Similarity • 0.1B • UpdatedNote Copied from https://hf.co/thenlper/gte-base (commit c078288)
vllm-project/gte-base-zh
Sentence Similarity • 0.1B • UpdatedNote Copied from https://hf.co/thenlper/gte-base-zh (commit 71ab794)
vllm-project/gte-large
Sentence Similarity • 0.3B • UpdatedNote Copied from https://hf.co/thenlper/gte-large (commit 4bef63f)
vllm-project/gte-large-zh
Sentence Similarity • 0.3B • UpdatedNote Copied from https://hf.co/thenlper/gte-large-zh (commit 64c364e)
vllm-project/gte-small
Sentence Similarity • 33.4M • UpdatedNote Copied from https://hf.co/thenlper/gte-small (commit 17e1f34)
vllm-project/gte-small-zh
Sentence Similarity • 30.3M • UpdatedNote Copied from https://hf.co/thenlper/gte-small-zh (commit af7bd46)
-
INCModel/Qwen3-1.7B-AutoRound-MXFP4-W4A4
2B • Updated • 640 -
INCModel/Qwen3-30B-A3B-12L-MXFP4-test
5B • Updated • 626 -
INCModel/Qwen3-30B-A3B-12L-MXFP8-test
Text Generation • 8B • Updated • 734 -
INCModel/Qwen3-30B-A3B-12L-W4A16-test
5B • Updated • 609
vllm-project/Qwen3-Reranker-0.6B-seq-cls
Text Ranking • 0.6B • UpdatedNote Copied from https://hf.co/tomaarsen/Qwen3-Reranker-0.6B-seq-cls (commit 6a5829f)
-
INCModel/Qwen3-30B-A3B-Instruct-2507-MXFP4-CT-AutoRound
17B • Updated • 505 -
inference-optimization/DeepSeek-V3-debug-add
1B • Updated • 20 -
inference-optimization/DeepSeek-V3-debug-add-FP8_DYNAMIC
1B • Updated • 29 -
inference-optimization/DeepSeek-V3-debug-add-NVFP4A16
0.9B • Updated • 26 -
inference-optimization/DeepSeek-V3-debug-empty
1B • Updated • 1.55k -
inference-optimization/DeepSeek-V3-debug-empty-FP8_DYNAMIC
1B • Updated • 1.23k -
inference-optimization/DeepSeek-V3-debug-empty-NVFP4A16
0.9B • Updated • 858 -
inference-optimization/DeepSeek-V3-debug-multiply
1B • Updated • 35 -
inference-optimization/DeepSeek-V3-debug-multiply-FP8_DYNAMIC
1B • Updated • 106 -
inference-optimization/DeepSeek-V3-debug-multiply-NVFP4A16
0.9B • Updated • 27
vllm-project/EAGLE-LLaMA3-Instruct-8B
UpdatedNote Copied from https://hf.co/yuhuili/EAGLE-LLaMA3-Instruct-8B (commit 5bfe556)
-
inference-optimization/Qwen3-0.6B-debug-add-FP8_BLOCK
0.6B • Updated • 20 -
inference-optimization/Qwen3-0.6B-debug-add-W4A16-G128
0.6B • Updated • 11 -
inference-optimization/Qwen3-0.6B-debug-multiply
0.6B • Updated • 32 -
inference-optimization/Qwen3-0.6B-debug-multiply-FP8_BLOCK
0.6B • Updated • 27
vllm-project/EAGLE-LLaMA3.1-Instruct-8B
UpdatedNote Copied from https://hf.co/yuhuili/EAGLE-LLaMA3.1-Instruct-8B (commit d0e4a20)
-
inference-optimization/Qwen3-0.6B-debug-multiply-W4A16-G128
0.6B • Updated • 13 -
inference-optimization/Qwen3-0.6B-FP8_BLOCK
0.6B • Updated • 283 -
inference-optimization/Qwen3-0.6B-W4A16-G128
0.6B • Updated • 784 -
inference-optimization/Qwen3-8B-speculators.peagle-qwen3arch-ckpt4
2B • Updated • 1.31k • 1 -
LnL-AI/TinyLlama-1.1B-Chat-v1.0-GPTQ-4bit
Text Generation • Updated • 6.57k
vllm-project/EAGLE3-LLaMA3.1-Instruct-8B
UpdatedNote Copied from https://hf.co/yuhuili/EAGLE3-LLaMA3.1-Instruct-8B (commit ada412b)
-
ModelCloud/Qwen1.5-1.8B-Chat-GPTQ-4bits-dynamic-cfg-with-lm_head-symTrue
2B • Updated • 2.86k -
nm-testing/asym-w8w8-int8-static-per-tensor-tiny-llama
1B • Updated • 268 -
nm-testing/dflash-qwen3-8b-speculators
2B • Updated • 1.37k -
nm-testing/Llama-3.2-1B-Instruct-FP8-KV
1B • Updated • 1.19k -
nm-testing/Llama-3.2-1B-Instruct-quip-w4a16
2B • Updated • 472 -
nm-testing/Llama-3.2-1B-Instruct-quipv16-nvfp4
1B • Updated • 405 -
nm-testing/Llama-3.2-1B-Instruct-spinquantR1R2R4-w4a16
2B • Updated • 477 -
nm-testing/Llama3_2_1B_speculator.eagle3
0.4B • Updated • 553 -
nm-testing/Meta-Llama-3-70B-Instruct-FBGEMM-nonuniform
Text Generation • 71B • Updated • 175 • 1 -
nm-testing/Meta-Llama-3-8B-FP8-compressed-tensors-test
Text Generation • 8B • Updated • 569 -
nm-testing/Meta-Llama-3-8B-Instruct-FBGEMM-nonuniform
Text Generation • 8B • Updated • 36 -
nm-testing/Meta-Llama-3-8B-Instruct-nonuniform-test
Text Generation • 8B • Updated • 2.26k -
nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Asym-Per-Token-Test
8B • Updated • 1.01k • 1 -
nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Per-Token-Test
Text Generation • 8B • Updated • 26 -
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-FP8-Channelwise-compressed-tensors
Text Generation • 8B • Updated • 20 • 2 -
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Static-Per-Tensor-Asym
8B • Updated • 44 -
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Static-Per-Tensor-Sym
8B • Updated • 54 -
nm-testing/pixtral-12b-FP8-dynamic
Image-Text-to-Text • 13B • Updated • 1.07k • 1 -
nm-testing/Qwen1.5-MoE-A2.7B-Chat-quantized.w4a16
14B • Updated • 2.13k • 1 -
nm-testing/Qwen2-1.5B-Instruct-FP8W8
Text Generation • 2B • Updated • 378 -
nm-testing/Qwen3-30B-A3B-FP8-block
Text Generation • 3B • Updated • 441 -
nm-testing/Qwen3-30B-A3B-Fp8-v1
31B • Updated • 133 -
nm-testing/Qwen3-30B-A3B-MXFP4A16
17B • Updated • 470 -
nm-testing/Qwen3-4B-mixed-quant-RTN-wNaM-a4
4B • Updated • 17 -
nm-testing/Qwen3-4B-mixed-quant-RTN-wNaM-asym
4B • Updated • 52 -
nm-testing/qwen3-8b-peagle-speculators
2B • Updated • 1.33k -
nm-testing/Qwen3-Next-80B-A3B-Instruct-NVFP4
46B • Updated • 205 • 2 -
nm-testing/Speculator-Qwen3-30B-MOE-VL-Eagle3
0.4B • Updated • 207 -
nm-testing/Speculator-Qwen3-8B-Eagle3-converted-071-quantized
1B • Updated • 1.42k -
nm-testing/Speculator-Qwen3-8B-Eagle3-converted-071-quantized-w4a16
1B • Updated • 1.01k -
nm-testing/SpeculatorLlama3-1-8B-Eagle3-converted-0717-quantized
1.0B • Updated • 1.49k -
nm-testing/TinyLlama-1.1B-Chat-v1.0-kvcache-fp8-attn_head
1B • Updated • 425 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-kvcache-fp8-tensor
1B • Updated • 1.08k -
nm-testing/TinyLlama-1.1B-Chat-v1.0-MXFP4
0.6B • Updated • 421 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4
0.7B • Updated • 894 -
nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4A16
0.7B • Updated • 309 -
nm-testing/tinyllama-oneshot-w4a16-channel-v2
Text Generation • 1B • Updated • 1.14k • 1 -
nm-testing/tinyllama-oneshot-w4a16-group128-v2
Text Generation • 1B • Updated • 755 -
nm-testing/tinyllama-oneshot-w8-channel-a8-tensor
Text Generation • 1B • Updated • 210 -
nm-testing/tinyllama-oneshot-w8a8-channel-dynamic-token-v2
Text Generation • 1B • Updated • 595 -
nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v2
Text Generation • 1B • Updated • 614 -
nm-testing/tinyllama-oneshot-w8w8-test-static-shape-change
Text Generation • 1B • Updated • 1.48k -
nm-testing/tinysmokeqwen3moe-W4A16-first-only
2.93M • Updated • 11 -
nm-testing/tinysmokeqwen3moe-W4A16-first-only-CTstable
2.93M • Updated • 1.22k -
OPEA/Qwen2.5-0.5B-Instruct-int4-sym-inc
0.2B • Updated • 5.96k -
peft-internal-testing/opt-125m-dummy-lora
Updated • 5.76k -
polaria-tech/zerank-2-reranker-vllm
Text Ranking • 4B • Updated • 7.73k • 2 -
PrunaAI/Einstein-v6.1-Llama3-8B-bnb-4bit-smashed
8B • Updated • 337 • 1 -
QuixiAI/Qwen3-30B-A3B-AWQ
Text Generation • 31B • Updated • 19.4k • 13 -
RecursiveSI/flint
Text Generation • 40B • Updated • 19k • 1.26k -
taobao-mnn/Qwen3-VL-8B-Instruct-Eagle3
Text Generation • 0.4B • Updated • 439 • 2 -
tiny-random/gpt-oss-bf16
Text Generation • 6.85M • Updated • 20.6k • 1 -
tiny-random/kimi-k3
Image-Text-to-Text • 0.2B • Updated • 656 • 1 -
tiny-random/qwen3-next-moe
Text Generation • 2.84M • Updated • 13.1k • 4 -
TitanML/tiny-mixtral
Text Generation • 0.2B • Updated • 5.15k • 2 -
torchao-testing/opt-125m-AWQConfig-Int4WeightOnlyConfig-v2-0.14.0.dev
Text Generation • Updated • 7 -
torchao-testing/opt-125m-Float8WeightOnlyConfig-v2-0.15.0
Updated • 115 -
torchao-testing/opt-125m-Int4WeightOnlyConfig-v2-0.14.0.dev
Text Generation • Updated • 15 -
torchao-testing/opt-125m-ModuleFqnToConfig-v1-regex-0.14.0.dev
Updated • 25 -
torchao-testing/Qwen3-8B-INT4-0.15.0dev-safetensors
Text Generation • 8B • Updated • 21 -
trl-internal-testing/tiny-GptOssForCausalLM
Text Generation • 3.24M • Updated • 168k • 4 -
unsloth/Llama-3.2-1B-Instruct
Text Generation • 1B • Updated • 1.37M • 112 -
unsloth/Meta-Llama-3.1-8B-Instruct
Text Generation • 8B • Updated • 184k • • 99 -
unsloth/tinyllama-bnb-4bit
Text Generation • 1B • Updated • 3k • 12
vllm-project/R-4B
Image-Text-to-Text • 5B • UpdatedNote Copied from https://hf.co/YannQi/R-4B (commit 0fbbf22)
-
inference-optimization/Qwen3-0.6B-debug-add
0.6B • Updated • 16
