MPI-vLLM Test Models - a wenyiwang Collection

wenyiwang 's Collections

GGUF CPU Testing

MPI-vLLM Test Models

MPI-vLLM Test Models

updated Nov 6, 2025

deepseek-ai/deepseek-coder-33b-instruct

Text Generation • 33B • Updated Mar 7, 2024 • 7.34k • 573
meta-llama/Meta-Llama-3-8B-Instruct

Text Generation • 8B • Updated Jun 18, 2025 • 1.47M • • 4.58k
meta-llama/Meta-Llama-3-8B

Text Generation • 8B • Updated Sep 27, 2024 • 1.37M • • 6.57k
Qwen/Qwen2.5-7B-Instruct

Text Generation • 8B • Updated Jan 12, 2025 • 12.8M • • 1.34k
facebook/opt-1.3b

Text Generation • Updated Sep 15, 2023 • 807k • 184
meta-llama/Llama-3.3-70B-Instruct

Text Generation • 71B • Updated Dec 21, 2024 • 763k • • 2.81k
Qwen/Qwen3-4B-Instruct-2507

Text Generation • 4B • Updated Sep 17, 2025 • 4.7M • • 873
deepseek-ai/DeepSeek-V3

Text Generation • 685B • Updated Mar 27, 2025 • 1.07M • • 4.09k
Qwen/Qwen3-30B-A3B-Instruct-2507

Text Generation • 31B • Updated Sep 17, 2025 • 882k • • 815
Qwen/Qwen3-235B-A22B-Instruct-2507

Text Generation • 235B • Updated Sep 17, 2025 • 131k • • 783
meta-llama/Llama-2-13b-chat-hf

Text Generation • 13B • Updated Apr 17, 2024 • 115k • • 1.12k
tiiuae/falcon-40b

Text Generation • 42B • Updated Aug 9, 2024 • 32.6k • 2.44k