Models

747

Base only

Active filters: mlc-llm

huggingkot/Dolphin3.0-Qwen2.5-0.5B-q4f16_1-MLC

Text Generation • Updated Mar 3, 2025 • 2

huggingkot/Dolphin3.0-Qwen2.5-1.5B-q4f16_1-MLC

Text Generation • Updated Mar 3, 2025 • 1

huggingkot/Dolphin3.0-Qwen2.5-3b-q4f16_1-MLC

Text Generation • Updated Mar 3, 2025 • 3

huggingkot/Dolphin3.0-Llama3.1-8B-q4f16_1-MLC

Text Generation • Updated Mar 3, 2025 • 3

huggingkot/Dolphin3.0-Llama3.2-1B-q4f16_1-MLC

Text Generation • Updated Mar 3, 2025

huggingkot/Dolphin3.0-Llama3.2-3B-q4f16_1-MLC

Text Generation • Updated Mar 3, 2025 • 3

huggingkot/LLAMA-3_8B_Unaligned_BETA-q4f16_1-MLC

Text Generation • Updated Mar 4, 2025 • 3

smalinin/Llama-3.1-Storm-8B-q4f32_1-MLC

Text Generation • Updated Mar 4, 2025 • 2

huggingkot/OpenCAI-7B-V2-q4f16_1-MLC

Text Generation • Updated Mar 4, 2025 • 3

smalinin/gorilla-openfunctions-v2_q4f32_1-MLC

Updated Mar 4, 2025

huggingkot/OpenCAI-8B-V2-q4f16_1-MLC

Text Generation • Updated Mar 4, 2025

huggingkot/Lumimaid-Magnum-v4-12B-q4f16_1-MLC

Text Generation • Updated Mar 4, 2025 • 1

huggingkot/Lumimaid-v0.2-12B-q4f16_1-MLC

Text Generation • Updated Mar 4, 2025 • 4

huggingkot/Qwen2.5-Coder-14B-Instruct-q4f16_1-MLC

Text Generation • Updated Mar 5, 2025

huggingkot/Qwen2.5-Coder-7B-Instruct-q4f16_1-MLC

Text Generation • Updated Mar 5, 2025

huggingkot/Qwen2.5-Coder-3B-Instruct-q4f16_1-MLC

Text Generation • Updated Mar 5, 2025

huggingkot/Qwen2.5-Coder-1.5B-Instruct-q4f16_1-MLC

Text Generation • Updated Mar 5, 2025

huggingkot/MN-12B-Mag-Mell-R1-q4f16_1-MLC

Text Generation • Updated Mar 5, 2025 • 1

huggingkot/DeepSeek-Coder-V2-Lite-Instruct-q4f16_1-MLC

Text Generation • Updated Mar 5, 2025

mlc-ai/QwQ-32B-q4f32_1-MLC

Updated Sep 7, 2025 • 3

mlc-ai/QwQ-32B-q0f16-MLC

Updated Sep 7, 2025 • 4

mlc-ai/QwQ-32B-q4f16_1-MLC

Updated Sep 7, 2025 • 7 • 1

mlc-ai/QwQ-32B-q4f16_0-MLC

Updated Sep 7, 2025 • 5

smalinin/Qwen2.5-14B-Instruct_q4f32_1-MLC

Text Generation • Updated Apr 29, 2025

smalinin/Qwen2.5-14B-Instruct_q4f16_1-MLC

Text Generation • Updated Apr 29, 2025 • 7

huggingkot/Gemmasutra-Small-4B-v1-q4f16_1-MLC

Text Generation • Updated Mar 12, 2025 • 7

huggingkot/NeuralDaredevil-8B-abliterated-q4f16_1-MLC

Text Generation • Updated Mar 12, 2025 • 10

huggingkot/Violet_Twilight-v0.2-q4f16_1-MLC

Text Generation • Updated Mar 12, 2025 • 3

huggingkot/DeepHermes-3-Llama-3-8B-Preview-q4f16_1-MLC

Text Generation • Updated Mar 14, 2025 • 5

mlc-ai/gemma-3-1b-it-q4bf16_0-MLC

Updated Sep 7, 2025 • 14 • 1