DeepSeek-V4.1-Flash EXL3 packs whose routed experts stream from SSD, for mlx-serve.
David Tai
OpensourceWTF
AI & ML interests
None yet
Recent Activity
updated a model about 13 hours ago
OpensourceWTF/Hy4-flash-exl3 published a model about 21 hours ago
OpensourceWTF/Hy4-flash-exl3 updated a model 1 day ago
OpensourceWTF/GLM-5.3-Flash-streaming-repack-exl3Organizations
MTPLX streaming packs
Packs for MTPLX on Apple silicon, most of them streaming their experts from SSD.
-
OpensourceWTF/DeepSeek-V4.1-Flash-MTPLX-streaming-q2
Updated • 477 • 4 -
OpensourceWTF/Hy3-oQ2e-MTPLX-streaming
Text Generation • 9B • Updated • 47 • 3 -
OpensourceWTF/Kimi-K3-Q2_K-t158-MTPLX-streaming
Text Generation • 57B • Updated • 335 -
OpensourceWTF/Qwen3.8-Flash-Next-MTPLX-oQ4-MTP
180B • Updated • 164 • 1
Qwen3.8-Flash-Next · mlx-serve EXL3
turboderp's Qwen3.8-Flash-Next EXL3 quants in mlx-serve's layout.
mlx-stream and other
Other streaming and MLX packs.
-
OpensourceWTF/Beam-1.0-501B-A23B-NVFP4-q8-mlx-stream
Text Generation • 3B • Updated • 396 • 1 -
OpensourceWTF/MiMo-V2.6-Flash-MOPD-fp8res-mlx-stream
Text Generation • 6B • Updated • 220 -
OpensourceWTF/Muse-Glimmer-30B-MLX-q4
Text Generation • 28B • Updated • 164 • 1 -
OpensourceWTF/DeepSeek-V4.1-Flash-1017-exl3-2.81bpw
Updated • 494 • 4
GLM-5.x · streaming EXL3
GLM-5.3 and GLM-5.3-Flash EXL3 packs whose experts stream from SSD, for mlx-serve + mlx-stream.
-
OpensourceWTF/GLM-5.3-Flash-streaming-repack-exl3-3.05bpw
10B • Updated • 464 • 1 -
OpensourceWTF/GLM-5.3-streaming-repack-exl3-3.0bpw
Text Generation • 19B • Updated • 132 -
OpensourceWTF/GLM-5.3-streaming-repack-exl3-3.42bpw
Text Generation • 19B • Updated • 176 -
OpensourceWTF/GLM-5.3-Flash-streaming-repack-exl3
Text Generation • Updated • 23 • 2
EXL3 streaming packs
DeepSeek-V4.1-Flash EXL3 packs whose routed experts stream from SSD, for mlx-serve.
mlx-stream and other
Other streaming and MLX packs.
-
OpensourceWTF/Beam-1.0-501B-A23B-NVFP4-q8-mlx-stream
Text Generation • 3B • Updated • 396 • 1 -
OpensourceWTF/MiMo-V2.6-Flash-MOPD-fp8res-mlx-stream
Text Generation • 6B • Updated • 220 -
OpensourceWTF/Muse-Glimmer-30B-MLX-q4
Text Generation • 28B • Updated • 164 • 1 -
OpensourceWTF/DeepSeek-V4.1-Flash-1017-exl3-2.81bpw
Updated • 494 • 4
MTPLX streaming packs
Packs for MTPLX on Apple silicon, most of them streaming their experts from SSD.
-
OpensourceWTF/DeepSeek-V4.1-Flash-MTPLX-streaming-q2
Updated • 477 • 4 -
OpensourceWTF/Hy3-oQ2e-MTPLX-streaming
Text Generation • 9B • Updated • 47 • 3 -
OpensourceWTF/Kimi-K3-Q2_K-t158-MTPLX-streaming
Text Generation • 57B • Updated • 335 -
OpensourceWTF/Qwen3.8-Flash-Next-MTPLX-oQ4-MTP
180B • Updated • 164 • 1
GLM-5.x · streaming EXL3
GLM-5.3 and GLM-5.3-Flash EXL3 packs whose experts stream from SSD, for mlx-serve + mlx-stream.
-
OpensourceWTF/GLM-5.3-Flash-streaming-repack-exl3-3.05bpw
10B • Updated • 464 • 1 -
OpensourceWTF/GLM-5.3-streaming-repack-exl3-3.0bpw
Text Generation • 19B • Updated • 132 -
OpensourceWTF/GLM-5.3-streaming-repack-exl3-3.42bpw
Text Generation • 19B • Updated • 176 -
OpensourceWTF/GLM-5.3-Flash-streaming-repack-exl3
Text Generation • Updated • 23 • 2
Qwen3.8-Flash-Next · mlx-serve EXL3
turboderp's Qwen3.8-Flash-Next EXL3 quants in mlx-serve's layout.