GreenBitAI/DeepSeek-V4.1-Flash-1017-4bit-paged
Image-Text-to-Text • 9B • Updated • 645 • 4
Haojin Yang
yanghaojin
AI & ML interests
None yet
Recent Activity
reacted to theirpost with 👀 4 days ago
DeepSeek-V4.1-Flash-1017, running locally on a Mac
Our 4-bit paged build is up: https://huggingface.co/GreenBitAI/DeepSeek-V4.1-Flash-1017-4bit-paged
On one M3 Ultra Mac Studio with gbx:
• ~22 tok/s standard decode
• ~44 tok/s on code with DeepSeek's official draft head (1.99×)
• ~33 tok/s on chat with the draft head
Why run 1017: DeepSeek reports 77.0 on DeepSWE v1.1 (up from 74.2) and 42.3 on Terminal-Bench 4.0 (up from 31.2), with shorter outputs (https://api-docs.deepseek.com/news/news261017).
It reads text and images, and plugs straight into Claude Code and Codex; the setup is in the model card. The paged format also loads on Macs with less memory, and on an NVIDIA DGX Spark with experts paged from the SSD;
Engine: https://github.com/GreenBitAI/gbx-lm/releases reacted to theirpost with 🚀 4 days ago
DeepSeek-V4.1-Flash-1017, running locally on a Mac
Our 4-bit paged build is up: https://huggingface.co/GreenBitAI/DeepSeek-V4.1-Flash-1017-4bit-paged
On one M3 Ultra Mac Studio with gbx:
• ~22 tok/s standard decode
• ~44 tok/s on code with DeepSeek's official draft head (1.99×)
• ~33 tok/s on chat with the draft head
Why run 1017: DeepSeek reports 77.0 on DeepSWE v1.1 (up from 74.2) and 42.3 on Terminal-Bench 4.0 (up from 31.2), with shorter outputs (https://api-docs.deepseek.com/news/news261017).
It reads text and images, and plugs straight into Claude Code and Codex; the setup is in the model card. The paged format also loads on Macs with less memory, and on an NVIDIA DGX Spark with experts paged from the SSD;
Engine: https://github.com/GreenBitAI/gbx-lm/releases reacted to theirpost with 🔥 4 days ago
DeepSeek-V4.1-Flash-1017, running locally on a Mac
Our 4-bit paged build is up: https://huggingface.co/GreenBitAI/DeepSeek-V4.1-Flash-1017-4bit-paged
On one M3 Ultra Mac Studio with gbx:
• ~22 tok/s standard decode
• ~44 tok/s on code with DeepSeek's official draft head (1.99×)
• ~33 tok/s on chat with the draft head
Why run 1017: DeepSeek reports 77.0 on DeepSWE v1.1 (up from 74.2) and 42.3 on Terminal-Bench 4.0 (up from 31.2), with shorter outputs (https://api-docs.deepseek.com/news/news261017).
It reads text and images, and plugs straight into Claude Code and Codex; the setup is in the model card. The paged format also loads on Macs with less memory, and on an NVIDIA DGX Spark with experts paged from the SSD;
Engine: https://github.com/GreenBitAI/gbx-lm/releasesOrganizations
liked a
model 4 days ago
liked a
model 20 days ago
liked a
Space almost 3 years ago