glogwa68/granite-4.0-h-1b-DISTILL-glm-4.7-GGUF
Text Generation
•
1B
•
Updated
•
495
•
2
David
lofitolstoy
·
AI & ML interests
None yet
Recent Activity
liked
a model
4 days ago
glogwa68/granite-4.0-h-1b-DISTILL-glm-4.7-GGUF
liked
a model
26 days ago
mrm8488/bert-hash-pico-ft-prompt-injection
reacted
to
danielhanchen's
post
with ❤️
4 months ago
Run DeepSeek-V3.1 locally on 170GB RAM with Dynamic 1-bit GGUFs!🐋
GGUFs: https://huggingface.co/unsloth/DeepSeek-V3.1-GGUF
The 715GB model gets reduced to 170GB (-80% size) by smartly quantizing layers.
The 1-bit GGUF passes all our code tests & we fixed the chat template for llama.cpp supported backends.
Guide: https://docs.unsloth.ai/basics/deepseek-v3.1
Organizations
None yet
liked
a
model
4 days ago
liked
a
model
26 days ago
reacted to
danielhanchen's
post with ❤️
4 months ago
Post
6563
Run DeepSeek-V3.1 locally on 170GB RAM with Dynamic 1-bit GGUFs!🐋
GGUFs: unsloth/DeepSeek-V3.1-GGUF
The 715GB model gets reduced to 170GB (-80% size) by smartly quantizing layers.
The 1-bit GGUF passes all our code tests & we fixed the chat template for llama.cpp supported backends.
Guide: https://docs.unsloth.ai/basics/deepseek-v3.1
GGUFs: unsloth/DeepSeek-V3.1-GGUF
The 715GB model gets reduced to 170GB (-80% size) by smartly quantizing layers.
The 1-bit GGUF passes all our code tests & we fixed the chat template for llama.cpp supported backends.
Guide: https://docs.unsloth.ai/basics/deepseek-v3.1
liked
a
model
5 months ago
liked
a
Space
8 months ago
updated
a
Space
9 months ago
published
a
Space
9 months ago
liked
a
Space
10 months ago
liked
a
model
11 months ago
published
a
Space
11 months ago
liked
a
model
about 1 year ago
liked
a
dataset
about 1 year ago
liked
2
datasets
over 2 years ago