Running
Trackio
🚀
Daniel (Unsloth) PRO
danielhanchen
AI & ML interests
None yet
Recent Activity
replied to
their
post
about 10 hours ago
You can now run Kimi K2.5 locally! 🔥
We shrank the 1T model to 240GB (-60%) via Dynamic 1-bit.
Get >40 tok/s on 242GB or 622GB VRAM/RAM for near full precision.
GGUF: https://huggingface.co/unsloth/Kimi-K2.5-GGUF
Guide: https://unsloth.ai/docs/models/kimi-k2.5
replied to
their
post
about 10 hours ago
You can now run Kimi K2.5 locally! 🔥
We shrank the 1T model to 240GB (-60%) via Dynamic 1-bit.
Get >40 tok/s on 242GB or 622GB VRAM/RAM for near full precision.
GGUF: https://huggingface.co/unsloth/Kimi-K2.5-GGUF
Guide: https://unsloth.ai/docs/models/kimi-k2.5
liked
a model
about 10 hours ago
unsloth/DeepSeek-V3.2-GGUF
Organizations
