Unsloth AI

unsloth's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

danielhanchen 

in unsloth/DeepSeek-V3.2-GGUF about 2 hours ago

Does this support DSA/lighting attention?

1

#1 opened about 4 hours ago by

segmond

danielhanchen 

in unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF about 4 hours ago

New Refresh with added Tool Calling in calibration dataset and improved imatrix

❤️ 3

#21 opened about 4 hours ago by

danielhanchen

danielhanchen 

updated a model about 8 hours ago

unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF

Text Generation • 31B • Updated about 7 hours ago • 105k • 415

danielhanchen 

updated 2 models about 9 hours ago

unsloth/Qwen3-Coder-30B-A3B-Instruct

Text Generation • 31B • Updated about 9 hours ago • 5.18k • 21

unsloth/DeepSeek-V3.2

Text Generation • 685B • Updated about 4 hours ago • 44 • 8

danielhanchen 

in unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF about 10 hours ago

Performance is poor

9

#1 opened 5 days ago by

sainnhe

danielhanchen 

updated a model about 10 hours ago

unsloth/DeepSeek-OCR-2

Image-Text-to-Text • 3B • Updated about 10 hours ago • 1.28k • 12

danielhanchen 

in unsloth/DeepSeek-OCR-2 about 10 hours ago

Unsloth implementation

3

#1 opened 2 days ago by

Kernel

danielhanchen 

in unsloth/Trinity-Large-Preview-GGUF about 11 hours ago

Quantasation for Ming-flash-omni-Preview?

1

#1 opened 1 day ago by

facehuggerfromspace

danielhanchen 

updated a model about 12 hours ago

unsloth/DeepSeek-V3.2-GGUF

671B • Updated about 4 hours ago • 1

danielhanchen 

published a model about 12 hours ago

unsloth/DeepSeek-V3.2-GGUF

671B • Updated about 4 hours ago • 1

danielhanchen 

updated a model about 17 hours ago

unsloth/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4

Text Generation • 18B • Updated about 17 hours ago • 10 • 1

danielhanchen 

published a model about 17 hours ago

unsloth/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4

Text Generation • 18B • Updated about 17 hours ago • 10 • 1

danielhanchen 

updated a model about 19 hours ago

unsloth/Kimi-K2.5-GGUF

1T • Updated about 19 hours ago • 5.57k • 101

danielhanchen 

updated a model 1 day ago

unsloth/Trinity-Large-Preview-GGUF

399B • Updated 1 day ago • 776 • 8

danielhanchen 

posted an update 1 day ago

view post

Post

1854

You can now run Kimi K2.5 locally! 🔥

We shrank the 1T model to 240GB (-60%) via Dynamic 1-bit.
Get >40 tok/s on 242GB or 622GB VRAM/RAM for near full precision.

GGUF: unsloth/Kimi-K2.5-GGUF

Guide: https://unsloth.ai/docs/models/kimi-k2.5

See translation

• 
• 

🚀

9

9

😎

3

3

👀

1

1

+

Reply

danielhanchen 

updated a model 1 day ago

unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF

Text Generation • 23B • Updated 1 day ago • 23.6k • 81

danielhanchen 

in unsloth/Kimi-K2.5-GGUF 1 day ago

Original model is just 600gb

9

#2 opened 1 day ago by

jpsequeira

danielhanchen 

in unsloth/GLM-4.7-Flash-REAP-23B-A3B-GGUF 1 day ago

The generation falls into constant repetition without any good result

8

#2 opened 4 days ago by

ddd2r2

Fix typos in README.md

1

#3 opened 4 days ago by

CoruNethron