Gruber's picture

1 156

Gruber

gruber

·

gruberdev

AI & ML interests

None yet

Recent Activity

liked a model about 1 month ago

distil-whisper/distil-large-v3.5

reacted to danielhanchen's post with 🚀 about 2 months ago

You can now run Kimi K2 Thinking locally with our Dynamic 1-bit GGUFs: https://huggingface.co/unsloth/Kimi-K2-Thinking-GGUF We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference. We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰 Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally

reacted to danielhanchen's post with 🔥 about 2 months ago

You can now run Kimi K2 Thinking locally with our Dynamic 1-bit GGUFs: https://huggingface.co/unsloth/Kimi-K2-Thinking-GGUF We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference. We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰 Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally

View all activity

Organizations

None yet

liked a model about 1 month ago

distil-whisper/distil-large-v3.5

Automatic Speech Recognition • 0.8B • Updated Mar 25 • 6.22k • 74

reacted to danielhanchen's post with 🚀🔥❤️ about 2 months ago

Post

4359

You can now run Kimi K2 Thinking locally with our Dynamic 1-bit GGUFs: unsloth/Kimi-K2-Thinking-GGUF

We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference.

We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰

Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally

liked a model 3 months ago

nari-labs/Dia-1.6B

Text-to-Speech • Updated Jun 1 • 83k • • 2.82k

liked a model 4 months ago

LLM360/K2-Think

Text Generation • 33B • Updated Nov 19 • 768 • 364

liked 2 models 6 months ago

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • 8B • Updated Apr 6 • 101k • 96

microsoft/OmniParser

Image-Text-to-Text • Updated Dec 2, 2024 • 387 • 1.7k

liked a Space 7 months ago

Whisper

Transcribe audio files or YouTube videos into text

liked 2 models 8 months ago

Zyphra/Zonos-v0.1-hybrid

Text-to-Speech • Updated Jun 3 • 32.8k • 1.1k

futo-org/acft-whisper-small

Automatic Speech Recognition • 0.3B • Updated Jun 25, 2024 • 14 • 4

upvoted a collection 8 months ago

Whisper ACFT

https://github.com/futo-org/whisper-acft • 6 items • Updated Jun 26, 2024 • 7

liked a Space 9 months ago

Whisper Turbo

Transcribe audio or YouTube videos into text

liked 2 models 10 months ago

perplexity-ai/r1-1776

Text Generation • 671B • Updated Feb 26 • 778 • 2.33k

uncensoredai/UncensoredLM-DeepSeek-R1-Distill-Qwen-14B

14B • Updated Feb 2 • 34 • 28

liked a model 11 months ago

deepseek-ai/DeepSeek-R1-Distill-Qwen-32B

Text Generation • 33B • Updated Feb 24 • 2.74M • • 1.48k

liked a Space 11 months ago

GPU Poor LLM Arena

Compact LLM Battle Arena: Frugal AI Face-Off!

liked a dataset 11 months ago

unalignment/toxic-dpo-v0.1

Viewer • Updated Dec 26, 2023 • 302 • 75 • 136

liked a Space 11 months ago

Chat With Janus-Pro-7B

A unified multimodal understanding and generation model.

liked a model 11 months ago

lmstudio-community/DeepSeek-R1-Distill-Qwen-14B-GGUF

Text Generation • 15B • Updated Jan 20 • 5.03k • 38