Lugament_Remix
lugament-remix
·
AI & ML interests
Lugament_Remix's HuggingFace account.
I love downloading & running local models
Recent Activity
reacted to juiceb0xc0de's post with 👀 1 day ago
🦙 llama.cpp hit v1.0.0, so I built it a party
https://huggingface.co/spaces/juiceb0xc0de/BYOGGUF: Bring Your Own GGUF. Paste any public model repo, pick a quant, and chat with it on an RTX PRO 6000 Blackwell through ZeroGPU, on the minutes your account already has (5 a day free, 40 on PRO).
If you don’t have a GGUF, the Space will make you one. Sign in, point it at any public safetensors or GGUF repo, pick your quant types, and it converts and quantizes on CPU, so it costs you no GPU quota. The finished quants land in your own account with a model card, and one button takes them straight into the chat room. Something the size of Qwen3.8-27B is fine.
Anything up to 48 GB runs on half the card at the normal rate; bigger models get the full 96 GB and burn minutes twice as fast. Public, ungated repos only. Native CUDA 13 binaries for Blackwell, built on the first stable llama.cpp. reacted to juiceb0xc0de's post with 🔥 1 day ago
🦙 llama.cpp hit v1.0.0, so I built it a party
https://huggingface.co/spaces/juiceb0xc0de/BYOGGUF: Bring Your Own GGUF. Paste any public model repo, pick a quant, and chat with it on an RTX PRO 6000 Blackwell through ZeroGPU, on the minutes your account already has (5 a day free, 40 on PRO).
If you don’t have a GGUF, the Space will make you one. Sign in, point it at any public safetensors or GGUF repo, pick your quant types, and it converts and quantizes on CPU, so it costs you no GPU quota. The finished quants land in your own account with a model card, and one button takes them straight into the chat room. Something the size of Qwen3.8-27B is fine.
Anything up to 48 GB runs on half the card at the normal rate; bigger models get the full 96 GB and burn minutes twice as fast. Public, ungated repos only. Native CUDA 13 binaries for Blackwell, built on the first stable llama.cpp. updated a collection 25 days ago
My TrendingOrganizations
None yet