GSQ-RCO-GGUF
Collection
Non-uniform GGUF quantizations via GSQ + RCO: per-tensor mixed precision in standard GGUF form • 3 items • Updated • 43
👋 Open to Work
Kaloyan Nikolov
sleepyeldrazi
AI & ML interests
ML engineer working on LLM inference and training. Finalizing my M.Sc. Computer Science @ RWTH Aachen.
Currently focusing on DGX Spark models/frameworks. Contact: konik98@gmail.com
Recent Activity
upvoted a collection 10 days ago
GSQ-RCO-GGUF new activity 22 days ago
sleepyeldrazi/Ornith-1.5-REAP-20B-A3B-GGUF:List of pruned expertsOrganizations
None yet
upvoted a collection 10 days ago
List of pruned experts
5
#1 opened 26 days ago
by 
kdrapel
Early report running it on a DGX Spark, 4 concurrent @ 256k bf16 with SSD offload
👍 7
4
#31 opened about 1 month ago
by sleepyeldrazi
BF16 Missing currently
1
#1 opened about 1 month ago
by sleepyeldrazi
liked a
model about 1 month ago
NVME vs Optane?
3
#29 opened about 1 month ago
by 
AndyFaceHugger
Is it possible to offload n-gram to an NVMe SSD?
👀🚀 31
15
#11 opened about 1 month ago
by 
lingyezhixing
updated a
model about 1 month ago
published a
model about 1 month ago
Yet to see any gains from DFlash
👍 11
13
#3 opened about 1 month ago
by 
Dnonmi
BenchMAXXXED
➕ 2
33
#28 opened 2 months ago
by 
TawusGames
liked a
model about 1 month ago
Exploring ThinkingCap fine-tunes for Qwen 3.8: Is it still necessary with native `reasoning_effort`?
👍 4
2
#106 opened about 1 month ago
by 
icognito
How can I run this well on an RTX 5070 ti?
8
#36 opened about 1 month ago
by 
theonerm2
liked a
model about 1 month ago
updated a
model about 2 months ago
published a
model about 2 months ago
updated a
model about 2 months ago