Q6_K is surprisingly phenomenal.
#7 opened 16 days ago
by
YourMOMSaidHi
Update README.md
#6 opened 3 months ago
by
iosovi
Request ARM quants
#5 opened about 1 year ago
by
lucid-gunner
Reproducibility
3
#3 opened over 1 year ago
by
fedric95
surprising - that model is incredible for it's size.
🚀
2
20
#2 opened over 1 year ago
by
mirek190
GGML_ASSERT: src/llama.cpp:11811: false
2
#1 opened over 1 year ago
by
alexcardo