Pretty nice
#1
by
yano2mch
- opened
Trying this one out, and it seems quite nice for a 12B model. Though i doubt i could put it through it's full paces, as i have a preference for some 70B models.
Also seems to be uncensored. Which is a big plus for RPing.
I'm glad to hear that you liked it!
I'm glad to hear that you liked it!
I need to test it a bit more, but i think this one is probably what i'd recommend for lower-end computers, but not quite chromebook/laptop or phone, those would be too slow and too much resources for those devices.
Well unless NPU's become available and are built-in very soon....
(note, using mradermacher's gguf quanitization of your model in case you're wondering)