Quants? Also question.
#1
by
IZA09
- opened
could i request quants? preferably 8 or 6? id rather not run full precision if i can help it even if it would be easy. (unless you recommend it?)
Ive been looking for something to copilot my ObsidianMD setup, something to read through my logs and recall details i dont care to look for myself. Would this be useful for that purpose? i apologize if this is a dumb question, ive never used model for anything other than turn-based conversations and ive been window shopping.
We provide quantized models in the GGUF format.
Lightning-4b is a model specialized for database analysis. Since it can run on a laptop, it ensures high confidentiality and is ideal for cases where sending data to external LLM providers is not an option.