Some of my own quants:
- UNA-SOLAR-10.7B-Instruct-v1.0_Q5_K_M.gguf
- UNA-SOLAR-10.7B-Instruct-v1.0_Q8_0.gguf
Source: fblgit
Source Model: UNA-SOLAR-10.7B-Instruct-v1.0
Source models for fblgit/UNA-SOLAR-10.7B-Instruct-v1.0 (Merge)
Models utilizing fblgit/UNA-SOLAR-10.7B-Instruct-v1.0
- Weyaxi/SauerkrautLM-UNA-SOLAR-Instruct (Ref) (Merge)
- Downloads last month
- 3
Hardware compatibility
Log In to add your hardware
5-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support