These are quantizations of the model openPangu-Embedded-7B-DeepDiver
Original model: https://huggingface.co/FreedomIntelligence/openPangu-Embedded-7B-DeepDiver
Download the latest llama.cpp to use them.
- Downloads last month
- 27
Hardware compatibility
Log In
to view the estimation
4-bit
5-bit
6-bit
8-bit
16-bit