IQuest-Coder-V1-7B-Base-Stage1
Collection
Quantized versions of IQuest-Coder-V1-7B-Base-Stage1 (GGUF, FP8, INT4, INT8,mlx-8bit). • 5 items • Updated
xhxlb/IQuest-Coder-V1-7B-Base-Stage1-8bit
This repository contains mlx quantized versions of IQuestLab/IQuest-Coder-V1-7B-Base-Stage1.
Original Model
- Base Model: IQuestLab/IQuest-Coder-V1-7B-Base-Stage1
- Organization: IQuestLab
- Downloads last month
- 43
Model size
8B params
Tensor type
BF16
·
U32 ·
Hardware compatibility
Log In to add your hardware
8-bit