IQuest-Coder-V1-7B-Base
Collection
Quantized versions of IQuest-Coder-V1-7B-Base (GGUF, FP8, INT4, INT8,mlx-8bit). • 5 items • Updated
xhxlb/IQuest-Coder-V1-7B-Base-8bit
This repository contains mlx quantized versions of IQuestLab/IQuest-Coder-V1-7B-Base.
Original Model
- Base Model: IQuestLab/IQuest-Coder-V1-7B-Base
- Organization: IQuestLab
- Downloads last month
- 46
Model size
8B params
Tensor type
BF16
·
U32 ·
Hardware compatibility
Log In to add your hardware
8-bit