IQuest-Coder-V1-7B-Instruct
Collection
Quantized versions of IQuest-Coder-V1-7B-Instruct (GGUF, FP8, INT4, INT8,mlx-8bit). • 5 items • Updated
xhxlb/IQuest-Coder-V1-7B-Instruct-8bit
This repository contains mlx quantized versions of IQuestLab/IQuest-Coder-V1-7B-Instruct.
Original Model
- Base Model: IQuestLab/IQuest-Coder-V1-7B-Instruct
- Organization: IQuestLab
- Downloads last month
- 30
Model size
8B params
Tensor type
BF16
·
U32 ·
Hardware compatibility
Log In to add your hardware
8-bit