IQuest-Coder-V1-40B-Thinking
Collection
Quantized versions of IQuest-Coder-V1-40B-Thinking (GGUF, FP8, INT4, INT8,mlx-8bit). • 6 items • Updated
xhxlb/IQuest-Coder-V1-40B-Thinking-8bit
This repository contains mlx quantized versions of IQuestLab/IQuest-Coder-V1-40B-Thinking.
Original Model
- Base Model: IQuestLab/IQuest-Coder-V1-40B-Thinking
- Organization: IQuestLab
- Downloads last month
- 25
Model size
40B params
Tensor type
BF16
·
U32 ·
Hardware compatibility
Log In to add your hardware
8-bit