IQuest-Coder-V1-40B-Thinking-int8

This repository contains INT8 quantized versions of IQuestLab/IQuest-Coder-V1-40B-Thinking.

Original Model

Usage

Please refer to the original model page for usage instructions.

Downloads last month
-
Safetensors
Model size
40B params
Tensor type
F32
·
I8
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for xhxlb/IQuest-Coder-V1-40B-Thinking-int8

Quantized
(5)
this model

Collection including xhxlb/IQuest-Coder-V1-40B-Thinking-int8