turboderp
/

IQuest-Coder-V1-40B-Instruct-exl3

Model card Files Files and versions

EXL3 quants of IQuestLab/IQuest-Coder-V1-40B-Instruct

⚠️ Requires ExLlamaV3 v0.0.19 (or v0.0.18 dev branch)

Base bitrates:

4.00 bits per weight

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for turboderp/IQuest-Coder-V1-40B-Instruct-exl3

Base model

IQuestLab/IQuest-Coder-V1-40B-Instruct

Quantized

(16)

this model

Collection including turboderp/IQuest-Coder-V1-40B-Instruct-exl3

EXL3 models

46 items • Updated Jan 10 • 39