metadata
base_model:
- Retreatcost/Voxtral-TCR1-4b
base_model_relation: quantized
pipeline_tag: text-generation
library_name: safetensors
tags:
- exl3
- 4-bit
- 6-bit
- 8-bit
Original model: Voxtral-TCR1-4b by Retreatcost
Available EXL3 v0.0.15 quants
| Type | Size | CLI |
|---|---|---|
| H8-4.0BPW | 2.83 GB | Copy-paste the line or Download the batch file |
| H8-6.0BPW | 3.64 GB | Copy-paste the line or Download the batch file |
| H8-8.0BPW | 4.44 GB | Copy-paste the line or Download the batch file |
Requirements: A python installation with huggingface-hub module to use CLI.