---
license: apache-2.0
language:
- ko
base_model:
- trillionlabs/Tri-7B
---

This is a 4-bit quantized version of trillionlabs/Tri-7B using Intel AutoRound.

### Model Details
Base Model: trillionlabs/Tri-7B  
Quantization Method: Intel AutoRound (Best Configuration)  
Precision: 4-bit  
Group Size: 128  
Symmetric: True  
Calibration Samples: 512  
Tuning Iterations: 1000  

### Requirements
```
pip install transformers accelerate auto-round
```

### License
This model inherits the Apache 2.0 license from the original Tri-7B model.