metadata
{}
Test-Model
This model is a fine-tuned version of llama, and is specialized for document classification. The overall accuracy of the model is 0.978852 and the hit rate is 0.543211.
Training Parameters
- Epochs: 5
- Batch Size: 20
- Threshold: 0.975
- Token Length: 512
- Data Set Size: 10000
- Evenly Distributed: True
- Municipalities: Heroey, Kongsberg, Boemlo, Luster, Maalselv
- Learning Rate: 0.0001
- Weight Decay: 0.01
- Eval Accumulation Steps: 4