| {} | |
| # Test-Model | |
| This model is a fine-tuned version of llama, and is specialized for document classification. The overall accuracy of the model is 0.978852 and the hit rate is 0.543211. | |
| ## Training Parameters | |
| - **Epochs**: 5 | |
| - **Batch Size**: 20 | |
| - **Threshold**: 0.975 | |
| - **Token Length**: 512 | |
| - **Data Set Size**: 10000 | |
| - **Evenly Distributed**: True | |
| - **Municipalities**: Heroey, Kongsberg, Boemlo, Luster, Maalselv | |
| - **Learning Rate**: 0.0001 | |
| - **Weight Decay**: 0.01 | |
| - **Eval Accumulation Steps**: 4 | |