File size: 559 Bytes
b408c23
39cdfed
b408c23
 
9ce91f2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
---

{}
---


# Test-Model

This model is a fine-tuned version of llama, and is specialized for document classification. It achieves the following results on the evaluation set:
- Accuracy: ACCURACY
- Hit rate: HIT RATE

## Training Parameters

- **Epochs**: 5
- **Batch Size**: 20
- **Threshold**: 0.975
- **Token Length**: 512
- **Data Set Size**: 10000
- **Evenly Distributed**: True
- **Municipalities**: Heroey, Kongsberg, Boemlo, Luster, Maalselv
- **Learning Rate**: 0.0001
- **Weight Decay**: 0.01
- **Eval Accumulation Steps**: 4