File size: 40,533 Bytes
9e9169f
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
---
library_name: transformers
license: apache-2.0
base_model: facebook/detr-resnet-50-dc5
tags:
- generated_from_trainer
model-index:
- name: checkpoints
  results: []
---

<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->

# checkpoints

This model is a fine-tuned version of [facebook/detr-resnet-50-dc5](https://huggingface.co/facebook/detr-resnet-50-dc5) on an unknown dataset.
It achieves the following results on the evaluation set:
- Loss: 2.3614
- Map: 0.0116
- Map 50: 0.0224
- Map 75: 0.0105
- Map Small: 0.0058
- Map Medium: 0.0165
- Map Large: 0.0098
- Mar 1: 0.0323
- Mar 10: 0.0618
- Mar 100: 0.0643
- Mar Small: 0.0215
- Mar Medium: 0.0607
- Mar Large: 0.0811
- Map Shirt, blouse: 0.0
- Mar 100 Shirt, blouse: 0.0
- Map Top, t-shirt, sweatshirt: 0.0234
- Mar 100 Top, t-shirt, sweatshirt: 0.3322
- Map Sweater: 0.0
- Mar 100 Sweater: 0.0
- Map Cardigan: 0.0
- Mar 100 Cardigan: 0.0
- Map Jacket: 0.0
- Mar 100 Jacket: 0.0
- Map Vest: 0.0
- Mar 100 Vest: 0.0
- Map Pants: 0.1092
- Mar 100 Pants: 0.6471
- Map Shorts: 0.0
- Mar 100 Shorts: 0.0
- Map Skirt: 0.0
- Mar 100 Skirt: 0.0
- Map Coat: 0.0
- Mar 100 Coat: 0.0
- Map Dress: 0.0869
- Mar 100 Dress: 0.7291
- Map Jumpsuit: 0.0
- Mar 100 Jumpsuit: 0.0
- Map Cape: 0.0
- Mar 100 Cape: 0.0
- Map Glasses: 0.0
- Mar 100 Glasses: 0.0
- Map Hat: 0.0
- Mar 100 Hat: 0.0
- Map Headband, head covering, hair accessory: 0.0
- Mar 100 Headband, head covering, hair accessory: 0.0
- Map Tie: 0.0
- Mar 100 Tie: 0.0
- Map Glove: 0.0
- Mar 100 Glove: 0.0
- Map Watch: 0.0
- Mar 100 Watch: 0.0
- Map Belt: 0.0069
- Mar 100 Belt: 0.0043
- Map Leg warmer: 0.0
- Mar 100 Leg warmer: 0.0
- Map Tights, stockings: 0.0
- Mar 100 Tights, stockings: 0.0
- Map Sock: 0.0
- Mar 100 Sock: 0.0
- Map Shoe: 0.2046
- Mar 100 Shoe: 0.4928
- Map Bag, wallet: 0.0
- Mar 100 Bag, wallet: 0.0
- Map Scarf: 0.0
- Mar 100 Scarf: 0.0
- Map Umbrella: 0.0
- Mar 100 Umbrella: 0.0
- Map Hood: 0.0
- Mar 100 Hood: 0.0
- Map Collar: 0.0
- Mar 100 Collar: 0.0
- Map Lapel: 0.0
- Mar 100 Lapel: 0.0
- Map Epaulette: 0.0
- Mar 100 Epaulette: 0.0
- Map Sleeve: 0.0724
- Mar 100 Sleeve: 0.4613
- Map Pocket: 0.0001
- Mar 100 Pocket: 0.042
- Map Neckline: 0.0292
- Mar 100 Neckline: 0.2495
- Map Buckle: 0.0
- Mar 100 Buckle: 0.0
- Map Zipper: 0.0
- Mar 100 Zipper: 0.0
- Map Applique: 0.0
- Mar 100 Applique: 0.0
- Map Bead: 0.0
- Mar 100 Bead: 0.0
- Map Bow: 0.0
- Mar 100 Bow: 0.0
- Map Flower: 0.0
- Mar 100 Flower: 0.0
- Map Fringe: 0.0
- Mar 100 Fringe: 0.0
- Map Ribbon: 0.0
- Mar 100 Ribbon: 0.0
- Map Rivet: 0.0
- Mar 100 Rivet: 0.0
- Map Ruffle: 0.0
- Mar 100 Ruffle: 0.0
- Map Sequin: 0.0
- Mar 100 Sequin: 0.0
- Map Tassel: 0.0
- Mar 100 Tassel: 0.0

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- learning_rate: 1e-05
- train_batch_size: 4
- eval_batch_size: 4
- seed: 42
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- training_steps: 10000
- mixed_precision_training: Native AMP

### Training results

| Training Loss | Epoch  | Step  | Validation Loss | Map    | Map 50 | Map 75 | Map Small | Map Medium | Map Large | Mar 1  | Mar 10 | Mar 100 | Mar Small | Mar Medium | Mar Large | Map Shirt, blouse | Mar 100 Shirt, blouse | Map Top, t-shirt, sweatshirt | Mar 100 Top, t-shirt, sweatshirt | Map Sweater | Mar 100 Sweater | Map Cardigan | Mar 100 Cardigan | Map Jacket | Mar 100 Jacket | Map Vest | Mar 100 Vest | Map Pants | Mar 100 Pants | Map Shorts | Mar 100 Shorts | Map Skirt | Mar 100 Skirt | Map Coat | Mar 100 Coat | Map Dress | Mar 100 Dress | Map Jumpsuit | Mar 100 Jumpsuit | Map Cape | Mar 100 Cape | Map Glasses | Mar 100 Glasses | Map Hat | Mar 100 Hat | Map Headband, head covering, hair accessory | Mar 100 Headband, head covering, hair accessory | Map Tie | Mar 100 Tie | Map Glove | Mar 100 Glove | Map Watch | Mar 100 Watch | Map Belt | Mar 100 Belt | Map Leg warmer | Mar 100 Leg warmer | Map Tights, stockings | Mar 100 Tights, stockings | Map Sock | Mar 100 Sock | Map Shoe | Mar 100 Shoe | Map Bag, wallet | Mar 100 Bag, wallet | Map Scarf | Mar 100 Scarf | Map Umbrella | Mar 100 Umbrella | Map Hood | Mar 100 Hood | Map Collar | Mar 100 Collar | Map Lapel | Mar 100 Lapel | Map Epaulette | Mar 100 Epaulette | Map Sleeve | Mar 100 Sleeve | Map Pocket | Mar 100 Pocket | Map Neckline | Mar 100 Neckline | Map Buckle | Mar 100 Buckle | Map Zipper | Mar 100 Zipper | Map Applique | Mar 100 Applique | Map Bead | Mar 100 Bead | Map Bow | Mar 100 Bow | Map Flower | Mar 100 Flower | Map Fringe | Mar 100 Fringe | Map Ribbon | Mar 100 Ribbon | Map Rivet | Mar 100 Rivet | Map Ruffle | Mar 100 Ruffle | Map Sequin | Mar 100 Sequin | Map Tassel | Mar 100 Tassel |
|:-------------:|:------:|:-----:|:---------------:|:------:|:------:|:------:|:---------:|:----------:|:---------:|:------:|:------:|:-------:|:---------:|:----------:|:---------:|:-----------------:|:---------------------:|:----------------------------:|:--------------------------------:|:-----------:|:---------------:|:------------:|:----------------:|:----------:|:--------------:|:--------:|:------------:|:---------:|:-------------:|:----------:|:--------------:|:---------:|:-------------:|:--------:|:------------:|:---------:|:-------------:|:------------:|:----------------:|:--------:|:------------:|:-----------:|:---------------:|:-------:|:-----------:|:-------------------------------------------:|:-----------------------------------------------:|:-------:|:-----------:|:---------:|:-------------:|:---------:|:-------------:|:--------:|:------------:|:--------------:|:------------------:|:---------------------:|:-------------------------:|:--------:|:------------:|:--------:|:------------:|:---------------:|:-------------------:|:---------:|:-------------:|:------------:|:----------------:|:--------:|:------------:|:----------:|:--------------:|:---------:|:-------------:|:-------------:|:-----------------:|:----------:|:--------------:|:----------:|:--------------:|:------------:|:----------------:|:----------:|:--------------:|:----------:|:--------------:|:------------:|:----------------:|:--------:|:------------:|:-------:|:-----------:|:----------:|:--------------:|:----------:|:--------------:|:----------:|:--------------:|:---------:|:-------------:|:----------:|:--------------:|:----------:|:--------------:|:----------:|:--------------:|
| 4.3049        | 0.0438 | 500   | 3.6778          | 0.0005 | 0.0016 | 0.0001 | 0.001     | 0.0006     | 0.0006    | 0.0013 | 0.0048 | 0.0091  | 0.0056    | 0.0112     | 0.0279    | 0.0               | 0.0                   | 0.0                          | 0.0                              | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0       | 0.0           | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.0169   | 0.1377       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0051     | 0.2822         | 0.0        | 0.0            | 0.0          | 0.0              | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 4.0072        | 0.0877 | 1000  | 3.2435          | 0.0021 | 0.0056 | 0.001  | 0.0023    | 0.0028     | 0.0005    | 0.0039 | 0.0114 | 0.0155  | 0.0104    | 0.0205     | 0.0298    | 0.0               | 0.0                   | 0.0                          | 0.0                              | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0       | 0.0           | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.083    | 0.3566       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0154     | 0.3576         | 0.0        | 0.0            | 0.0          | 0.0              | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 3.2281        | 0.1315 | 1500  | 3.0550          | 0.0033 | 0.0081 | 0.0021 | 0.0029    | 0.0046     | 0.0002    | 0.0059 | 0.015  | 0.0181  | 0.013     | 0.0235     | 0.0288    | 0.0               | 0.0                   | 0.0                          | 0.0                              | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0       | 0.0           | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0006    | 0.0075        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1173   | 0.3901       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0267     | 0.3585         | 0.0        | 0.0            | 0.0061       | 0.0772           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 3.2953        | 0.1753 | 2000  | 2.9315          | 0.0034 | 0.0084 | 0.0021 | 0.0024    | 0.0053     | 0.0009    | 0.0076 | 0.0197 | 0.0227  | 0.0161    | 0.0265     | 0.024     | 0.0               | 0.0                   | 0.0                          | 0.0                              | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0       | 0.0           | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0098    | 0.1102        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1012   | 0.4111       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.032      | 0.3735         | 0.0        | 0.0006         | 0.0118       | 0.1481           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 2.5306        | 0.2192 | 2500  | 2.8260          | 0.0042 | 0.0105 | 0.0028 | 0.0028    | 0.0057     | 0.002     | 0.0093 | 0.0241 | 0.0273  | 0.0177    | 0.0284     | 0.0343    | 0.0               | 0.0                   | 0.0                          | 0.0                              | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0002    | 0.0003        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0318    | 0.2535        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1067   | 0.4251       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0354     | 0.3962         | 0.0        | 0.0026         | 0.0205       | 0.1784           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 2.8446        | 0.2630 | 3000  | 2.7502          | 0.0051 | 0.0113 | 0.004  | 0.0034    | 0.0058     | 0.003     | 0.012  | 0.0283 | 0.0314  | 0.0161    | 0.0313     | 0.0446    | 0.0               | 0.0                   | 0.0002                       | 0.0008                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0132    | 0.065         | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0338    | 0.3398        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1305   | 0.4584       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0385     | 0.4044         | 0.0        | 0.0078         | 0.018        | 0.1688           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 2.3798        | 0.3069 | 3500  | 2.6691          | 0.0065 | 0.0138 | 0.0053 | 0.0031    | 0.0065     | 0.0057    | 0.0185 | 0.0375 | 0.0407  | 0.0181    | 0.0334     | 0.056     | 0.0               | 0.0                   | 0.001                        | 0.0063                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0486    | 0.2917        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0645    | 0.5028        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1233   | 0.4518       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0419     | 0.3999         | 0.0        | 0.0108         | 0.0185       | 0.2072           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 1.8111        | 0.3507 | 4000  | 2.6270          | 0.0074 | 0.0159 | 0.0062 | 0.0037    | 0.0075     | 0.0065    | 0.0219 | 0.0415 | 0.0443  | 0.0168    | 0.0354     | 0.0607    | 0.0               | 0.0                   | 0.0086                       | 0.0486                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0581    | 0.3519        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0753    | 0.5732        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1428   | 0.4334       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0409     | 0.4027         | 0.0        | 0.0216         | 0.0165       | 0.2056           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 2.3798        | 0.3945 | 4500  | 2.5748          | 0.0076 | 0.0157 | 0.0066 | 0.0041    | 0.01       | 0.0061    | 0.0233 | 0.0486 | 0.0515  | 0.018     | 0.042      | 0.074     | 0.0               | 0.0                   | 0.013                        | 0.1139                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0528    | 0.4863        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0582    | 0.6506        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1605   | 0.4713       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0394     | 0.4381         | 0.0        | 0.0184         | 0.0258       | 0.1922           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 2.3017        | 0.4384 | 5000  | 2.5355          | 0.0079 | 0.0162 | 0.007  | 0.0044    | 0.0113     | 0.0063    | 0.0259 | 0.0521 | 0.0553  | 0.0198    | 0.0462     | 0.0793    | 0.0               | 0.0                   | 0.0149                       | 0.1621                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0607    | 0.5462        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0504    | 0.6648        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1652   | 0.4824       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0485     | 0.4417         | 0.0001     | 0.0277         | 0.0251       | 0.2184           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 2.1818        | 0.4822 | 5500  | 2.5019          | 0.0088 | 0.0176 | 0.0077 | 0.005     | 0.0118     | 0.0071    | 0.0267 | 0.0547 | 0.0575  | 0.0197    | 0.0497     | 0.0811    | 0.0               | 0.0                   | 0.0231                       | 0.1979                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0749    | 0.5796        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0573    | 0.6902        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1711   | 0.4896       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0502     | 0.4463         | 0.0001     | 0.0307         | 0.026        | 0.2118           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 3.7264        | 0.5260 | 6000  | 2.4801          | 0.0088 | 0.0182 | 0.0074 | 0.0046    | 0.013      | 0.0077    | 0.0271 | 0.0559 | 0.0587  | 0.0199    | 0.0517     | 0.0756    | 0.0               | 0.0                   | 0.0226                       | 0.256                            | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0777    | 0.5854        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.066     | 0.6799        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1535   | 0.459        | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0612     | 0.4444         | 0.0001     | 0.0318         | 0.0248       | 0.2458           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 3.2463        | 0.5699 | 6500  | 2.4314          | 0.0102 | 0.0202 | 0.0093 | 0.0053    | 0.014      | 0.0087    | 0.0301 | 0.0584 | 0.061   | 0.02      | 0.0575     | 0.0802    | 0.0               | 0.0                   | 0.0268                       | 0.2933                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0838    | 0.6035        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0839    | 0.7102        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1921   | 0.476        | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0588     | 0.4496         | 0.0001     | 0.0387         | 0.0258       | 0.2329           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 2.9215        | 0.6137 | 7000  | 2.4212          | 0.0103 | 0.0201 | 0.0094 | 0.0054    | 0.0144     | 0.0088    | 0.03   | 0.0598 | 0.0624  | 0.0211    | 0.058      | 0.0812    | 0.0               | 0.0                   | 0.024                        | 0.2928                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0984    | 0.6293        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0724    | 0.7242        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1887   | 0.4963       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.063      | 0.4455         | 0.0001     | 0.0428         | 0.0268       | 0.2391           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 2.9853        | 0.6575 | 7500  | 2.4040          | 0.0109 | 0.0209 | 0.01   | 0.0056    | 0.0152     | 0.0091    | 0.03   | 0.0601 | 0.0629  | 0.0216    | 0.0599     | 0.0792    | 0.0               | 0.0                   | 0.0232                       | 0.3118                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.1049    | 0.6156        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0731    | 0.7404        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.2057   | 0.4923       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0663     | 0.4531         | 0.0001     | 0.0368         | 0.0264       | 0.2431           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 2.7586        | 0.7014 | 8000  | 2.4094          | 0.0106 | 0.0212 | 0.0097 | 0.0054    | 0.0157     | 0.0089    | 0.0304 | 0.0591 | 0.0619  | 0.0216    | 0.0588     | 0.0788    | 0.0               | 0.0                   | 0.024                        | 0.3101                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.1042    | 0.6143        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0751    | 0.7167        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1962   | 0.4804       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0651     | 0.4502         | 0.0001     | 0.0385         | 0.024        | 0.2379           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 2.5399        | 0.7452 | 8500  | 2.3802          | 0.0106 | 0.0207 | 0.0097 | 0.0055    | 0.0153     | 0.0089    | 0.0311 | 0.061  | 0.0633  | 0.0212    | 0.0594     | 0.0808    | 0.0               | 0.0                   | 0.0236                       | 0.344                            | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.0952    | 0.6468        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0779    | 0.7134        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.1989   | 0.4838       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.066      | 0.4451         | 0.0001     | 0.0422         | 0.0272       | 0.2379           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 3.2245        | 0.7891 | 9000  | 2.3654          | 0.0112 | 0.0216 | 0.0102 | 0.0056    | 0.0155     | 0.0095    | 0.0318 | 0.0613 | 0.064   | 0.0217    | 0.0611     | 0.0808    | 0.0               | 0.0                   | 0.0241                       | 0.3248                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.1051    | 0.6465        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0847    | 0.7272        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0      | 0.0          | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.201    | 0.4872       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.071      | 0.458          | 0.0001     | 0.0433         | 0.029        | 0.2575           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 2.3969        | 0.8329 | 9500  | 2.3674          | 0.0114 | 0.0221 | 0.0104 | 0.0057    | 0.0163     | 0.0095    | 0.0316 | 0.0615 | 0.0641  | 0.0212    | 0.0604     | 0.0804    | 0.0               | 0.0                   | 0.0236                       | 0.3309                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.1071    | 0.6446        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0835    | 0.7287        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0069   | 0.0043       | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.2008   | 0.4869       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0716     | 0.4598         | 0.0001     | 0.0418         | 0.0295       | 0.2494           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |
| 2.8285        | 0.8767 | 10000 | 2.3614          | 0.0116 | 0.0224 | 0.0105 | 0.0058    | 0.0165     | 0.0098    | 0.0323 | 0.0618 | 0.0643  | 0.0215    | 0.0607     | 0.0811    | 0.0               | 0.0                   | 0.0234                       | 0.3322                           | 0.0         | 0.0             | 0.0          | 0.0              | 0.0        | 0.0            | 0.0      | 0.0          | 0.1092    | 0.6471        | 0.0        | 0.0            | 0.0       | 0.0           | 0.0      | 0.0          | 0.0869    | 0.7291        | 0.0          | 0.0              | 0.0      | 0.0          | 0.0         | 0.0             | 0.0     | 0.0         | 0.0                                         | 0.0                                             | 0.0     | 0.0         | 0.0       | 0.0           | 0.0       | 0.0           | 0.0069   | 0.0043       | 0.0            | 0.0                | 0.0                   | 0.0                       | 0.0      | 0.0          | 0.2046   | 0.4928       | 0.0             | 0.0                 | 0.0       | 0.0           | 0.0          | 0.0              | 0.0      | 0.0          | 0.0        | 0.0            | 0.0       | 0.0           | 0.0           | 0.0               | 0.0724     | 0.4613         | 0.0001     | 0.042          | 0.0292       | 0.2495           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0          | 0.0              | 0.0      | 0.0          | 0.0     | 0.0         | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            | 0.0       | 0.0           | 0.0        | 0.0            | 0.0        | 0.0            | 0.0        | 0.0            |


### Framework versions

- Transformers 4.51.3
- Pytorch 2.6.0+cu124
- Datasets 3.5.0
- Tokenizers 0.21.1