userReviewed-20250321115933

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.7000
Overall Strict Precision: 0.4317
Overall Strict Recall: 0.4595
Overall Strict F1: 0.4452
Overall Ent Type Precision: 0.5205
Overall Ent Type Recall: 0.5540
Overall Ent Type F1: 0.5367
Overall Partial Precision: 0.4910
Overall Partial Recall: 0.5227
Overall Partial F1: 0.5064
Overall Exact Precision: 0.4430
Overall Exact Recall: 0.4715
Overall Exact F1: 0.4568
Bookingnumber Strict Precision: 0.0155
Bookingnumber Strict Recall: 0.4839
Bookingnumber Strict F1: 0.0301
Bookingnumber Ent Type Precision: 0.0174
Bookingnumber Ent Type Recall: 0.5414
Bookingnumber Ent Type F1: 0.0336
Bookingnumber Partial Precision: 0.0204
Bookingnumber Partial Recall: 0.6376
Bookingnumber Partial F1: 0.0396
Bookingnumber Exact Precision: 0.0191
Bookingnumber Exact Recall: 0.5962
Bookingnumber Exact F1: 0.0370
Checkin Strict Precision: 0.0
Checkin Strict Recall: 0
Checkin Strict F1: 0
Checkin Ent Type Precision: 0.0
Checkin Ent Type Recall: 0
Checkin Ent Type F1: 0
Checkin Partial Precision: 0.0
Checkin Partial Recall: 0
Checkin Partial F1: 0
Checkin Exact Precision: 0.0
Checkin Exact Recall: 0
Checkin Exact F1: 0
Grossamount Strict Precision: 0.0164
Grossamount Strict Recall: 0.1855
Grossamount Strict F1: 0.0301
Grossamount Ent Type Precision: 0.0174
Grossamount Ent Type Recall: 0.1965
Grossamount Ent Type F1: 0.0319
Grossamount Partial Precision: 0.0173
Grossamount Partial Recall: 0.1961
Grossamount Partial F1: 0.0319
Grossamount Exact Precision: 0.0168
Grossamount Exact Recall: 0.1895
Grossamount Exact F1: 0.0308
Roomno Strict Precision: 0.0896
Roomno Strict Recall: 0.6931
Roomno Strict F1: 0.1587
Roomno Ent Type Precision: 0.0904
Roomno Ent Type Recall: 0.6989
Roomno Ent Type F1: 0.1600
Roomno Partial Precision: 0.0913
Roomno Partial Recall: 0.7065
Roomno Partial F1: 0.1618
Roomno Exact Precision: 0.0907
Roomno Exact Recall: 0.7016
Roomno Exact F1: 0.1606
Companyaddress Strict Precision: 0.0607
Companyaddress Strict Recall: 0.6700
Companyaddress Strict F1: 0.1113
Companyaddress Ent Type Precision: 0.0804
Companyaddress Ent Type Recall: 0.8867
Companyaddress Ent Type F1: 0.1473
Companyaddress Partial Precision: 0.0710
Companyaddress Partial Recall: 0.7841
Companyaddress Partial F1: 0.1303
Companyaddress Exact Precision: 0.0610
Companyaddress Exact Recall: 0.6736
Companyaddress Exact F1: 0.1119
Hotelvatnumber Strict Precision: 0.0250
Hotelvatnumber Strict Recall: 0.6727
Hotelvatnumber Strict F1: 0.0481
Hotelvatnumber Ent Type Precision: 0.0267
Hotelvatnumber Ent Type Recall: 0.7184
Hotelvatnumber Ent Type F1: 0.0514
Hotelvatnumber Partial Precision: 0.0273
Hotelvatnumber Partial Recall: 0.7348
Hotelvatnumber Partial F1: 0.0526
Hotelvatnumber Exact Precision: 0.0262
Hotelvatnumber Exact Recall: 0.7069
Hotelvatnumber Exact F1: 0.0506
Hoteltaxcode Strict Precision: 0.0044
Hoteltaxcode Strict Recall: 0.3000
Hoteltaxcode Strict F1: 0.0086
Hoteltaxcode Ent Type Precision: 0.0054
Hoteltaxcode Ent Type Recall: 0.3737
Hoteltaxcode Ent Type F1: 0.0107
Hoteltaxcode Partial Precision: 0.0049
Hoteltaxcode Partial Recall: 0.3392
Hoteltaxcode Partial F1: 0.0097
Hoteltaxcode Exact Precision: 0.0044
Hoteltaxcode Exact Recall: 0.3009
Hoteltaxcode Exact F1: 0.0086
Cardtype Strict Precision: 0.0
Cardtype Strict Recall: 0
Cardtype Strict F1: 0
Cardtype Ent Type Precision: 0.0
Cardtype Ent Type Recall: 0
Cardtype Ent Type F1: 0
Cardtype Partial Precision: 0.0
Cardtype Partial Recall: 0
Cardtype Partial F1: 0
Cardtype Exact Precision: 0.0
Cardtype Exact Recall: 0
Cardtype Exact F1: 0
Currencycode Strict Precision: 0.0127
Currencycode Strict Recall: 0.1243
Currencycode Strict F1: 0.0230
Currencycode Ent Type Precision: 0.0128
Currencycode Ent Type Recall: 0.1254
Currencycode Ent Type F1: 0.0232
Currencycode Partial Precision: 0.0128
Currencycode Partial Recall: 0.1254
Currencycode Partial F1: 0.0232
Currencycode Exact Precision: 0.0127
Currencycode Exact Recall: 0.1244
Currencycode Exact F1: 0.0230
Hotelname Strict Precision: 0.0357
Hotelname Strict Recall: 0.2230
Hotelname Strict F1: 0.0616
Hotelname Ent Type Precision: 0.0623
Hotelname Ent Type Recall: 0.3888
Hotelname Ent Type F1: 0.1074
Hotelname Partial Precision: 0.0498
Hotelname Partial Recall: 0.3107
Hotelname Partial F1: 0.0858
Hotelname Exact Precision: 0.0358
Hotelname Exact Recall: 0.2235
Hotelname Exact F1: 0.0617
Externalreservationnumber Strict Precision: 0.0015
Externalreservationnumber Strict Recall: 0.3925
Externalreservationnumber Strict F1: 0.0030
Externalreservationnumber Ent Type Precision: 0.0018
Externalreservationnumber Ent Type Recall: 0.4741
Externalreservationnumber Ent Type F1: 0.0037
Externalreservationnumber Partial Precision: 0.0024
Externalreservationnumber Partial Recall: 0.6248
Externalreservationnumber Partial F1: 0.0048
Externalreservationnumber Exact Precision: 0.0022
Externalreservationnumber Exact Recall: 0.5683
Externalreservationnumber Exact F1: 0.0044
Invoicedate Strict Precision: 0.0
Invoicedate Strict Recall: 0
Invoicedate Strict F1: 0
Invoicedate Ent Type Precision: 0.0
Invoicedate Ent Type Recall: 0
Invoicedate Ent Type F1: 0
Invoicedate Partial Precision: 0.0
Invoicedate Partial Recall: 0
Invoicedate Partial F1: 0
Invoicedate Exact Precision: 0.0
Invoicedate Exact Recall: 0
Invoicedate Exact F1: 0
Hotelcity Strict Precision: 0.0567
Hotelcity Strict Recall: 0.4393
Hotelcity Strict F1: 0.1004
Hotelcity Ent Type Precision: 0.0625
Hotelcity Ent Type Recall: 0.4848
Hotelcity Ent Type F1: 0.1108
Hotelcity Partial Precision: 0.0611
Hotelcity Partial Recall: 0.4734
Hotelcity Partial F1: 0.1082
Hotelcity Exact Precision: 0.0578
Hotelcity Exact Recall: 0.4485
Hotelcity Exact F1: 0.1025
Companyname Strict Precision: 0.0590
Companyname Strict Recall: 0.5838
Companyname Strict F1: 0.1072
Companyname Ent Type Precision: 0.0783
Companyname Ent Type Recall: 0.7747
Companyname Ent Type F1: 0.1422
Companyname Partial Precision: 0.0696
Companyname Partial Recall: 0.6887
Companyname Partial F1: 0.1264
Companyname Exact Precision: 0.0594
Companyname Exact Recall: 0.5877
Companyname Exact F1: 0.1079
Reservationnumber Strict Precision: 0.0086
Reservationnumber Strict Recall: 0.6326
Reservationnumber Strict F1: 0.0170
Reservationnumber Ent Type Precision: 0.0089
Reservationnumber Ent Type Recall: 0.6534
Reservationnumber Ent Type F1: 0.0176
Reservationnumber Partial Precision: 0.0099
Reservationnumber Partial Recall: 0.7240
Reservationnumber Partial F1: 0.0195
Reservationnumber Exact Precision: 0.0097
Reservationnumber Exact Recall: 0.7083
Reservationnumber Exact F1: 0.0191
Taxamount Strict Precision: 0.0066
Taxamount Strict Recall: 0.5234
Taxamount Strict F1: 0.0130
Taxamount Ent Type Precision: 0.0074
Taxamount Ent Type Recall: 0.5867
Taxamount Ent Type F1: 0.0145
Taxamount Partial Precision: 0.0070
Taxamount Partial Recall: 0.5611
Taxamount Partial F1: 0.0139
Taxamount Exact Precision: 0.0066
Taxamount Exact Recall: 0.5282
Taxamount Exact F1: 0.0131
Pagenumber Strict Precision: 0.0293
Pagenumber Strict Recall: 0.1180
Pagenumber Strict F1: 0.0469
Pagenumber Ent Type Precision: 0.0310
Pagenumber Ent Type Recall: 0.1250
Pagenumber Ent Type F1: 0.0497
Pagenumber Partial Precision: 0.0413
Pagenumber Partial Recall: 0.1665
Pagenumber Partial F1: 0.0662
Pagenumber Exact Precision: 0.0374
Pagenumber Exact Recall: 0.1506
Pagenumber Exact F1: 0.0599
Companyzipcode Strict Precision: 0.0
Companyzipcode Strict Recall: 0
Companyzipcode Strict F1: 0
Companyzipcode Ent Type Precision: 0.0
Companyzipcode Ent Type Recall: 0
Companyzipcode Ent Type F1: 0
Companyzipcode Partial Precision: 0.0
Companyzipcode Partial Recall: 0
Companyzipcode Partial F1: 0
Companyzipcode Exact Precision: 0.0
Companyzipcode Exact Recall: 0
Companyzipcode Exact F1: 0
Hotelemail Strict Precision: 0.0567
Hotelemail Strict Recall: 0.8068
Hotelemail Strict F1: 0.1059
Hotelemail Ent Type Precision: 0.0606
Hotelemail Ent Type Recall: 0.8625
Hotelemail Ent Type F1: 0.1132
Hotelemail Partial Precision: 0.0586
Hotelemail Partial Recall: 0.8350
Hotelemail Partial F1: 0.1096
Hotelemail Exact Precision: 0.0567
Hotelemail Exact Recall: 0.8070
Hotelemail Exact F1: 0.1059
Hotelzipcode Strict Precision: 0.0574
Hotelzipcode Strict Recall: 0.5397
Hotelzipcode Strict F1: 0.1038
Hotelzipcode Ent Type Precision: 0.0634
Hotelzipcode Ent Type Recall: 0.5963
Hotelzipcode Ent Type F1: 0.1147
Hotelzipcode Partial Precision: 0.0608
Hotelzipcode Partial Recall: 0.5719
Hotelzipcode Partial F1: 0.1100
Hotelzipcode Exact Precision: 0.0577
Hotelzipcode Exact Recall: 0.5424
Hotelzipcode Exact F1: 0.1043
Cardnumber Strict Precision: 0.0
Cardnumber Strict Recall: 0
Cardnumber Strict F1: 0
Cardnumber Ent Type Precision: 0.0
Cardnumber Ent Type Recall: 0
Cardnumber Ent Type F1: 0
Cardnumber Partial Precision: 0.0
Cardnumber Partial Recall: 0
Cardnumber Partial F1: 0
Cardnumber Exact Precision: 0.0
Cardnumber Exact Recall: 0
Cardnumber Exact F1: 0
Travellername Strict Precision: 0.0559
Travellername Strict Recall: 0.4427
Travellername Strict F1: 0.0993
Travellername Ent Type Precision: 0.0820
Travellername Ent Type Recall: 0.6490
Travellername Ent Type F1: 0.1456
Travellername Partial Precision: 0.0702
Travellername Partial Recall: 0.5557
Travellername Partial F1: 0.1246
Travellername Exact Precision: 0.0566
Travellername Exact Recall: 0.4484
Travellername Exact F1: 0.1006
Checkout Strict Precision: 0.0
Checkout Strict Recall: 0
Checkout Strict F1: 0
Checkout Ent Type Precision: 0.0
Checkout Ent Type Recall: 0
Checkout Ent Type F1: 0
Checkout Partial Precision: 0.0
Checkout Partial Recall: 0
Checkout Partial F1: 0
Checkout Exact Precision: 0.0
Checkout Exact Recall: 0
Checkout Exact F1: 0
Hotelcountry Strict Precision: 0.0136
Hotelcountry Strict Recall: 0.6737
Hotelcountry Strict F1: 0.0267
Hotelcountry Ent Type Precision: 0.0139
Hotelcountry Ent Type Recall: 0.6874
Hotelcountry Ent Type F1: 0.0273
Hotelcountry Partial Precision: 0.0146
Hotelcountry Partial Recall: 0.7199
Hotelcountry Partial F1: 0.0285
Hotelcountry Exact Precision: 0.0144
Hotelcountry Exact Recall: 0.7114
Hotelcountry Exact F1: 0.0282
Hotelfaxnumber Strict Precision: 0.0183
Hotelfaxnumber Strict Recall: 0.4603
Hotelfaxnumber Strict F1: 0.0352
Hotelfaxnumber Ent Type Precision: 0.0296
Hotelfaxnumber Ent Type Recall: 0.7454
Hotelfaxnumber Ent Type F1: 0.0570
Hotelfaxnumber Partial Precision: 0.0240
Hotelfaxnumber Partial Recall: 0.6037
Hotelfaxnumber Partial F1: 0.0462
Hotelfaxnumber Exact Precision: 0.0183
Hotelfaxnumber Exact Recall: 0.4603
Hotelfaxnumber Exact F1: 0.0352
Companycity Strict Precision: 0.0743
Companycity Strict Recall: 0.8373
Companycity Strict F1: 0.1364
Companycity Ent Type Precision: 0.0789
Companycity Ent Type Recall: 0.8896
Companycity Ent Type F1: 0.1449
Companycity Partial Precision: 0.0782
Companycity Partial Recall: 0.8819
Companycity Partial F1: 0.1437
Companycity Exact Precision: 0.0755
Companycity Exact Recall: 0.8519
Companycity Exact F1: 0.1388
Hotelbankaccount Strict Precision: 0.0
Hotelbankaccount Strict Recall: 0
Hotelbankaccount Strict F1: 0
Hotelbankaccount Ent Type Precision: 0.0
Hotelbankaccount Ent Type Recall: 0
Hotelbankaccount Ent Type F1: 0
Hotelbankaccount Partial Precision: 0.0
Hotelbankaccount Partial Recall: 0
Hotelbankaccount Partial F1: 0
Hotelbankaccount Exact Precision: 0.0
Hotelbankaccount Exact Recall: 0
Hotelbankaccount Exact F1: 0
Hoteladdress Strict Precision: 0.0178
Hoteladdress Strict Recall: 0.2384
Hoteladdress Strict F1: 0.0331
Hoteladdress Ent Type Precision: 0.0375
Hoteladdress Ent Type Recall: 0.5033
Hoteladdress Ent Type F1: 0.0699
Hoteladdress Partial Precision: 0.0278
Hoteladdress Partial Recall: 0.3729
Hoteladdress Partial F1: 0.0518
Hoteladdress Exact Precision: 0.0178
Hoteladdress Exact Recall: 0.2386
Hoteladdress Exact F1: 0.0331
Companycountry Strict Precision: 0.0479
Companycountry Strict Recall: 0.8316
Companycountry Strict F1: 0.0905
Companycountry Ent Type Precision: 0.0485
Companycountry Ent Type Recall: 0.8429
Companycountry Ent Type F1: 0.0918
Companycountry Partial Precision: 0.0496
Companycountry Partial Recall: 0.8620
Companycountry Partial F1: 0.0939
Companycountry Exact Precision: 0.0492
Companycountry Exact Recall: 0.8548
Companycountry Exact F1: 0.0931
Hotelphonenumber Strict Precision: 0.0251
Hotelphonenumber Strict Recall: 0.4248
Hotelphonenumber Strict F1: 0.0474
Hotelphonenumber Ent Type Precision: 0.0432
Hotelphonenumber Ent Type Recall: 0.7318
Hotelphonenumber Ent Type F1: 0.0817
Hotelphonenumber Partial Precision: 0.0342
Hotelphonenumber Partial Recall: 0.5790
Hotelphonenumber Partial F1: 0.0646
Hotelphonenumber Exact Precision: 0.0251
Hotelphonenumber Exact Recall: 0.4253
Hotelphonenumber Exact F1: 0.0475
Netamount Strict Precision: 0.0080
Netamount Strict Recall: 0.6143
Netamount Strict F1: 0.0159
Netamount Ent Type Precision: 0.0093
Netamount Ent Type Recall: 0.7076
Netamount Ent Type F1: 0.0183
Netamount Partial Precision: 0.0088
Netamount Partial Recall: 0.6702
Netamount Partial F1: 0.0173
Netamount Exact Precision: 0.0081
Netamount Exact Recall: 0.6203
Netamount Exact F1: 0.0160
Invoicenumber Strict Precision: 0.0769
Invoicenumber Strict Recall: 0.8229
Invoicenumber Strict F1: 0.1406
Invoicenumber Ent Type Precision: 0.0822
Invoicenumber Ent Type Recall: 0.8804
Invoicenumber Ent Type F1: 0.1504
Invoicenumber Partial Precision: 0.0802
Invoicenumber Partial Recall: 0.8588
Invoicenumber Partial F1: 0.1467
Invoicenumber Exact Precision: 0.0775
Invoicenumber Exact Recall: 0.8292
Invoicenumber Exact F1: 0.1417
Companyvatnumber Strict Precision: 0.0028
Companyvatnumber Strict Recall: 0.2710
Companyvatnumber Strict F1: 0.0056
Companyvatnumber Ent Type Precision: 0.0054
Companyvatnumber Ent Type Recall: 0.5144
Companyvatnumber Ent Type F1: 0.0107
Companyvatnumber Partial Precision: 0.0043
Companyvatnumber Partial Recall: 0.4123
Companyvatnumber Partial F1: 0.0086
Companyvatnumber Exact Precision: 0.0030
Companyvatnumber Exact Recall: 0.2832
Companyvatnumber Exact F1: 0.0059
Documenttype Strict Precision: 0.0
Documenttype Strict Recall: 0
Documenttype Strict F1: 0
Documenttype Ent Type Precision: 0.0
Documenttype Ent Type Recall: 0
Documenttype Ent Type F1: 0
Documenttype Partial Precision: 0.0
Documenttype Partial Recall: 0
Documenttype Partial F1: 0
Documenttype Exact Precision: 0.0
Documenttype Exact Recall: 0
Documenttype Exact F1: 0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 1e-06
train_batch_size: 8
eval_batch_size: 8
seed: 42
gradient_accumulation_steps: 16
total_train_batch_size: 128
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
lr_scheduler_warmup_ratio: 0.5
num_epochs: 8

Training results

Training Loss	Epoch	Step	Validation Loss	Overall Strict Precision	Overall Strict Recall	Overall Strict F1	Overall Ent Type Precision	Overall Ent Type Recall	Overall Ent Type F1	Overall Partial Precision	Overall Partial Recall	Overall Partial F1	Overall Exact Precision	Overall Exact Recall	Overall Exact F1	Bookingnumber Strict Precision	Bookingnumber Strict Recall	Bookingnumber Strict F1	Bookingnumber Ent Type Precision	Bookingnumber Ent Type Recall	Bookingnumber Ent Type F1	Bookingnumber Partial Precision	Bookingnumber Partial Recall	Bookingnumber Partial F1	Bookingnumber Exact Precision	Bookingnumber Exact Recall	Bookingnumber Exact F1	Checkin Strict Precision	Checkin Strict Recall	Checkin Strict F1	Checkin Ent Type Precision	Checkin Ent Type Recall	Checkin Ent Type F1	Checkin Partial Precision	Checkin Partial Recall	Checkin Partial F1	Checkin Exact Precision	Checkin Exact Recall	Checkin Exact F1	Grossamount Strict Precision	Grossamount Strict Recall	Grossamount Strict F1	Grossamount Ent Type Precision	Grossamount Ent Type Recall	Grossamount Ent Type F1	Grossamount Partial Precision	Grossamount Partial Recall	Grossamount Partial F1	Grossamount Exact Precision	Grossamount Exact Recall	Grossamount Exact F1	Roomno Strict Precision	Roomno Strict Recall	Roomno Strict F1	Roomno Ent Type Precision	Roomno Ent Type Recall	Roomno Ent Type F1	Roomno Partial Precision	Roomno Partial Recall	Roomno Partial F1	Roomno Exact Precision	Roomno Exact Recall	Roomno Exact F1	Companyaddress Strict Precision	Companyaddress Strict Recall	Companyaddress Strict F1	Companyaddress Ent Type Precision	Companyaddress Ent Type Recall	Companyaddress Ent Type F1	Companyaddress Partial Precision	Companyaddress Partial Recall	Companyaddress Partial F1	Companyaddress Exact Precision	Companyaddress Exact Recall	Companyaddress Exact F1	Hotelvatnumber Strict Precision	Hotelvatnumber Strict Recall	Hotelvatnumber Strict F1	Hotelvatnumber Ent Type Precision	Hotelvatnumber Ent Type Recall	Hotelvatnumber Ent Type F1	Hotelvatnumber Partial Precision	Hotelvatnumber Partial Recall	Hotelvatnumber Partial F1	Hotelvatnumber Exact Precision	Hotelvatnumber Exact Recall	Hotelvatnumber Exact F1	Hoteltaxcode Strict Precision	Hoteltaxcode Strict Recall	Hoteltaxcode Strict F1	Hoteltaxcode Ent Type Precision	Hoteltaxcode Ent Type Recall	Hoteltaxcode Ent Type F1	Hoteltaxcode Partial Precision	Hoteltaxcode Partial Recall	Hoteltaxcode Partial F1	Hoteltaxcode Exact Precision	Hoteltaxcode Exact Recall	Hoteltaxcode Exact F1	Cardtype Strict Precision	Cardtype Strict Recall	Cardtype Strict F1	Cardtype Ent Type Precision	Cardtype Ent Type Recall	Cardtype Ent Type F1	Cardtype Partial Precision	Cardtype Partial Recall	Cardtype Partial F1	Cardtype Exact Precision	Cardtype Exact Recall	Cardtype Exact F1	Currencycode Strict Precision	Currencycode Strict Recall	Currencycode Strict F1	Currencycode Ent Type Precision	Currencycode Ent Type Recall	Currencycode Ent Type F1	Currencycode Partial Precision	Currencycode Partial Recall	Currencycode Partial F1	Currencycode Exact Precision	Currencycode Exact Recall	Currencycode Exact F1	Hotelname Strict Precision	Hotelname Strict Recall	Hotelname Strict F1	Hotelname Ent Type Precision	Hotelname Ent Type Recall	Hotelname Ent Type F1	Hotelname Partial Precision	Hotelname Partial Recall	Hotelname Partial F1	Hotelname Exact Precision	Hotelname Exact Recall	Hotelname Exact F1	Externalreservationnumber Strict Precision	Externalreservationnumber Strict Recall	Externalreservationnumber Strict F1	Externalreservationnumber Ent Type Precision	Externalreservationnumber Ent Type Recall	Externalreservationnumber Ent Type F1	Externalreservationnumber Partial Precision	Externalreservationnumber Partial Recall	Externalreservationnumber Partial F1	Externalreservationnumber Exact Precision	Externalreservationnumber Exact Recall	Externalreservationnumber Exact F1	Invoicedate Strict Precision	Invoicedate Strict Recall	Invoicedate Strict F1	Invoicedate Ent Type Precision	Invoicedate Ent Type Recall	Invoicedate Ent Type F1	Invoicedate Partial Precision	Invoicedate Partial Recall	Invoicedate Partial F1	Invoicedate Exact Precision	Invoicedate Exact Recall	Invoicedate Exact F1	Hotelcity Strict Precision	Hotelcity Strict Recall	Hotelcity Strict F1	Hotelcity Ent Type Precision	Hotelcity Ent Type Recall	Hotelcity Ent Type F1	Hotelcity Partial Precision	Hotelcity Partial Recall	Hotelcity Partial F1	Hotelcity Exact Precision	Hotelcity Exact Recall	Hotelcity Exact F1	Companyname Strict Precision	Companyname Strict Recall	Companyname Strict F1	Companyname Ent Type Precision	Companyname Ent Type Recall	Companyname Ent Type F1	Companyname Partial Precision	Companyname Partial Recall	Companyname Partial F1	Companyname Exact Precision	Companyname Exact Recall	Companyname Exact F1	Taxamount Strict Precision	Taxamount Strict Recall	Taxamount Strict F1	Taxamount Ent Type Precision	Taxamount Ent Type Recall	Taxamount Ent Type F1	Taxamount Partial Precision	Taxamount Partial Recall	Taxamount Partial F1	Taxamount Exact Precision	Taxamount Exact Recall	Taxamount Exact F1	Reservationnumber Strict Precision	Reservationnumber Strict Recall	Reservationnumber Strict F1	Reservationnumber Ent Type Precision	Reservationnumber Ent Type Recall	Reservationnumber Ent Type F1	Reservationnumber Partial Precision	Reservationnumber Partial Recall	Reservationnumber Partial F1	Reservationnumber Exact Precision	Reservationnumber Exact Recall	Reservationnumber Exact F1	Companyzipcode Strict Precision	Companyzipcode Strict Recall	Companyzipcode Strict F1	Companyzipcode Ent Type Precision	Companyzipcode Ent Type Recall	Companyzipcode Ent Type F1	Companyzipcode Partial Precision	Companyzipcode Partial Recall	Companyzipcode Partial F1	Companyzipcode Exact Precision	Companyzipcode Exact Recall	Companyzipcode Exact F1	Pagenumber Strict Precision	Pagenumber Strict Recall	Pagenumber Strict F1	Pagenumber Ent Type Precision	Pagenumber Ent Type Recall	Pagenumber Ent Type F1	Pagenumber Partial Precision	Pagenumber Partial Recall	Pagenumber Partial F1	Pagenumber Exact Precision	Pagenumber Exact Recall	Pagenumber Exact F1	Hotelemail Strict Precision	Hotelemail Strict Recall	Hotelemail Strict F1	Hotelemail Ent Type Precision	Hotelemail Ent Type Recall	Hotelemail Ent Type F1	Hotelemail Partial Precision	Hotelemail Partial Recall	Hotelemail Partial F1	Hotelemail Exact Precision	Hotelemail Exact Recall	Hotelemail Exact F1	Hotelzipcode Strict Precision	Hotelzipcode Strict Recall	Hotelzipcode Strict F1	Hotelzipcode Ent Type Precision	Hotelzipcode Ent Type Recall	Hotelzipcode Ent Type F1	Hotelzipcode Partial Precision	Hotelzipcode Partial Recall	Hotelzipcode Partial F1	Hotelzipcode Exact Precision	Hotelzipcode Exact Recall	Hotelzipcode Exact F1	Cardnumber Strict Precision	Cardnumber Strict Recall	Cardnumber Strict F1	Cardnumber Ent Type Precision	Cardnumber Ent Type Recall	Cardnumber Ent Type F1	Cardnumber Partial Precision	Cardnumber Partial Recall	Cardnumber Partial F1	Cardnumber Exact Precision	Cardnumber Exact Recall	Cardnumber Exact F1	Travellername Strict Precision	Travellername Strict Recall	Travellername Strict F1	Travellername Ent Type Precision	Travellername Ent Type Recall	Travellername Ent Type F1	Travellername Partial Precision	Travellername Partial Recall	Travellername Partial F1	Travellername Exact Precision	Travellername Exact Recall	Travellername Exact F1	Checkout Strict Precision	Checkout Strict Recall	Checkout Strict F1	Checkout Ent Type Precision	Checkout Ent Type Recall	Checkout Ent Type F1	Checkout Partial Precision	Checkout Partial Recall	Checkout Partial F1	Checkout Exact Precision	Checkout Exact Recall	Checkout Exact F1	Hotelcountry Strict Precision	Hotelcountry Strict Recall	Hotelcountry Strict F1	Hotelcountry Ent Type Precision	Hotelcountry Ent Type Recall	Hotelcountry Ent Type F1	Hotelcountry Partial Precision	Hotelcountry Partial Recall	Hotelcountry Partial F1	Hotelcountry Exact Precision	Hotelcountry Exact Recall	Hotelcountry Exact F1	Hotelfaxnumber Strict Precision	Hotelfaxnumber Strict Recall	Hotelfaxnumber Strict F1	Hotelfaxnumber Ent Type Precision	Hotelfaxnumber Ent Type Recall	Hotelfaxnumber Ent Type F1	Hotelfaxnumber Partial Precision	Hotelfaxnumber Partial Recall	Hotelfaxnumber Partial F1	Hotelfaxnumber Exact Precision	Hotelfaxnumber Exact Recall	Hotelfaxnumber Exact F1	Companycity Strict Precision	Companycity Strict Recall	Companycity Strict F1	Companycity Ent Type Precision	Companycity Ent Type Recall	Companycity Ent Type F1	Companycity Partial Precision	Companycity Partial Recall	Companycity Partial F1	Companycity Exact Precision	Companycity Exact Recall	Companycity Exact F1	Hotelbankaccount Strict Recall	Hotelbankaccount Ent Type Recall	Hotelbankaccount Partial Recall	Hotelbankaccount Exact Recall	Hoteladdress Strict Precision	Hoteladdress Strict Recall	Hoteladdress Strict F1	Hoteladdress Ent Type Precision	Hoteladdress Ent Type Recall	Hoteladdress Ent Type F1	Hoteladdress Partial Precision	Hoteladdress Partial Recall	Hoteladdress Partial F1	Hoteladdress Exact Precision	Hoteladdress Exact Recall	Hoteladdress Exact F1	Companycountry Strict Precision	Companycountry Strict Recall	Companycountry Strict F1	Companycountry Ent Type Precision	Companycountry Ent Type Recall	Companycountry Ent Type F1	Companycountry Partial Precision	Companycountry Partial Recall	Companycountry Partial F1	Companycountry Exact Precision	Companycountry Exact Recall	Companycountry Exact F1	Hotelphonenumber Strict Precision	Hotelphonenumber Strict Recall	Hotelphonenumber Strict F1	Hotelphonenumber Ent Type Precision	Hotelphonenumber Ent Type Recall	Hotelphonenumber Ent Type F1	Hotelphonenumber Partial Precision	Hotelphonenumber Partial Recall	Hotelphonenumber Partial F1	Hotelphonenumber Exact Precision	Hotelphonenumber Exact Recall	Hotelphonenumber Exact F1	Netamount Strict Precision	Netamount Strict Recall	Netamount Strict F1	Netamount Ent Type Precision	Netamount Ent Type Recall	Netamount Ent Type F1	Netamount Partial Precision	Netamount Partial Recall	Netamount Partial F1	Netamount Exact Precision	Netamount Exact Recall	Netamount Exact F1	Invoicenumber Strict Precision	Invoicenumber Strict Recall	Invoicenumber Strict F1	Invoicenumber Ent Type Precision	Invoicenumber Ent Type Recall	Invoicenumber Ent Type F1	Invoicenumber Partial Precision	Invoicenumber Partial Recall	Invoicenumber Partial F1	Invoicenumber Exact Precision	Invoicenumber Exact Recall	Invoicenumber Exact F1	Companyvatnumber Strict Precision	Companyvatnumber Strict Recall	Companyvatnumber Strict F1	Companyvatnumber Ent Type Precision	Companyvatnumber Ent Type Recall	Companyvatnumber Ent Type F1	Companyvatnumber Partial Precision	Companyvatnumber Partial Recall	Companyvatnumber Partial F1	Companyvatnumber Exact Precision	Companyvatnumber Exact Recall	Companyvatnumber Exact F1	Documenttype Strict Precision	Documenttype Strict Recall	Documenttype Strict F1	Documenttype Ent Type Precision	Documenttype Ent Type Recall	Documenttype Ent Type F1	Documenttype Partial Precision	Documenttype Partial Recall	Documenttype Partial F1	Documenttype Exact Precision	Documenttype Exact Recall	Documenttype Exact F1
0.7639	0.9994	1067	0.3964	0.5310	0.5307	0.5309	0.6386	0.6382	0.6384	0.5951	0.5948	0.5950	0.5387	0.5384	0.5386	0.0145	0.4083	0.0281	0.0194	0.5437	0.0374	0.0215	0.6048	0.0416	0.0181	0.5084	0.0350	0.0036	0.3233	0.0072	0.0045	0.4057	0.0090	0.0041	0.3652	0.0081	0.0036	0.3240	0.0072	0.0675	0.5250	0.1195	0.0769	0.5987	0.1363	0.0732	0.5700	0.1298	0.0683	0.5318	0.1211	0.1161	0.7760	0.2021	0.1178	0.7869	0.2049	0.1191	0.7956	0.2072	0.1181	0.7890	0.2054	0.0772	0.6525	0.1381	0.1047	0.8845	0.1872	0.0916	0.7742	0.1639	0.0776	0.6558	0.1388	0.0387	0.6238	0.0729	0.0459	0.7394	0.0863	0.0442	0.7125	0.0832	0.0401	0.6473	0.0756	0.0116	0.5438	0.0228	0.0144	0.6743	0.0283	0.0136	0.6341	0.0266	0.0120	0.5627	0.0236	0.0056	0.3435	0.0110	0.0075	0.4571	0.0147	0.0065	0.4003	0.0129	0.0056	0.3435	0.0110	0.0297	0.0953	0.0453	0.0303	0.0974	0.0462	0.0301	0.0968	0.0460	0.0297	0.0953	0.0453	0.0446	0.2339	0.0748	0.0787	0.4132	0.1322	0.0626	0.3284	0.1051	0.0447	0.2345	0.0750	0.0008	0.4545	0.0015	0.0010	0.5694	0.0019	0.0012	0.7297	0.0025	0.0011	0.6555	0.0022	0.0046	0.2577	0.0091	0.0065	0.3616	0.0128	0.0056	0.3096	0.0109	0.0046	0.2577	0.0091	0.0814	0.5928	0.1432	0.0883	0.6428	0.1553	0.0870	0.6334	0.1530	0.0832	0.6056	0.1463	0.0760	0.5658	0.1341	0.1013	0.7541	0.1787	0.0902	0.6710	0.1590	0.0767	0.5707	0.1352	0.0097	0.4423	0.0191	0.0123	0.5606	0.0242	0.0111	0.5025	0.0217	0.0098	0.4434	0.0191	0.0110	0.5312	0.0216	0.0122	0.5891	0.0239	0.0141	0.6792	0.0276	0.0128	0.6182	0.0251	0.0356	0.5392	0.0669	0.0393	0.5952	0.0738	0.0377	0.5696	0.0706	0.0357	0.5406	0.0670	0.0482	0.6540	0.0898	0.0497	0.6739	0.0925	0.0492	0.6679	0.0917	0.0483	0.6560	0.0900	0.0739	0.8419	0.1359	0.0779	0.8866	0.1431	0.0759	0.8646	0.1396	0.0740	0.8421	0.1360	0.0814	0.6336	0.1443	0.0874	0.6802	0.1549	0.0852	0.6635	0.1511	0.0821	0.6393	0.1456	0.0	0.0	0	0.0000	0.0192	0.0001	0.0000	0.0096	0.0000	0.0	0.0	0	0.0770	0.4241	0.1303	0.1137	0.6262	0.1924	0.0967	0.5325	0.1636	0.0778	0.4288	0.1318	0.0016	0.2806	0.0031	0.0021	0.3683	0.0041	0.0018	0.3295	0.0037	0.0016	0.2849	0.0032	0.0199	0.6991	0.0387	0.0202	0.7099	0.0393	0.0211	0.7427	0.0411	0.0209	0.7357	0.0407	0.0416	0.6708	0.0783	0.0547	0.8823	0.1030	0.0481	0.7770	0.0907	0.0416	0.6708	0.0783	0.0963	0.8699	0.1734	0.1013	0.9152	0.1825	0.1005	0.9075	0.1809	0.0977	0.8824	0.1759	0	0	0	0	0.0399	0.2920	0.0702	0.0803	0.5880	0.1413	0.0605	0.4429	0.1064	0.0400	0.2928	0.0704	0.0608	0.8681	0.1136	0.0614	0.8770	0.1148	0.0623	0.8894	0.1164	0.0619	0.8845	0.1157	0.0562	0.5969	0.1027	0.0804	0.8540	0.1469	0.0684	0.7268	0.1250	0.0563	0.5981	0.1029	0.0269	0.6754	0.0517	0.0323	0.8125	0.0622	0.0296	0.7453	0.0570	0.0269	0.6763	0.0517	0.0974	0.8374	0.1746	0.1047	0.8993	0.1875	0.1020	0.8764	0.1827	0.0981	0.8431	0.1758	0.0184	0.6697	0.0358	0.0210	0.7657	0.0409	0.0208	0.7562	0.0404	0.0193	0.7048	0.0377	0.0321	0.6964	0.0614	0.0350	0.7583	0.0669	0.0336	0.7275	0.0642	0.0321	0.6966	0.0614
0.5551	1.9996	2135	0.5132	0.4718	0.5213	0.4953	0.5710	0.6309	0.5995	0.5316	0.5874	0.5581	0.4796	0.5298	0.5034	0.0151	0.4716	0.0292	0.0176	0.5501	0.0341	0.0199	0.6239	0.0386	0.0183	0.5733	0.0355	0.0000	0.0577	0.0000	0.0000	0.1346	0.0001	0.0000	0.0962	0.0001	0.0000	0.0577	0.0000	0.0279	0.2523	0.0502	0.0304	0.2749	0.0547	0.0304	0.2753	0.0548	0.0289	0.2618	0.0521	0.0996	0.7554	0.1759	0.1008	0.7645	0.1780	0.1017	0.7717	0.1797	0.1009	0.7658	0.1784	0.0669	0.6691	0.1217	0.0891	0.8902	0.1619	0.0785	0.7852	0.1428	0.0673	0.6728	0.1224	0.0295	0.6376	0.0563	0.0341	0.7373	0.0651	0.0334	0.7224	0.0638	0.0306	0.6633	0.0586	0.0102	0.4940	0.0200	0.0128	0.6212	0.0251	0.0119	0.5784	0.0234	0.0104	0.5047	0.0204	0.0002	0.2342	0.0004	0.0003	0.4054	0.0006	0.0002	0.3198	0.0005	0.0002	0.2342	0.0004	0.0170	0.1094	0.0294	0.0173	0.1112	0.0299	0.0173	0.1113	0.0299	0.0170	0.1094	0.0294	0.0388	0.2237	0.0661	0.0687	0.3958	0.1170	0.0545	0.3141	0.0929	0.0389	0.2241	0.0663	0.0018	0.3837	0.0035	0.0021	0.4564	0.0042	0.0028	0.6134	0.0057	0.0025	0.5494	0.0051	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0703	0.5429	0.1245	0.0768	0.5931	0.1360	0.0753	0.5816	0.1334	0.0717	0.5537	0.1270	0.0649	0.5856	0.1168	0.0860	0.7762	0.1548	0.0764	0.6898	0.1376	0.0653	0.5895	0.1176	0.0099	0.6094	0.0195	0.0103	0.6319	0.0203	0.0118	0.7252	0.0233	0.0114	0.6973	0.0224	0.0055	0.6504	0.0110	0.0063	0.7425	0.0125	0.0060	0.7102	0.0120	0.0056	0.6606	0.0112	0.0403	0.5168	0.0747	0.0416	0.5341	0.0772	0.0415	0.5333	0.0771	0.0406	0.5207	0.0752	0.0000	0.2941	0.0001	0.0000	0.3529	0.0001	0.0000	0.3235	0.0001	0.0000	0.2941	0.0001	0.0630	0.8251	0.1171	0.0669	0.8759	0.1243	0.0650	0.8509	0.1207	0.0630	0.8253	0.1171	0.0703	0.5799	0.1255	0.0760	0.6268	0.1356	0.0736	0.6070	0.1313	0.0707	0.5827	0.1261	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0646	0.4378	0.1126	0.0948	0.6423	0.1652	0.0811	0.5500	0.1414	0.0655	0.4437	0.1141	0.0000	0.1111	0.0001	0.0000	0.1296	0.0001	0.0000	0.1204	0.0001	0.0000	0.1111	0.0001	0.0164	0.6568	0.0320	0.0167	0.6679	0.0326	0.0175	0.7008	0.0342	0.0173	0.6928	0.0338	0.0297	0.5473	0.0563	0.0438	0.8081	0.0831	0.0367	0.6783	0.0697	0.0297	0.5473	0.0563	0.0839	0.8592	0.1528	0.0879	0.9008	0.1602	0.0875	0.8969	0.1595	0.0852	0.8733	0.1553	0	0	0	0	0.0291	0.2541	0.0522	0.0648	0.5657	0.1163	0.0472	0.4118	0.0847	0.0292	0.2548	0.0524	0.0532	0.8543	0.1001	0.0535	0.8589	0.1007	0.0545	0.8762	0.1027	0.0543	0.8730	0.1023	0.0439	0.5441	0.0812	0.0655	0.8122	0.1213	0.0548	0.6791	0.1014	0.0439	0.5445	0.0813	0.0082	0.6796	0.0162	0.0092	0.7637	0.0182	0.0088	0.7247	0.0173	0.0082	0.6818	0.0163	0.0848	0.8362	0.1540	0.0903	0.8900	0.1639	0.0883	0.8702	0.1603	0.0854	0.8423	0.1551	0.0065	0.3722	0.0127	0.0089	0.5117	0.0175	0.0080	0.4575	0.0156	0.0067	0.3856	0.0132	0.0	0.0	0	0.0000	0.1	0.0000	0.0000	0.05	0.0000	0.0	0.0	0
0.4931	2.9999	3203	0.5980	0.4537	0.4998	0.4756	0.5500	0.6060	0.5767	0.5125	0.5647	0.5373	0.4618	0.5089	0.4842	0.0155	0.4779	0.0300	0.0179	0.5508	0.0346	0.0205	0.6309	0.0396	0.0190	0.5843	0.0367	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0175	0.1874	0.0320	0.0192	0.2056	0.0351	0.0192	0.2055	0.0351	0.0181	0.1946	0.0332	0.0956	0.7008	0.1683	0.0965	0.7073	0.1699	0.0975	0.7146	0.1716	0.0969	0.7098	0.1705	0.0637	0.6734	0.1164	0.0847	0.8946	0.1547	0.0747	0.7893	0.1365	0.0641	0.6770	0.1171	0.0277	0.6801	0.0533	0.0306	0.7506	0.0588	0.0308	0.7555	0.0592	0.0292	0.7147	0.0560	0.0076	0.4074	0.0149	0.0095	0.5085	0.0186	0.0087	0.4652	0.0170	0.0076	0.4102	0.0150	0.0	0.0	0	0.0000	0.5	0.0000	0.0000	0.25	0.0000	0.0	0.0	0	0.0140	0.1230	0.0252	0.0142	0.1245	0.0255	0.0142	0.1243	0.0255	0.0140	0.1230	0.0252	0.0364	0.2301	0.0628	0.0647	0.4089	0.1117	0.0513	0.3243	0.0885	0.0365	0.2306	0.0630	0.0015	0.3829	0.0030	0.0019	0.4701	0.0037	0.0025	0.6220	0.0049	0.0022	0.5574	0.0044	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0636	0.5124	0.1132	0.0698	0.5618	0.1241	0.0681	0.5485	0.1212	0.0648	0.5214	0.1152	0.0619	0.6006	0.1122	0.0822	0.7980	0.1490	0.0730	0.7088	0.1324	0.0623	0.6047	0.1129	0.0094	0.6330	0.0186	0.0097	0.6517	0.0192	0.0109	0.7332	0.0216	0.0106	0.7131	0.0210	0.0068	0.6725	0.0135	0.0074	0.7292	0.0146	0.0073	0.7169	0.0144	0.0069	0.6845	0.0137	0.0389	0.2427	0.0670	0.0402	0.2509	0.0693	0.0421	0.2629	0.0726	0.0406	0.2532	0.0699	0.0000	1.0	0.0001	0.0000	1.0	0.0001	0.0000	1.0	0.0001	0.0000	1.0	0.0001	0.0601	0.8226	0.1120	0.0639	0.8751	0.1191	0.0620	0.8492	0.1156	0.0601	0.8229	0.1120	0.0644	0.5579	0.1154	0.0699	0.6059	0.1254	0.0675	0.5850	0.1210	0.0646	0.5602	0.1159	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0601	0.4527	0.1060	0.0878	0.6617	0.1550	0.0752	0.5669	0.1328	0.0608	0.4582	0.1073	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0150	0.6552	0.0294	0.0153	0.6676	0.0300	0.0162	0.7056	0.0317	0.0160	0.6985	0.0313	0.0249	0.5049	0.0475	0.0388	0.7860	0.0740	0.0319	0.6460	0.0608	0.0249	0.5049	0.0475	0.0796	0.8479	0.1456	0.0838	0.8925	0.1532	0.0834	0.8883	0.1525	0.0811	0.8630	0.1482	0	0	0	0	0.0250	0.2527	0.0456	0.0556	0.5614	0.1012	0.0405	0.4090	0.0737	0.0251	0.2535	0.0457	0.0504	0.8451	0.0951	0.0508	0.8527	0.0959	0.0518	0.8698	0.0979	0.0516	0.8649	0.0973	0.0360	0.4703	0.0669	0.0583	0.7622	0.1084	0.0472	0.6170	0.0877	0.0360	0.4706	0.0669	0.0082	0.6585	0.0163	0.0096	0.7639	0.0189	0.0090	0.7153	0.0177	0.0083	0.6606	0.0163	0.0810	0.8349	0.1477	0.0862	0.8883	0.1572	0.0843	0.8680	0.1536	0.0816	0.8405	0.1488	0.0021	0.1776	0.0041	0.0046	0.3862	0.0090	0.0035	0.2958	0.0069	0.0022	0.1879	0.0044	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0
0.4574	3.9993	4270	0.6609	0.4422	0.4567	0.4494	0.5360	0.5536	0.5446	0.5046	0.5211	0.5127	0.4544	0.4694	0.4618	0.0159	0.4801	0.0307	0.0180	0.5452	0.0349	0.0210	0.6337	0.0406	0.0196	0.5913	0.0379	0.0170	0.1813	0.0311	0.0184	0.1956	0.0336	0.0184	0.1955	0.0336	0.0176	0.1868	0.0321	0.0623	0.6672	0.1140	0.0830	0.8887	0.1519	0.0732	0.7833	0.1339	0.0627	0.6708	0.1147	0.0608	0.5954	0.1104	0.0807	0.7904	0.1465	0.0717	0.7022	0.1302	0.0612	0.5995	0.1111	0.0092	0.6253	0.0181	0.0095	0.6448	0.0187	0.0105	0.7178	0.0208	0.0103	0.7006	0.0203	0.0067	0.5555	0.0132	0.0075	0.6217	0.0148	0.0072	0.5977	0.0142	0.0068	0.5623	0.0134	0.0000	1.0	0.0000	0.0000	1.0	0.0000	0.0000	1.0	0.0000	0.0000	1.0	0.0000	0.0611	0.5440	0.1099	0.0671	0.5975	0.1207	0.0645	0.5740	0.1160	0.0614	0.5464	0.1104	0.0582	0.4400	0.1029	0.0857	0.6473	0.1513	0.0732	0.5532	0.1293	0.0590	0.4459	0.1043	0.0146	0.6602	0.0286	0.0149	0.6726	0.0291	0.0157	0.7086	0.0307	0.0155	0.7009	0.0303	0.0205	0.2350	0.0376	0.0455	0.5229	0.0837	0.0331	0.3810	0.0610	0.0205	0.2354	0.0377	0.0287	0.4215	0.0538	0.0494	0.7245	0.0924	0.0391	0.5735	0.0732	0.0287	0.4218	0.0538	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0936	0.6818	0.1646	0.0945	0.6881	0.1661	0.0954	0.6951	0.1678	0.0948	0.6903	0.1667	0.0260	0.6804	0.0500	0.0280	0.7343	0.0540	0.0284	0.7425	0.0546	0.0271	0.7106	0.0523	0.0053	0.3145	0.0104	0.0069	0.4094	0.0136	0.0061	0.3645	0.0121	0.0053	0.3152	0.0104	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0145	0.1225	0.0260	0.0146	0.1234	0.0262	0.0146	0.1234	0.0262	0.0145	0.1226	0.0260	0.0368	0.2251	0.0632	0.0646	0.3956	0.1111	0.0515	0.3154	0.0885	0.0368	0.2256	0.0633	0.0016	0.3673	0.0032	0.0020	0.4606	0.0040	0.0026	0.5984	0.0051	0.0023	0.5321	0.0046	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0596	0.4813	0.1061	0.0655	0.5289	0.1165	0.0639	0.5163	0.1138	0.0607	0.4904	0.1081	0.0361	0.1306	0.0566	0.0385	0.1390	0.0603	0.0502	0.1815	0.0787	0.0464	0.1679	0.0728	0.0589	0.8098	0.1098	0.0630	0.8669	0.1175	0.0610	0.8387	0.1137	0.0589	0.81	0.1098	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0.0	0.0	0.0	0.0208	0.4567	0.0398	0.0340	0.7445	0.0650	0.0274	0.6011	0.0525	0.0208	0.4567	0.0398	0.0775	0.8373	0.1418	0.0822	0.8882	0.1505	0.0816	0.8817	0.1494	0.0789	0.8523	0.1444	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0498	0.8430	0.0941	0.0502	0.8497	0.0949	0.0513	0.8686	0.0970	0.0511	0.8641	0.0965	0.0084	0.6371	0.0166	0.0095	0.7177	0.0187	0.0090	0.6838	0.0178	0.0085	0.6418	0.0167	0.0796	0.8332	0.1453	0.0848	0.8877	0.1548	0.0828	0.8667	0.1511	0.0801	0.8388	0.1462	0.0028	0.1915	0.0055	0.0055	0.3786	0.0109	0.0043	0.2988	0.0086	0.0029	0.2001	0.0057
0.4301	4.9996	5338	0.6702	0.4398	0.4782	0.4582	0.5305	0.5769	0.5527	0.4976	0.5411	0.5184	0.4494	0.4886	0.4682	0.0158	0.4833	0.0307	0.0178	0.5425	0.0345	0.0209	0.6359	0.0404	0.0195	0.5958	0.0378	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0167	0.1833	0.0306	0.0179	0.1961	0.0328	0.0178	0.1955	0.0327	0.0171	0.1878	0.0314	0.0912	0.6984	0.1613	0.0920	0.7050	0.1628	0.0927	0.7105	0.1641	0.0921	0.7060	0.1630	0.0616	0.6691	0.1128	0.0816	0.8868	0.1494	0.0721	0.7831	0.1320	0.0619	0.6727	0.1134	0.0256	0.6705	0.0494	0.0275	0.7202	0.0530	0.0281	0.7348	0.0541	0.0269	0.7053	0.0519	0.0048	0.3062	0.0094	0.0059	0.3738	0.0115	0.0054	0.3426	0.0106	0.0048	0.3070	0.0095	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0	0.0	0	0.0134	0.1238	0.0243	0.0135	0.1247	0.0244	0.0135	0.1247	0.0244	0.0135	0.1239	0.0243	0.0365	0.2260	0.0628	0.0634	0.3930	0.1092	0.0507	0.3146	0.0874	0.0365	0.2265	0.0629	0.0015	0.3794	0.0031	0.0019	0.4750	0.0038	0.0025	0.6199	0.0050	0.0022	0.5524	0.0045	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0592	0.4596	0.1049	0.0649	0.5039	0.1150	0.0635	0.4929	0.1125	0.0604	0.4686	0.1070	0.0598	0.5936	0.1086	0.0794	0.7885	0.1442	0.0705	0.7005	0.1281	0.0602	0.5975	0.1093	0.0088	0.6330	0.0174	0.0091	0.6497	0.0179	0.0100	0.7191	0.0198	0.0098	0.7068	0.0194	0.0066	0.5464	0.0130	0.0073	0.6092	0.0145	0.0071	0.5865	0.0139	0.0066	0.5526	0.0131	0.0315	0.1693	0.0531	0.0336	0.1806	0.0566	0.0388	0.2088	0.0655	0.0360	0.1934	0.0607	0.0000	1.0	0.0000	0.0000	1.0	0.0000	0.0000	1.0	0.0000	0.0000	1.0	0.0000	0.0575	0.8056	0.1074	0.0615	0.8609	0.1147	0.0595	0.8337	0.1111	0.0575	0.8059	0.1074	0.0604	0.5482	0.1089	0.0661	0.5997	0.1191	0.0637	0.5776	0.1147	0.0607	0.5509	0.1094	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0571	0.4377	0.1011	0.0839	0.6430	0.1485	0.0718	0.5498	0.1270	0.0579	0.4436	0.1024	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0142	0.6635	0.0279	0.0145	0.6740	0.0283	0.0152	0.7063	0.0297	0.0150	0.6993	0.0294	0.0207	0.4752	0.0396	0.0329	0.7560	0.0630	0.0268	0.6164	0.0514	0.0207	0.4752	0.0396	0.0760	0.8343	0.1393	0.0807	0.8862	0.1480	0.0802	0.8800	0.1470	0.0775	0.8504	0.1420	0	0	0	0	0.0199	0.2423	0.0368	0.0419	0.5101	0.0775	0.0311	0.3780	0.0574	0.0200	0.2426	0.0369	0.0489	0.8360	0.0924	0.0494	0.8452	0.0934	0.0506	0.8646	0.0955	0.0502	0.8588	0.0949	0.0280	0.4425	0.0527	0.0473	0.7473	0.0890	0.0377	0.5955	0.0709	0.0280	0.4429	0.0528	0.0080	0.6457	0.0159	0.0091	0.7338	0.0181	0.0087	0.6964	0.0171	0.0081	0.6511	0.0160	0.0784	0.8264	0.1432	0.0837	0.8818	0.1528	0.0818	0.8618	0.1494	0.0791	0.8333	0.1444	0.0025	0.2180	0.0049	0.0051	0.4485	0.0101	0.0040	0.3475	0.0078	0.0026	0.2272	0.0051	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0
0.4147	5.9999	6406	0.6859	0.4342	0.4662	0.4496	0.5235	0.5621	0.5421	0.4927	0.5290	0.5102	0.4448	0.4776	0.4606	0.0157	0.4807	0.0304	0.0176	0.5382	0.0340	0.0207	0.6343	0.0401	0.0194	0.5943	0.0376	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0164	0.1854	0.0301	0.0174	0.1969	0.0320	0.0174	0.1963	0.0319	0.0168	0.1895	0.0308	0.0900	0.6924	0.1593	0.0908	0.6989	0.1608	0.0917	0.7058	0.1623	0.0910	0.7005	0.1611	0.0608	0.6696	0.1116	0.0805	0.8863	0.1477	0.0712	0.7836	0.1305	0.0612	0.6733	0.1122	0.0251	0.6725	0.0484	0.0268	0.7195	0.0517	0.0274	0.7348	0.0528	0.0264	0.7067	0.0508	0.0043	0.2918	0.0085	0.0055	0.3703	0.0108	0.0049	0.3335	0.0097	0.0043	0.2926	0.0085	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0131	0.1254	0.0237	0.0132	0.1264	0.0239	0.0132	0.1265	0.0239	0.0131	0.1256	0.0238	0.0358	0.2225	0.0617	0.0625	0.3881	0.1076	0.0499	0.3101	0.0860	0.0359	0.2231	0.0619	0.0016	0.3994	0.0031	0.0019	0.4907	0.0039	0.0025	0.6354	0.0050	0.0022	0.5681	0.0045	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0567	0.4473	0.1007	0.0626	0.4935	0.1111	0.0611	0.4815	0.1084	0.0579	0.4561	0.1027	0.0592	0.5888	0.1076	0.0785	0.7810	0.1427	0.0698	0.6945	0.1269	0.0596	0.5929	0.1084	0.0087	0.6246	0.0171	0.0089	0.6437	0.0176	0.0099	0.7128	0.0195	0.0097	0.6986	0.0192	0.0066	0.5384	0.0130	0.0074	0.6009	0.0145	0.0071	0.5764	0.0139	0.0067	0.5434	0.0131	0.0301	0.1329	0.0491	0.0319	0.1408	0.0520	0.0400	0.1766	0.0653	0.0366	0.1617	0.0597	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0568	0.8042	0.1060	0.0607	0.8594	0.1133	0.0587	0.8322	0.1097	0.0568	0.8044	0.1061	0.0588	0.5439	0.1062	0.0646	0.5968	0.1165	0.0621	0.5742	0.1121	0.0591	0.5467	0.1067	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0561	0.4492	0.0998	0.0819	0.6555	0.1456	0.0702	0.5622	0.1248	0.0569	0.4551	0.1011	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0137	0.6743	0.0269	0.0140	0.6871	0.0275	0.0147	0.7188	0.0287	0.0145	0.7110	0.0284	0.0190	0.4641	0.0366	0.0308	0.7516	0.0593	0.0250	0.6086	0.0480	0.0190	0.4641	0.0366	0.0746	0.8363	0.1369	0.0792	0.8883	0.1454	0.0785	0.8809	0.1442	0.0759	0.8517	0.1394	0	0	0	0	0.0181	0.2371	0.0337	0.0383	0.5009	0.0711	0.0283	0.3707	0.0526	0.0181	0.2373	0.0337	0.0482	0.8344	0.0911	0.0488	0.8448	0.0923	0.0499	0.8640	0.0944	0.0495	0.8574	0.0937	0.0259	0.4269	0.0489	0.0447	0.7360	0.0843	0.0353	0.5821	0.0667	0.0260	0.4274	0.0489	0.0080	0.6229	0.0159	0.0093	0.7176	0.0183	0.0088	0.6806	0.0174	0.0081	0.6304	0.0161	0.0774	0.8240	0.1415	0.0828	0.8814	0.1513	0.0808	0.8600	0.1476	0.0780	0.8305	0.1426	0.0031	0.2696	0.0062	0.0058	0.4992	0.0114	0.0047	0.4044	0.0092	0.0033	0.2811	0.0064	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0
0.4102	6.9992	7473	0.6960	0.4329	0.4602	0.4461	0.5218	0.5547	0.5378	0.4922	0.5232	0.5072	0.4442	0.4721	0.4577	0.0156	0.4864	0.0302	0.0174	0.5439	0.0337	0.0204	0.6389	0.0396	0.0192	0.5984	0.0371	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0164	0.1845	0.0302	0.0175	0.1960	0.0320	0.0174	0.1952	0.0319	0.0168	0.1884	0.0308	0.0899	0.6912	0.1592	0.0907	0.6970	0.1605	0.0917	0.7050	0.1623	0.0911	0.7	0.1612	0.0609	0.6695	0.1117	0.0805	0.8854	0.1477	0.0712	0.7831	0.1306	0.0612	0.6731	0.1123	0.0251	0.6657	0.0484	0.0269	0.7134	0.0519	0.0275	0.7299	0.0531	0.0264	0.7010	0.0510	0.0044	0.2948	0.0088	0.0056	0.3689	0.0110	0.0050	0.3345	0.0099	0.0045	0.2956	0.0088	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0129	0.1239	0.0233	0.0130	0.1249	0.0235	0.0130	0.1249	0.0235	0.0129	0.1240	0.0234	0.0358	0.2240	0.0618	0.0624	0.3897	0.1075	0.0499	0.3118	0.0860	0.0359	0.2246	0.0619	0.0016	0.3893	0.0031	0.0019	0.4687	0.0037	0.0025	0.6160	0.0049	0.0022	0.5588	0.0044	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0573	0.4406	0.1013	0.0631	0.4853	0.1116	0.0617	0.4746	0.1092	0.0585	0.4500	0.1035	0.0591	0.5861	0.1074	0.0785	0.7783	0.1426	0.0698	0.6917	0.1267	0.0595	0.5900	0.1081	0.0087	0.6313	0.0171	0.0090	0.6542	0.0177	0.0100	0.7242	0.0196	0.0097	0.7070	0.0192	0.0065	0.5258	0.0129	0.0073	0.5882	0.0145	0.0070	0.5631	0.0138	0.0066	0.5307	0.0130	0.0295	0.1190	0.0473	0.0313	0.1265	0.0502	0.0413	0.1667	0.0662	0.0374	0.1510	0.0599	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0569	0.8092	0.1063	0.0608	0.8643	0.1135	0.0588	0.8371	0.1100	0.0569	0.8094	0.1063	0.0580	0.5409	0.1048	0.0639	0.5964	0.1155	0.0614	0.5725	0.1109	0.0583	0.5437	0.1053	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0561	0.4441	0.0995	0.0822	0.6514	0.1460	0.0704	0.5575	0.1250	0.0568	0.4497	0.1008	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0137	0.6719	0.0269	0.0140	0.6854	0.0274	0.0147	0.7185	0.0288	0.0145	0.7102	0.0284	0.0187	0.4679	0.0360	0.0300	0.7505	0.0577	0.0244	0.6100	0.0469	0.0187	0.4679	0.0360	0.0745	0.8375	0.1368	0.0791	0.8899	0.1453	0.0784	0.8821	0.1440	0.0757	0.8520	0.1391	0	0	0	0	0.0181	0.2386	0.0337	0.0384	0.5055	0.0714	0.0284	0.3740	0.0528	0.0181	0.2387	0.0337	0.0480	0.8333	0.0908	0.0486	0.8444	0.0920	0.0497	0.8632	0.0940	0.0493	0.8562	0.0932	0.0255	0.4262	0.0481	0.0438	0.7315	0.0826	0.0347	0.5795	0.0654	0.0255	0.4266	0.0482	0.0080	0.6205	0.0158	0.0092	0.7107	0.0181	0.0087	0.6743	0.0172	0.0081	0.6266	0.0159	0.0771	0.8264	0.1410	0.0824	0.8836	0.1508	0.0804	0.8619	0.1471	0.0777	0.8327	0.1421	0.0025	0.2788	0.0049	0.0047	0.5315	0.0094	0.0038	0.4229	0.0074	0.0026	0.2884	0.0051	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0
0.4011	7.9948	8536	0.7000	0.4317	0.4595	0.4452	0.5205	0.5540	0.5367	0.4910	0.5227	0.5064	0.4430	0.4715	0.4568	0.0155	0.4839	0.0301	0.0174	0.5414	0.0336	0.0204	0.6376	0.0396	0.0191	0.5962	0.0370	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0164	0.1855	0.0301	0.0174	0.1965	0.0319	0.0173	0.1961	0.0319	0.0168	0.1895	0.0308	0.0896	0.6931	0.1587	0.0904	0.6989	0.1600	0.0913	0.7065	0.1618	0.0907	0.7016	0.1606	0.0607	0.6700	0.1113	0.0804	0.8867	0.1473	0.0710	0.7841	0.1303	0.0610	0.6736	0.1119	0.0250	0.6727	0.0481	0.0267	0.7184	0.0514	0.0273	0.7348	0.0526	0.0262	0.7069	0.0506	0.0044	0.3000	0.0086	0.0054	0.3737	0.0107	0.0049	0.3392	0.0097	0.0044	0.3009	0.0086	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0127	0.1243	0.0230	0.0128	0.1254	0.0232	0.0128	0.1254	0.0232	0.0127	0.1244	0.0230	0.0357	0.2230	0.0616	0.0623	0.3888	0.1074	0.0498	0.3107	0.0858	0.0358	0.2235	0.0617	0.0015	0.3925	0.0030	0.0018	0.4741	0.0037	0.0024	0.6248	0.0048	0.0022	0.5683	0.0044	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0567	0.4393	0.1004	0.0625	0.4848	0.1108	0.0611	0.4734	0.1082	0.0578	0.4485	0.1025	0.0590	0.5838	0.1072	0.0783	0.7747	0.1422	0.0696	0.6887	0.1264	0.0594	0.5877	0.1079	0.0086	0.6326	0.0170	0.0089	0.6534	0.0176	0.0099	0.7240	0.0195	0.0097	0.7083	0.0191	0.0066	0.5234	0.0130	0.0074	0.5867	0.0145	0.0070	0.5611	0.0139	0.0066	0.5282	0.0131	0.0293	0.1180	0.0469	0.0310	0.1250	0.0497	0.0413	0.1665	0.0662	0.0374	0.1506	0.0599	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0567	0.8068	0.1059	0.0606	0.8625	0.1132	0.0586	0.8350	0.1096	0.0567	0.8070	0.1059	0.0574	0.5397	0.1038	0.0634	0.5963	0.1147	0.0608	0.5719	0.1100	0.0577	0.5424	0.1043	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0559	0.4427	0.0993	0.0820	0.6490	0.1456	0.0702	0.5557	0.1246	0.0566	0.4484	0.1006	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0	0.0136	0.6737	0.0267	0.0139	0.6874	0.0273	0.0146	0.7199	0.0285	0.0144	0.7114	0.0282	0.0183	0.4603	0.0352	0.0296	0.7454	0.0570	0.0240	0.6037	0.0462	0.0183	0.4603	0.0352	0.0743	0.8373	0.1364	0.0789	0.8896	0.1449	0.0782	0.8819	0.1437	0.0755	0.8519	0.1388	0	0	0	0	0.0178	0.2384	0.0331	0.0375	0.5033	0.0699	0.0278	0.3729	0.0518	0.0178	0.2386	0.0331	0.0479	0.8316	0.0905	0.0485	0.8429	0.0918	0.0496	0.8620	0.0939	0.0492	0.8548	0.0931	0.0251	0.4248	0.0474	0.0432	0.7318	0.0817	0.0342	0.5790	0.0646	0.0251	0.4253	0.0475	0.0080	0.6143	0.0159	0.0093	0.7076	0.0183	0.0088	0.6702	0.0173	0.0081	0.6203	0.0160	0.0769	0.8229	0.1406	0.0822	0.8804	0.1504	0.0802	0.8588	0.1467	0.0775	0.8292	0.1417	0.0028	0.2710	0.0056	0.0054	0.5144	0.0107	0.0043	0.4123	0.0086	0.0030	0.2832	0.0059	0.0	0	0	0.0	0	0	0.0	0	0	0.0	0	0

Framework versions

Transformers 4.40.2
Pytorch 2.3.1+cu121
Datasets 2.20.0
Tokenizers 0.19.1

Downloads last month: 1

Safetensors

Model size

0.2B params

Tensor type

F32

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support