finer_ner_finetuning_1930

This model is a fine-tuned version of distilbert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.0030
• Accuracy: 0.9995
• Precision: 0.7336
• Recall: 0.9108
• F1: 0.8127
• Classification Report: {'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.8030560271646859, 'recall': 0.9510723860589813, 'f1-score': 0.8708192697146364, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.6291053227633069, 'recall': 0.864591439688716, 'f1-score': 0.7282858079318256, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.792677127912506, 'recall': 0.9471590909090909, 'f1-score': 0.8630597980843905, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.7029164607019278, 'recall': 0.8713235294117647, 'f1-score': 0.7781121751025992, 'support': 1632}, 'micro avg': {'precision': 0.7336466901684293, 'recall': 0.9108445453071811, 'f1-score': 0.8126988718542089, 'support': 6169}, 'macro avg': {'precision': 0.7319387346356067, 'recall': 0.9085366115171383, 'f1-score': 0.8100692627083629, 'support': 6169}, 'weighted avg': {'precision': 0.7373693210037475, 'recall': 0.9108445453071811, 'f1-score': 0.8143903271198901, 'support': 6169}}

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 5e-05
• train_batch_size: 192
• eval_batch_size: 512
• seed: 42
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 500
• num_epochs: 20
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	Precision	Recall	F1	Classification Report
0.0062	0.6729	500	0.0035	0.9987	0.4726	0.9091	0.6219	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.6779981114258735, 'recall': 0.9624664879356568, 'f1-score': 0.7955678670360111, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.38188976377952755, 'recall': 0.754863813229572, 'f1-score': 0.5071895424836601, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.5206378986866792, 'recall': 0.9460227272727273, 'f1-score': 0.6716417910447761, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.38319621042134133, 'recall': 0.9417892156862745, 'f1-score': 0.5447457026404395, 'support': 1632}, 'micro avg': {'precision': 0.47257099519676415, 'recall': 0.9090614362133247, 'f1-score': 0.6218673763583944, 'support': 6169}, 'macro avg': {'precision': 0.4909304960783554, 'recall': 0.9012855610310576, 'f1-score': 0.6297862258012217, 'support': 6169}, 'weighted avg': {'precision': 0.4934349887826682, 'recall': 0.9090614362133247, 'f1-score': 0.6337883544589455, 'support': 6169}}
0.0043	1.3459	1000	0.0020	0.9993	0.6224	0.8980	0.7352	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.7216957605985037, 'recall': 0.9698391420911529, 'f1-score': 0.8275664855590505, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.5145967342899554, 'recall': 0.8093385214007782, 'f1-score': 0.6291591046581972, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.6932880203908242, 'recall': 0.9272727272727272, 'f1-score': 0.7933884297520661, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.5636652122173741, 'recall': 0.8707107843137255, 'f1-score': 0.6843245846376115, 'support': 1632}, 'micro avg': {'precision': 0.6224019773059207, 'recall': 0.898038579996758, 'f1-score': 0.7352355673523557, 'support': 6169}, 'macro avg': {'precision': 0.6233114318741644, 'recall': 0.8942902937695959, 'f1-score': 0.7336096511517314, 'support': 6169}, 'weighted avg': {'precision': 0.6286457157727615, 'recall': 0.898038579996758, 'f1-score': 0.7385929655425685, 'support': 6169}}
0.0037	2.0188	1500	0.0018	0.9994	0.6721	0.8831	0.7633	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.8, 'recall': 0.9195710455764075, 'f1-score': 0.85562831306517, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.5406234031681144, 'recall': 0.8233463035019455, 'f1-score': 0.6526835286859962, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.7193211488250653, 'recall': 0.9392045454545455, 'f1-score': 0.814687037949729, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.6390449438202247, 'recall': 0.8363970588235294, 'f1-score': 0.7245222929936306, 'support': 1632}, 'micro avg': {'precision': 0.6720947446336047, 'recall': 0.8831253039390501, 'f1-score': 0.763292469352014, 'support': 6169}, 'macro avg': {'precision': 0.6747473739533512, 'recall': 0.879629738339107, 'f1-score': 0.7618802931736314, 'support': 6169}, 'weighted avg': {'precision': 0.6803740708895686, 'recall': 0.8831253039390501, 'f1-score': 0.7669906543057005, 'support': 6169}}
0.003	2.6918	2000	0.0017	0.9994	0.6761	0.9029	0.7732	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.7630457933972311, 'recall': 0.960455764075067, 'f1-score': 0.8504451038575668, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.5769020251778872, 'recall': 0.8202334630350194, 'f1-score': 0.6773778920308483, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.7388737511353315, 'recall': 0.9244318181818182, 'f1-score': 0.8213023725391216, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.6243567753001715, 'recall': 0.8921568627450981, 'f1-score': 0.7346115035317861, 'support': 1632}, 'micro avg': {'precision': 0.6760529190435732, 'recall': 0.9029016047981845, 'f1-score': 0.7731815657967795, 'support': 6169}, 'macro avg': {'precision': 0.6757945862526553, 'recall': 0.8993194770092506, 'f1-score': 0.7709342179898308, 'support': 6169}, 'weighted avg': {'precision': 0.6806859272799995, 'recall': 0.9029016047981845, 'f1-score': 0.775437321388857, 'support': 6169}}
0.0022	3.3647	2500	0.0017	0.9994	0.7014	0.8859	0.7829	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.7880646960401562, 'recall': 0.9470509383378016, 'f1-score': 0.8602739726027397, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.5705850778314546, 'recall': 0.8272373540856031, 'f1-score': 0.6753494282083863, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.7467386414754836, 'recall': 0.9431818181818182, 'f1-score': 0.8335425558624153, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.694720334553058, 'recall': 0.8143382352941176, 'f1-score': 0.7497884344146686, 'support': 1632}, 'micro avg': {'precision': 0.7013603696098563, 'recall': 0.8858810179931917, 'f1-score': 0.7828952080796505, 'support': 6169}, 'macro avg': {'precision': 0.7000271874750381, 'recall': 0.8829520864748351, 'f1-score': 0.7797385977720526, 'support': 6169}, 'weighted avg': {'precision': 0.7062794531516897, 'recall': 0.8858810179931917, 'f1-score': 0.7848990769417498, 'support': 6169}}
0.0022	4.0377	3000	0.0017	0.9995	0.7231	0.8982	0.8012	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.7771797631862217, 'recall': 0.967828418230563, 'f1-score': 0.862089552238806, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.6263669501822601, 'recall': 0.8023346303501946, 'f1-score': 0.7035141589901057, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.8016650342801175, 'recall': 0.9301136363636363, 'f1-score': 0.8611257233035244, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.6750118091639112, 'recall': 0.8756127450980392, 'f1-score': 0.7623366230994931, 'support': 1632}, 'micro avg': {'precision': 0.723084953673496, 'recall': 0.8982006808234722, 'f1-score': 0.8011856564488143, 'support': 6169}, 'macro avg': {'precision': 0.7200558892031277, 'recall': 0.8939723575106082, 'f1-score': 0.7972665144079824, 'support': 6169}, 'weighted avg': {'precision': 0.7257227217614778, 'recall': 0.8982006808234722, 'f1-score': 0.8023938966048242, 'support': 6169}}
0.0016	4.7106	3500	0.0021	0.9994	0.6841	0.9168	0.7835	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.7698878804057662, 'recall': 0.9664879356568364, 'f1-score': 0.8570579494799405, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.589687328579265, 'recall': 0.8365758754863813, 'f1-score': 0.6917631917631919, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.7461746174617462, 'recall': 0.9420454545454545, 'f1-score': 0.8327473631341035, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.6302127659574468, 'recall': 0.9074754901960784, 'f1-score': 0.7438473129080865, 'support': 1632}, 'micro avg': {'precision': 0.6840832123850992, 'recall': 0.9168422758956071, 'f1-score': 0.7835422871787767, 'support': 6169}, 'macro avg': {'precision': 0.683990648101056, 'recall': 0.9131461889711876, 'f1-score': 0.7813539543213306, 'support': 6169}, 'weighted avg': {'precision': 0.6886360018746936, 'recall': 0.9168422758956071, 'f1-score': 0.7857416657192076, 'support': 6169}}
0.0013	5.3836	4000	0.0021	0.9995	0.7021	0.9147	0.7945	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.8167539267015707, 'recall': 0.9410187667560321, 'f1-score': 0.874493927125506, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.5747592498732894, 'recall': 0.8824902723735408, 'f1-score': 0.6961325966850829, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.7621247113163973, 'recall': 0.9375, 'f1-score': 0.840764331210191, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.6674311926605505, 'recall': 0.8915441176470589, 'f1-score': 0.7633788037775446, 'support': 1632}, 'micro avg': {'precision': 0.7021276595744681, 'recall': 0.9147349651483223, 'f1-score': 0.794453048007884, 'support': 6169}, 'macro avg': {'precision': 0.7052672701379519, 'recall': 0.913138289194158, 'f1-score': 0.7936924146995812, 'support': 6169}, 'weighted avg': {'precision': 0.7112578526608523, 'recall': 0.9147349651483223, 'f1-score': 0.79832302750956, 'support': 6169}}
0.0011	6.0565	4500	0.0019	0.9995	0.7393	0.8933	0.8091	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.7822536744692433, 'recall': 0.9631367292225201, 'f1-score': 0.8633223190147191, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.6813858695652174, 'recall': 0.7805447470817121, 'f1-score': 0.7276024664490388, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.8216855087358684, 'recall': 0.9085227272727273, 'f1-score': 0.8629249865083649, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.6693951796271033, 'recall': 0.9019607843137255, 'f1-score': 0.7684677629861656, 'support': 1632}, 'micro avg': {'precision': 0.7393345854574725, 'recall': 0.8933376560220457, 'f1-score': 0.809072891433605, 'support': 6169}, 'macro avg': {'precision': 0.7386800580993581, 'recall': 0.8885412469726712, 'f1-score': 0.805579383739572, 'support': 6169}, 'weighted avg': {'precision': 0.74263620574258, 'recall': 0.8933376560220457, 'f1-score': 0.8098449399911039, 'support': 6169}}
0.001	6.7295	5000	0.0022	0.9995	0.7050	0.9118	0.7952	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.7899113082039911, 'recall': 0.9550938337801609, 'f1-score': 0.8646844660194176, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.5650246305418719, 'recall': 0.8926070038910506, 'f1-score': 0.6920060331825038, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.7896267571497819, 'recall': 0.9255681818181818, 'f1-score': 0.8522103060423751, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.6839577329490875, 'recall': 0.8725490196078431, 'f1-score': 0.7668282175551965, 'support': 1632}, 'micro avg': {'precision': 0.704975560847224, 'recall': 0.9118171502674663, 'f1-score': 0.7951653944020356, 'support': 6169}, 'macro avg': {'precision': 0.7071301072111831, 'recall': 0.9114545097743091, 'f1-score': 0.7939322556998731, 'support': 6169}, 'weighted avg': {'precision': 0.7149564653660538, 'recall': 0.9118171502674663, 'f1-score': 0.7992690493799885, 'support': 6169}}
0.0007	7.4024	5500	0.0022	0.9995	0.7354	0.9042	0.8111	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.8013468013468014, 'recall': 0.9571045576407506, 'f1-score': 0.872327428222358, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.6501831501831502, 'recall': 0.8287937743190662, 'f1-score': 0.7287033869312352, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.7923076923076923, 'recall': 0.9363636363636364, 'f1-score': 0.8583333333333333, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.6892086330935252, 'recall': 0.8805147058823529, 'f1-score': 0.7732041969330105, 'support': 1632}, 'micro avg': {'precision': 0.735398813447594, 'recall': 0.9041984114118982, 'f1-score': 0.8111094954195144, 'support': 6169}, 'macro avg': {'precision': 0.7332615692327922, 'recall': 0.9006941685514516, 'f1-score': 0.8081420863549843, 'support': 6169}, 'weighted avg': {'precision': 0.7376146544439856, 'recall': 0.9041984114118982, 'f1-score': 0.8121952165951912, 'support': 6169}}
0.0007	8.0754	6000	0.0025	0.9995	0.7073	0.9178	0.7989	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.7880285557386052, 'recall': 0.9617962466487936, 'f1-score': 0.8662843344400846, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.6119153674832962, 'recall': 0.8552529182879377, 'f1-score': 0.7134047387211945, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.7232947232947233, 'recall': 0.9579545454545455, 'f1-score': 0.824248350036666, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.7010209042294604, 'recall': 0.883578431372549, 'f1-score': 0.7817836812144213, 'support': 1632}, 'micro avg': {'precision': 0.7073079325421612, 'recall': 0.9178148808558924, 'f1-score': 0.7989276139410187, 'support': 6169}, 'macro avg': {'precision': 0.7060648876865213, 'recall': 0.9146455354409564, 'f1-score': 0.7964302761030916, 'support': 6169}, 'weighted avg': {'precision': 0.7098581100793041, 'recall': 0.9178148808558924, 'f1-score': 0.8000922969764643, 'support': 6169}}
0.0006	8.7483	6500	0.0026	0.9995	0.7150	0.9139	0.8023	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.80625, 'recall': 0.9510723860589813, 'f1-score': 0.8726937269372694, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.5826893353941267, 'recall': 0.8801556420233463, 'f1-score': 0.7011779293242405, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.8048062775870525, 'recall': 0.9323863636363636, 'f1-score': 0.8639115556725454, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.6745920745920746, 'recall': 0.8866421568627451, 'f1-score': 0.7662165740005294, 'support': 1632}, 'micro avg': {'precision': 0.7150285351934051, 'recall': 0.9139244610147512, 'f1-score': 0.802333855130212, 'support': 6169}, 'macro avg': {'precision': 0.7170844218933135, 'recall': 0.912564137145359, 'f1-score': 0.8009999464836463, 'support': 6169}, 'weighted avg': {'precision': 0.7244406079216941, 'recall': 0.9139244610147512, 'f1-score': 0.8062931539187226, 'support': 6169}}
0.0005	9.4213	7000	0.0026	0.9995	0.7346	0.9121	0.8138	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.8179710144927537, 'recall': 0.9457104557640751, 'f1-score': 0.8772147963941561, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.6788227767114523, 'recall': 0.82568093385214, 'f1-score': 0.7450842696629213, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.7936129647283127, 'recall': 0.9460227272727273, 'f1-score': 0.8631415241057543, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.6552330694810906, 'recall': 0.9129901960784313, 'f1-score': 0.7629288274449564, 'support': 1632}, 'micro avg': {'precision': 0.7345953002610967, 'recall': 0.9121413519208948, 'f1-score': 0.8137970930652976, 'support': 6169}, 'macro avg': {'precision': 0.7364099563534023, 'recall': 0.9076010782418436, 'f1-score': 0.8120923544019472, 'support': 6169}, 'weighted avg': {'precision': 0.738985120605021, 'recall': 0.9121413519208948, 'f1-score': 0.815442809459107, 'support': 6169}}
0.0004	10.0942	7500	0.0024	0.9996	0.7561	0.8966	0.8204	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.8150488225157955, 'recall': 0.9510723860589813, 'f1-score': 0.8778224559232911, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.6491228070175439, 'recall': 0.8350194552529183, 'f1-score': 0.730428863172226, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.8234398782343988, 'recall': 0.9221590909090909, 'f1-score': 0.8700080407397481, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.7261538461538461, 'recall': 0.8676470588235294, 'f1-score': 0.7906197654941374, 'support': 1632}, 'micro avg': {'precision': 0.7561175666438824, 'recall': 0.8965796725563301, 'f1-score': 0.8203797092850788, 'support': 6169}, 'macro avg': {'precision': 0.7534413384803961, 'recall': 0.89397449776113, 'f1-score': 0.8172197813323506, 'support': 6169}, 'weighted avg': {'precision': 0.759363415922634, 'recall': 0.8965796725563301, 'f1-score': 0.8218216570598558, 'support': 6169}}
0.0004	10.7672	8000	0.0029	0.9995	0.7217	0.9152	0.8070	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.7714592274678111, 'recall': 0.9638069705093834, 'f1-score': 0.8569725864123957, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.6273957158962796, 'recall': 0.866147859922179, 'f1-score': 0.7276887871853549, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.7920887602508442, 'recall': 0.9329545454545455, 'f1-score': 0.8567701539264283, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.6879734848484849, 'recall': 0.8903186274509803, 'f1-score': 0.7761752136752137, 'support': 1632}, 'micro avg': {'precision': 0.7217180109932251, 'recall': 0.9152212676284649, 'f1-score': 0.8070325900514579, 'support': 6169}, 'macro avg': {'precision': 0.719729297115855, 'recall': 0.9133070008342721, 'f1-score': 0.8044016852998481, 'support': 6169}, 'weighted avg': {'precision': 0.7252503821726223, 'recall': 0.9152212676284649, 'f1-score': 0.8086102464076734, 'support': 6169}}
0.0003	11.4401	8500	0.0026	0.9995	0.7466	0.9018	0.8169	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.8189705031810295, 'recall': 0.9490616621983914, 'f1-score': 0.8792300527786402, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.6555891238670695, 'recall': 0.8443579766536965, 'f1-score': 0.738095238095238, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.7759181775918178, 'recall': 0.9482954545454545, 'f1-score': 0.8534901559703401, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.7270354906054279, 'recall': 0.8535539215686274, 'f1-score': 0.7852311161217587, 'support': 1632}, 'micro avg': {'precision': 0.7466111931284392, 'recall': 0.901766899011185, 'f1-score': 0.8168869309838473, 'support': 6169}, 'macro avg': {'precision': 0.7443783238113362, 'recall': 0.8988172537415424, 'f1-score': 0.8140116407414943, 'support': 6169}, 'weighted avg': {'precision': 0.7483342402569199, 'recall': 0.901766899011185, 'f1-score': 0.817620923280373, 'support': 6169}}
0.0003	12.1131	9000	0.0030	0.9995	0.7336	0.9108	0.8127	{'DebtInstrumentBasisSpreadOnVariableRate1': {'precision': 0.8030560271646859, 'recall': 0.9510723860589813, 'f1-score': 0.8708192697146364, 'support': 1492}, 'DebtInstrumentFaceAmount': {'precision': 0.6291053227633069, 'recall': 0.864591439688716, 'f1-score': 0.7282858079318256, 'support': 1285}, 'DebtInstrumentInterestRateStatedPercentage': {'precision': 0.792677127912506, 'recall': 0.9471590909090909, 'f1-score': 0.8630597980843905, 'support': 1760}, 'LineOfCreditFacilityMaximumBorrowingCapacity': {'precision': 0.7029164607019278, 'recall': 0.8713235294117647, 'f1-score': 0.7781121751025992, 'support': 1632}, 'micro avg': {'precision': 0.7336466901684293, 'recall': 0.9108445453071811, 'f1-score': 0.8126988718542089, 'support': 6169}, 'macro avg': {'precision': 0.7319387346356067, 'recall': 0.9085366115171383, 'f1-score': 0.8100692627083629, 'support': 6169}, 'weighted avg': {'precision': 0.7373693210037475, 'recall': 0.9108445453071811, 'f1-score': 0.8143903271198901, 'support': 6169}}

Framework versions

• Transformers 4.48.3
• Pytorch 2.6.0+cu124
• Datasets 3.2.0
• Tokenizers 0.21.0