v7_onlyaugs800k_qwen_lora

This model is a fine-tuned version of Daewon0808/prm800k_qwen_fulltune on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.9864
• Prm accuracy: 0.8208
• Prm precision: 0.8137
• Prm recall: 1.0
• Prm specificty: 0.1739
• Prm npv: 1.0
• Prm f1: 0.8973
• Prm f1 neg: 0.2963
• Prm f1 auc: 0.5870
• Prm f1 auc (fixed): 0.8984

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0001
• train_batch_size: 2
• eval_batch_size: 4
• seed: 908932403
• distributed_type: multi-GPU
• num_devices: 8
• gradient_accumulation_steps: 4
• total_train_batch_size: 64
• total_eval_batch_size: 32
• optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: cosine
• lr_scheduler_warmup_ratio: 0.1
• num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss	Prm accuracy	Prm precision	Prm recall	Prm specificty	Prm npv	Prm f1	Prm f1 neg	Prm f1 auc	Prm f1 auc (fixed)
No log	0	0	0.2271	0.8774	0.9375	0.9036	0.7826	0.6923	0.9202	0.7347	0.8431	0.8345
0.3991	0.0034	5	0.2265	0.8774	0.9375	0.9036	0.7826	0.6923	0.9202	0.7347	0.8431	0.8342
0.3901	0.0068	10	0.2276	0.8774	0.9375	0.9036	0.7826	0.6923	0.9202	0.7347	0.8431	0.8316
0.3863	0.0102	15	0.2270	0.8774	0.9375	0.9036	0.7826	0.6923	0.9202	0.7347	0.8431	0.8334
0.4921	0.0136	20	0.2271	0.8679	0.9259	0.9036	0.7391	0.68	0.9146	0.7083	0.8214	0.8366
0.3194	0.0170	25	0.2372	0.9057	0.9101	0.9759	0.6522	0.8824	0.9419	0.75	0.8140	0.8394
0.3713	0.0203	30	0.2852	0.9057	0.9011	0.9880	0.6087	0.9333	0.9425	0.7368	0.7983	0.8452
0.384	0.0237	35	0.3114	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8515
0.4006	0.0271	40	0.2645	0.9057	0.9011	0.9880	0.6087	0.9333	0.9425	0.7368	0.7983	0.8486
0.3619	0.0305	45	0.2452	0.8962	0.9	0.9759	0.6087	0.875	0.9364	0.7179	0.7923	0.8447
0.2869	0.0339	50	0.2323	0.8962	0.9091	0.9639	0.6522	0.8333	0.9357	0.7317	0.8080	0.8497
0.2566	0.0373	55	0.2316	0.8962	0.9186	0.9518	0.6957	0.8	0.9349	0.7442	0.8237	0.8483
0.204	0.0407	60	0.2414	0.8962	0.9091	0.9639	0.6522	0.8333	0.9357	0.7317	0.8080	0.8604
0.1928	0.0441	65	0.2833	0.8868	0.8901	0.9759	0.5652	0.8667	0.9310	0.6842	0.7706	0.8696
0.2903	0.0475	70	0.2673	0.8962	0.9	0.9759	0.6087	0.875	0.9364	0.7179	0.7923	0.8685
0.2207	0.0509	75	0.2607	0.8962	0.9091	0.9639	0.6522	0.8333	0.9357	0.7317	0.8080	0.8675
0.2689	0.0543	80	0.2544	0.8962	0.9091	0.9639	0.6522	0.8333	0.9357	0.7317	0.8080	0.8664
0.2774	0.0577	85	0.2501	0.8868	0.9176	0.9398	0.6957	0.7619	0.9286	0.7273	0.8177	0.8554
0.1592	0.0610	90	0.2793	0.8868	0.9080	0.9518	0.6522	0.7895	0.9294	0.7143	0.8020	0.8570
0.141	0.0644	95	0.2645	0.8679	0.9157	0.9157	0.6957	0.6957	0.9157	0.6957	0.8057	0.8533
0.2308	0.0678	100	0.2919	0.8962	0.9091	0.9639	0.6522	0.8333	0.9357	0.7317	0.8080	0.8607
0.2861	0.0712	105	0.2545	0.8774	0.9167	0.9277	0.6957	0.7273	0.9222	0.7111	0.8117	0.8591
0.2891	0.0746	110	0.2642	0.9151	0.9205	0.9759	0.6957	0.8889	0.9474	0.7805	0.8358	0.8541
0.1742	0.0780	115	0.3104	0.9057	0.9011	0.9880	0.6087	0.9333	0.9425	0.7368	0.7983	0.8507
0.3077	0.0814	120	0.3208	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8491
0.2794	0.0848	125	0.2433	0.8868	0.9277	0.9277	0.7391	0.7391	0.9277	0.7391	0.8334	0.8491
0.1221	0.0882	130	0.3251	0.9057	0.9011	0.9880	0.6087	0.9333	0.9425	0.7368	0.7983	0.8583
0.1573	0.0916	135	0.4995	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8625
0.2251	0.0950	140	0.3813	0.8868	0.8901	0.9759	0.5652	0.8667	0.9310	0.6842	0.7706	0.8643
0.1112	0.0984	145	0.4068	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8743
0.1388	0.1017	150	0.4041	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8769
0.174	0.1051	155	0.3488	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8829
0.1989	0.1085	160	0.3669	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8800
0.1669	0.1119	165	0.2836	0.8868	0.9080	0.9518	0.6522	0.7895	0.9294	0.7143	0.8020	0.8717
0.1527	0.1153	170	0.3441	0.8774	0.8889	0.9639	0.5652	0.8125	0.9249	0.6667	0.7645	0.8777
0.1497	0.1187	175	0.2793	0.8868	0.8989	0.9639	0.6087	0.8235	0.9302	0.7	0.7863	0.8690
0.193	0.1221	180	0.2554	0.8868	0.9176	0.9398	0.6957	0.7619	0.9286	0.7273	0.8177	0.8559
0.3058	0.1255	185	0.3476	0.8774	0.8804	0.9759	0.5217	0.8571	0.9257	0.6486	0.7488	0.8601
0.1633	0.1289	190	0.3899	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8656
0.1216	0.1323	195	0.3793	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8709
0.2043	0.1357	200	0.3169	0.9057	0.9011	0.9880	0.6087	0.9333	0.9425	0.7368	0.7983	0.8701
0.0936	0.1391	205	0.3345	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8748
0.1975	0.1424	210	0.3877	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8735
0.1404	0.1458	215	0.4018	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8654
0.0998	0.1492	220	0.4056	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8654
0.1733	0.1526	225	0.3863	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8630
0.2434	0.1560	230	0.3069	0.8868	0.8901	0.9759	0.5652	0.8667	0.9310	0.6842	0.7706	0.8460
0.1337	0.1594	235	0.3148	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8502
0.1386	0.1628	240	0.3153	0.8868	0.8901	0.9759	0.5652	0.8667	0.9310	0.6842	0.7706	0.8434
0.1038	0.1662	245	0.4318	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8463
0.0913	0.1696	250	0.4010	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8512
0.1822	0.1730	255	0.4056	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8510
0.1078	0.1764	260	0.3416	0.8962	0.9	0.9759	0.6087	0.875	0.9364	0.7179	0.7923	0.8478
0.0984	0.1798	265	0.4117	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8578
0.1013	0.1831	270	0.4852	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8635
0.078	0.1865	275	0.6261	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.8704
0.1961	0.1899	280	0.4063	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8586
0.138	0.1933	285	0.3322	0.8868	0.8989	0.9639	0.6087	0.8235	0.9302	0.7	0.7863	0.8510
0.1046	0.1967	290	0.3564	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8601
0.1556	0.2001	295	0.3584	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8617
0.1121	0.2035	300	0.4137	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8672
0.1461	0.2069	305	0.4612	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8706
0.0435	0.2103	310	0.5440	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8709
0.1065	0.2137	315	0.4276	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8748
0.128	0.2171	320	0.3567	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8811
0.1214	0.2205	325	0.3498	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8777
0.194	0.2238	330	0.3369	0.8868	0.8901	0.9759	0.5652	0.8667	0.9310	0.6842	0.7706	0.8709
0.1226	0.2272	335	0.2918	0.9057	0.9101	0.9759	0.6522	0.8824	0.9419	0.75	0.8140	0.8643
0.0838	0.2306	340	0.3408	0.8868	0.8901	0.9759	0.5652	0.8667	0.9310	0.6842	0.7706	0.8717
0.0895	0.2340	345	0.5387	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8748
0.0748	0.2374	350	0.4810	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8764
0.1038	0.2408	355	0.4349	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8717
0.0958	0.2442	360	0.5047	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8714
0.1445	0.2476	365	0.4326	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8719
0.1262	0.2510	370	0.3930	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8680
0.1844	0.2544	375	0.4706	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8672
0.0553	0.2578	380	0.5241	0.8491	0.8384	1.0	0.3043	1.0	0.9121	0.4667	0.6522	0.8662
0.1019	0.2611	385	0.5107	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8638
0.0988	0.2645	390	0.3946	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8604
0.2323	0.2679	395	0.4300	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8628
0.1456	0.2713	400	0.5281	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8677
0.1754	0.2747	405	0.5420	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8622
0.085	0.2781	410	0.3600	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8622
0.1005	0.2815	415	0.3596	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8601
0.0732	0.2849	420	0.4637	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8633
0.0691	0.2883	425	0.4729	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8719
0.1915	0.2917	430	0.4018	0.8962	0.8913	0.9880	0.5652	0.9286	0.9371	0.7027	0.7766	0.8821
0.1281	0.2951	435	0.4614	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8772
0.1663	0.2985	440	0.5339	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8811
0.1798	0.3018	445	0.4933	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8803
0.1248	0.3052	450	0.4655	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8711
0.1719	0.3086	455	0.4626	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8727
0.0838	0.3120	460	0.4857	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8719
0.1812	0.3154	465	0.5388	0.8679	0.8557	1.0	0.3913	1.0	0.9222	0.5625	0.6957	0.8735
0.1163	0.3188	470	0.4720	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8680
0.1309	0.3222	475	0.5000	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8677
0.043	0.3256	480	0.5714	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8601
0.1962	0.3290	485	0.5447	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8628
0.0613	0.3324	490	0.4246	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8711
0.1011	0.3358	495	0.4193	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8853
0.0881	0.3392	500	0.5107	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8882
0.1074	0.3425	505	0.4344	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8968
0.1129	0.3459	510	0.4001	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8916
0.1017	0.3493	515	0.4677	0.8679	0.8632	0.9880	0.4348	0.9091	0.9213	0.5882	0.7114	0.8952
0.1359	0.3527	520	0.5891	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8918
0.0948	0.3561	525	0.5519	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8842
0.0935	0.3595	530	0.4579	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8795
0.0584	0.3629	535	0.4330	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8787
0.0517	0.3663	540	0.4826	0.8585	0.8542	0.9880	0.3913	0.9	0.9162	0.5455	0.6896	0.8790
0.0695	0.3697	545	0.5438	0.8774	0.8646	1.0	0.4348	1.0	0.9274	0.6061	0.7174	0.8845
0.1623	0.3731	550	0.5265	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.8850
0.0837	0.3765	555	0.5344	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8845
0.0806	0.3799	560	0.5469	0.8868	0.8737	1.0	0.4783	1.0	0.9326	0.6471	0.7391	0.8895
0.0562	0.3832	565	0.4770	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8986
0.094	0.3866	570	0.4969	0.8962	0.8830	1.0	0.5217	1.0	0.9379	0.6857	0.7609	0.8984
0.0563	0.3900	575	0.5273	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8973
0.1127	0.3934	580	0.5531	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.9054
0.0799	0.3968	585	0.5241	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.9060
0.113	0.4002	590	0.4792	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.9041
0.1299	0.4036	595	0.5511	0.8962	0.8830	1.0	0.5217	1.0	0.9379	0.6857	0.7609	0.9096
0.0666	0.4070	600	0.5095	0.8962	0.8830	1.0	0.5217	1.0	0.9379	0.6857	0.7609	0.9026
0.0776	0.4104	605	0.4547	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8989
0.1324	0.4138	610	0.4268	0.8868	0.8817	0.9880	0.5217	0.9231	0.9318	0.6667	0.7548	0.8989
0.1009	0.4172	615	0.5171	0.8962	0.8830	1.0	0.5217	1.0	0.9379	0.6857	0.7609	0.9023
0.1316	0.4206	620	0.5977	0.8868	0.8737	1.0	0.4783	1.0	0.9326	0.6471	0.7391	0.9044
0.1429	0.4239	625	0.5022	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.9065
0.0727	0.4273	630	0.4536	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.9028
0.0896	0.4307	635	0.4961	0.8774	0.8723	0.9880	0.4783	0.9167	0.9266	0.6286	0.7331	0.9036
0.081	0.4341	640	0.5440	0.8774	0.8646	1.0	0.4348	1.0	0.9274	0.6061	0.7174	0.9036
0.0905	0.4375	645	0.5883	0.8679	0.8557	1.0	0.3913	1.0	0.9222	0.5625	0.6957	0.9036
0.0869	0.4409	650	0.6121	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8986
0.0979	0.4443	655	0.5935	0.8491	0.8454	0.9880	0.3478	0.8889	0.9111	0.5	0.6679	0.8921
0.0593	0.4477	660	0.6262	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8855
0.1028	0.4511	665	0.7210	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.8850
0.1166	0.4545	670	0.7510	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8897
0.0583	0.4579	675	0.6496	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.8892
0.0896	0.4613	680	0.6935	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8955
0.0734	0.4646	685	0.7634	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8973
0.0888	0.4680	690	0.7221	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9005
0.0941	0.4714	695	0.5913	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.9013
0.1054	0.4748	700	0.5586	0.8491	0.8384	1.0	0.3043	1.0	0.9121	0.4667	0.6522	0.8997
0.2673	0.4782	705	0.5914	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.9020
0.0802	0.4816	710	0.5510	0.8491	0.8384	1.0	0.3043	1.0	0.9121	0.4667	0.6522	0.9018
0.1927	0.4850	715	0.5749	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.9010
0.0994	0.4884	720	0.5144	0.8679	0.8557	1.0	0.3913	1.0	0.9222	0.5625	0.6957	0.8958
0.0645	0.4918	725	0.5293	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8937
0.14	0.4952	730	0.5883	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8958
0.0956	0.4986	735	0.6499	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8992
0.1382	0.5020	740	0.6361	0.8491	0.8384	1.0	0.3043	1.0	0.9121	0.4667	0.6522	0.8958
0.0766	0.5053	745	0.6189	0.8679	0.8557	1.0	0.3913	1.0	0.9222	0.5625	0.6957	0.8952
0.0568	0.5087	750	0.6435	0.8679	0.8557	1.0	0.3913	1.0	0.9222	0.5625	0.6957	0.8981
0.0922	0.5121	755	0.7031	0.8585	0.8469	1.0	0.3478	1.0	0.9171	0.5161	0.6739	0.8965
0.0942	0.5155	760	0.8422	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8908
0.1505	0.5189	765	0.9690	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8926
0.0995	0.5223	770	0.8744	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8926
0.0728	0.5257	775	0.7211	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.8950
0.0922	0.5291	780	0.6873	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.9007
0.0579	0.5325	785	0.7206	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9020
0.0798	0.5359	790	0.6590	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.9073
0.0676	0.5393	795	0.5485	0.8774	0.8646	1.0	0.4348	1.0	0.9274	0.6061	0.7174	0.9104
0.111	0.5426	800	0.5310	0.8774	0.8646	1.0	0.4348	1.0	0.9274	0.6061	0.7174	0.9146
0.1016	0.5460	805	0.5599	0.8679	0.8557	1.0	0.3913	1.0	0.9222	0.5625	0.6957	0.9201
0.0509	0.5494	810	0.6660	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.9225
0.0875	0.5528	815	0.7098	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9185
0.0905	0.5562	820	0.7241	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9107
0.0482	0.5596	825	0.7768	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9044
0.1272	0.5630	830	0.7293	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8986
0.0565	0.5664	835	0.7816	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8952
0.0713	0.5698	840	0.8852	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8931
0.0884	0.5732	845	0.8637	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8897
0.1033	0.5766	850	0.8584	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8905
0.1162	0.5800	855	0.7822	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8929
0.0601	0.5833	860	0.8419	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8884
0.0967	0.5867	865	0.9060	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8876
0.1207	0.5901	870	0.9668	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8934
0.0958	0.5935	875	0.8655	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8947
0.0388	0.5969	880	0.8251	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8892
0.0949	0.6003	885	0.8456	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8934
0.1755	0.6037	890	0.9025	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8981
0.0671	0.6071	895	0.8514	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.8910
0.0856	0.6105	900	0.8858	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.8934
0.1097	0.6139	905	0.9493	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8905
0.0626	0.6173	910	0.9615	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8876
0.0755	0.6207	915	0.8791	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8848
0.1145	0.6240	920	0.8575	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8842
0.0857	0.6274	925	0.8234	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8827
0.0854	0.6308	930	0.8560	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8834
0.0709	0.6342	935	0.9199	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8816
0.0522	0.6376	940	0.9444	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8832
0.0839	0.6410	945	0.8850	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8834
0.0847	0.6444	950	0.8596	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8871
0.1122	0.6478	955	0.8509	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8855
0.062	0.6512	960	0.8368	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.8806
0.0348	0.6546	965	0.8612	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8821
0.0718	0.6580	970	0.8652	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8842
0.034	0.6614	975	0.8419	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8842
0.1121	0.6647	980	0.8893	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8879
0.1324	0.6681	985	0.8941	0.8302	0.8218	1.0	0.2174	1.0	0.9022	0.3571	0.6087	0.8876
0.1361	0.6715	990	0.8051	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8858
0.0874	0.6749	995	0.7942	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8850
0.1205	0.6783	1000	0.7761	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8887
0.1024	0.6817	1005	0.7638	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8863
0.0599	0.6851	1010	0.8042	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8887
0.0876	0.6885	1015	0.8506	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8910
0.0977	0.6919	1020	0.8636	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8910
0.0552	0.6953	1025	0.8298	0.8396	0.83	1.0	0.2609	1.0	0.9071	0.4138	0.6304	0.8937
0.0778	0.6987	1030	0.8421	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8887
0.0693	0.7021	1035	0.8706	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8887
0.0703	0.7054	1040	0.8498	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8903
0.0561	0.7088	1045	0.8252	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8924
0.045	0.7122	1050	0.8714	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8999
0.0686	0.7156	1055	0.9441	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8934
0.0481	0.7190	1060	0.9749	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8963
0.0768	0.7224	1065	0.9832	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8979
0.0638	0.7258	1070	1.0029	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8939
0.1014	0.7292	1075	1.0305	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8965
0.0512	0.7326	1080	1.0932	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8979
0.1873	0.7360	1085	1.0743	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8992
0.0409	0.7394	1090	1.0393	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9007
0.0865	0.7428	1095	0.9883	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9007
0.0902	0.7461	1100	0.9335	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9005
0.0587	0.7495	1105	0.8859	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8992
0.062	0.7529	1110	0.8835	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8979
0.0965	0.7563	1115	0.8958	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8958
0.0464	0.7597	1120	0.8828	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8950
0.0795	0.7631	1125	0.8774	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8926
0.053	0.7665	1130	0.8716	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8944
0.1437	0.7699	1135	0.8593	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8947
0.0894	0.7733	1140	0.8660	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8931
0.0498	0.7767	1145	0.8575	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8929
0.0785	0.7801	1150	0.8778	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8918
0.1106	0.7834	1155	0.8879	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8937
0.0946	0.7868	1160	0.8844	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8926
0.0708	0.7902	1165	0.8741	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8952
0.0495	0.7936	1170	0.8492	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8937
0.073	0.7970	1175	0.8278	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8952
0.0652	0.8004	1180	0.8457	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8979
0.0835	0.8038	1185	0.8856	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8965
0.1057	0.8072	1190	0.9238	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8965
0.0433	0.8106	1195	0.9043	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8984
0.0385	0.8140	1200	0.8890	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8992
0.0593	0.8174	1205	0.8689	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9018
0.1077	0.8208	1210	0.8711	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8986
0.1662	0.8241	1215	0.8616	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8984
0.0722	0.8275	1220	0.8669	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9018
0.1389	0.8309	1225	0.8796	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9013
0.048	0.8343	1230	0.9183	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8997
0.0831	0.8377	1235	0.9491	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9018
0.0897	0.8411	1240	0.9662	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9005
0.086	0.8445	1245	0.9610	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9036
0.0851	0.8479	1250	0.9611	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9020
0.0409	0.8513	1255	0.9626	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9007
0.1243	0.8547	1260	0.9640	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9015
0.0595	0.8581	1265	0.9789	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8992
0.1074	0.8615	1270	0.9964	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9002
0.0604	0.8648	1275	1.0021	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8992
0.05	0.8682	1280	1.0045	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8999
0.0717	0.8716	1285	0.9965	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8994
0.0503	0.8750	1290	0.9911	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8999
0.0655	0.8784	1295	0.9892	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8981
0.0656	0.8818	1300	0.9872	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8981
0.051	0.8852	1305	0.9923	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8968
0.0541	0.8886	1310	0.9999	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8986
0.0419	0.8920	1315	1.0078	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8965
0.1078	0.8954	1320	1.0074	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8976
0.069	0.8988	1325	1.0178	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8973
0.0819	0.9022	1330	1.0323	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8963
0.0948	0.9055	1335	1.0334	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8968
0.0638	0.9089	1340	1.0373	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8968
0.0828	0.9123	1345	1.0293	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8950
0.1116	0.9157	1350	1.0227	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8958
0.1118	0.9191	1355	1.0211	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8963
0.0566	0.9225	1360	1.0156	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8963
0.0423	0.9259	1365	1.0092	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8968
0.0458	0.9293	1370	1.0144	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8965
0.0477	0.9327	1375	1.0141	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8963
0.0445	0.9361	1380	1.0063	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8973
0.0832	0.9395	1385	1.0045	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8955
0.0867	0.9429	1390	1.0006	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8976
0.0637	0.9462	1395	0.9924	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8986
0.057	0.9496	1400	0.9988	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8960
0.0872	0.9530	1405	0.9918	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8979
0.0681	0.9564	1410	0.9918	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8963
0.0909	0.9598	1415	0.9827	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8992
0.0958	0.9632	1420	0.9923	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8960
0.0512	0.9666	1425	0.9923	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8976
0.0615	0.9700	1430	0.9911	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8989
0.0474	0.9734	1435	0.9879	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.9015
0.1243	0.9768	1440	0.9905	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8965
0.0544	0.9802	1445	0.9879	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8984
0.1352	0.9836	1450	0.9876	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8963
0.0816	0.9869	1455	0.9863	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8976
0.0412	0.9903	1460	0.9944	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8981
0.1848	0.9937	1465	0.9926	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8992
0.0418	0.9971	1470	0.9864	0.8208	0.8137	1.0	0.1739	1.0	0.8973	0.2963	0.5870	0.8984

Framework versions

• PEFT 0.12.0
• Transformers 4.46.0
• Pytorch 2.4.0+cu118
• Datasets 3.0.0
• Tokenizers 0.20.1