ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run2_AugV5_k12_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5046
• Qwk: 0.3609
• Mse: 0.5046
• Rmse: 0.7103

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	3.3007	-0.0248	3.3007	1.8168
No log	0.0645	4	1.6553	-0.0101	1.6553	1.2866
No log	0.0968	6	1.2277	0.0325	1.2277	1.1080
No log	0.1290	8	1.2220	0.0888	1.2220	1.1054
No log	0.1613	10	0.8548	0.1718	0.8548	0.9245
No log	0.1935	12	0.5863	0.0569	0.5863	0.7657
No log	0.2258	14	0.5982	0.0569	0.5982	0.7734
No log	0.2581	16	0.5318	0.1407	0.5318	0.7293
No log	0.2903	18	1.1174	0.1587	1.1174	1.0571
No log	0.3226	20	1.0026	0.1128	1.0026	1.0013
No log	0.3548	22	0.5712	0.2908	0.5712	0.7558
No log	0.3871	24	0.5228	0.0569	0.5228	0.7230
No log	0.4194	26	0.5275	0.2340	0.5275	0.7263
No log	0.4516	28	0.9295	0.2286	0.9295	0.9641
No log	0.4839	30	0.6825	0.2917	0.6825	0.8261
No log	0.5161	32	0.5218	0.1407	0.5218	0.7223
No log	0.5484	34	0.5712	0.1884	0.5712	0.7558
No log	0.5806	36	0.5599	0.2448	0.5599	0.7483
No log	0.6129	38	0.6040	0.2381	0.6040	0.7772
No log	0.6452	40	0.9162	0.1453	0.9162	0.9572
No log	0.6774	42	0.6696	0.2787	0.6696	0.8183
No log	0.7097	44	0.5684	0.3757	0.5684	0.7539
No log	0.7419	46	0.5316	0.2558	0.5316	0.7291
No log	0.7742	48	0.7046	0.2793	0.7046	0.8394
No log	0.8065	50	0.9523	0.2184	0.9523	0.9758
No log	0.8387	52	0.5571	0.4059	0.5571	0.7464
No log	0.8710	54	0.7281	0.3303	0.7281	0.8533
No log	0.9032	56	0.5473	0.2527	0.5473	0.7398
No log	0.9355	58	0.5751	0.3769	0.5751	0.7584
No log	0.9677	60	0.6035	0.3077	0.6035	0.7769
No log	1.0	62	0.5221	0.3369	0.5221	0.7225
No log	1.0323	64	0.5864	0.2965	0.5864	0.7658
No log	1.0645	66	1.1386	0.1628	1.1386	1.0671
No log	1.0968	68	1.1130	0.1628	1.1130	1.0550
No log	1.1290	70	0.5974	0.3200	0.5974	0.7729
No log	1.1613	72	0.7633	0.3251	0.7633	0.8736
No log	1.1935	74	0.5570	0.3299	0.5570	0.7463
No log	1.2258	76	0.8006	0.2523	0.8006	0.8947
No log	1.2581	78	0.5783	0.2865	0.5783	0.7604
No log	1.2903	80	0.5241	0.2821	0.5241	0.7240
No log	1.3226	82	0.6110	0.3591	0.6110	0.7817
No log	1.3548	84	0.5357	0.2208	0.5357	0.7319
No log	1.3871	86	0.7378	0.2897	0.7378	0.8589
No log	1.4194	88	0.6355	0.2179	0.6355	0.7972
No log	1.4516	90	0.5319	0.2298	0.5319	0.7293
No log	1.4839	92	0.5406	0.2381	0.5406	0.7353
No log	1.5161	94	0.8256	0.3968	0.8256	0.9086
No log	1.5484	96	1.3923	0.1724	1.3923	1.1800
No log	1.5806	98	1.0204	0.3131	1.0204	1.0101
No log	1.6129	100	1.1294	0.3025	1.1294	1.0627
No log	1.6452	102	0.7353	0.2857	0.7353	0.8575
No log	1.6774	104	0.6165	0.2780	0.6165	0.7852
No log	1.7097	106	0.7473	0.2941	0.7473	0.8645
No log	1.7419	108	0.5675	0.2990	0.5675	0.7534
No log	1.7742	110	0.5050	0.3778	0.5050	0.7106
No log	1.8065	112	0.7105	0.2963	0.7105	0.8429
No log	1.8387	114	1.3922	0.1688	1.3922	1.1799
No log	1.8710	116	1.0471	0.2727	1.0471	1.0233
No log	1.9032	118	0.5303	0.3617	0.5303	0.7283
No log	1.9355	120	0.7738	0.3388	0.7738	0.8797
No log	1.9677	122	0.5801	0.4019	0.5801	0.7617
No log	2.0	124	0.7647	0.2489	0.7647	0.8745
No log	2.0323	126	1.1902	0.1837	1.1902	1.0909
No log	2.0645	128	1.0117	0.1773	1.0117	1.0058
No log	2.0968	130	0.5542	0.3730	0.5542	0.7445
No log	2.1290	132	0.5737	0.3369	0.5737	0.7574
No log	2.1613	134	0.5779	0.3010	0.5779	0.7602
No log	2.1935	136	0.6184	0.2893	0.6184	0.7864
No log	2.2258	138	1.1568	0.2000	1.1568	1.0756
No log	2.2581	140	0.9414	0.1765	0.9414	0.9702
No log	2.2903	142	0.7487	0.2743	0.7487	0.8653
No log	2.3226	144	0.5199	0.4902	0.5199	0.7210
No log	2.3548	146	0.5559	0.4286	0.5559	0.7456
No log	2.3871	148	0.8906	0.1875	0.8906	0.9437
No log	2.4194	150	0.7458	0.1925	0.7458	0.8636
No log	2.4516	152	0.5174	0.4227	0.5174	0.7193
No log	2.4839	154	0.5540	0.3161	0.5540	0.7443
No log	2.5161	156	0.5554	0.3297	0.5554	0.7453
No log	2.5484	158	0.7188	0.1919	0.7188	0.8478
No log	2.5806	160	0.7792	0.2941	0.7792	0.8827
No log	2.6129	162	0.6578	0.1841	0.6578	0.8111
No log	2.6452	164	0.5364	0.3862	0.5364	0.7324
No log	2.6774	166	0.7186	0.3271	0.7186	0.8477
No log	2.7097	168	0.6054	0.3200	0.6054	0.7781
No log	2.7419	170	0.7234	0.3527	0.7234	0.8505
No log	2.7742	172	1.1308	0.1587	1.1308	1.0634
No log	2.8065	174	0.9257	0.1877	0.9257	0.9621
No log	2.8387	176	0.6291	0.2917	0.6291	0.7932
No log	2.8710	178	0.5771	0.4105	0.5771	0.7597
No log	2.9032	180	0.7165	0.1600	0.7165	0.8465
No log	2.9355	182	0.7304	0.2372	0.7304	0.8547
No log	2.9677	184	0.7341	0.2000	0.7341	0.8568
No log	3.0	186	0.5440	0.4536	0.5440	0.7375
No log	3.0323	188	0.5871	0.3990	0.5871	0.7662
No log	3.0645	190	0.6267	0.4286	0.6267	0.7916
No log	3.0968	192	0.9186	0.2464	0.9186	0.9584
No log	3.1290	194	1.1907	0.1678	1.1907	1.0912
No log	3.1613	196	0.9801	0.1886	0.9801	0.9900
No log	3.1935	198	0.6274	0.3488	0.6274	0.7921
No log	3.2258	200	0.5136	0.4973	0.5136	0.7167
No log	3.2581	202	0.7168	0.2961	0.7168	0.8467
No log	3.2903	204	0.9434	0.2226	0.9434	0.9713
No log	3.3226	206	0.7759	0.2868	0.7759	0.8808
No log	3.3548	208	0.5383	0.4725	0.5383	0.7337
No log	3.3871	210	0.4898	0.4894	0.4898	0.6998
No log	3.4194	212	0.5760	0.3814	0.5760	0.7589
No log	3.4516	214	0.8501	0.3134	0.8501	0.9220
No log	3.4839	216	0.9583	0.2432	0.9583	0.9789
No log	3.5161	218	0.7149	0.4016	0.7149	0.8455
No log	3.5484	220	0.4017	0.4583	0.4017	0.6338
No log	3.5806	222	0.3694	0.5319	0.3694	0.6078
No log	3.6129	224	0.4519	0.4902	0.4519	0.6723
No log	3.6452	226	0.7669	0.3202	0.7669	0.8757
No log	3.6774	228	0.8863	0.2615	0.8863	0.9414
No log	3.7097	230	0.5605	0.3498	0.5605	0.7487
No log	3.7419	232	0.3950	0.5464	0.3950	0.6285
No log	3.7742	234	0.4007	0.5464	0.4007	0.6330
No log	3.8065	236	0.5396	0.3878	0.5396	0.7346
No log	3.8387	238	0.6022	0.3028	0.6022	0.7760
No log	3.8710	240	0.7201	0.2681	0.7201	0.8486
No log	3.9032	242	0.6512	0.3091	0.6512	0.8070
No log	3.9355	244	0.4230	0.4424	0.4230	0.6504
No log	3.9677	246	0.4599	0.4545	0.4599	0.6782
No log	4.0	248	0.4462	0.4682	0.4462	0.6680
No log	4.0323	250	0.4594	0.3659	0.4594	0.6778
No log	4.0645	252	0.5960	0.3191	0.5960	0.7720
No log	4.0968	254	0.5332	0.2360	0.5332	0.7302
No log	4.1290	256	0.4659	0.3898	0.4659	0.6826
No log	4.1613	258	0.4693	0.4222	0.4693	0.6851
No log	4.1935	260	0.4232	0.5307	0.4232	0.6505
No log	4.2258	262	0.4380	0.4409	0.4380	0.6618
No log	4.2581	264	0.5234	0.3118	0.5234	0.7235
No log	4.2903	266	0.4720	0.375	0.4720	0.6870
No log	4.3226	268	0.4286	0.5960	0.4286	0.6547
No log	4.3548	270	0.4676	0.4667	0.4676	0.6838
No log	4.3871	272	0.4094	0.5699	0.4094	0.6399
No log	4.4194	274	0.4034	0.4860	0.4034	0.6351
No log	4.4516	276	0.4686	0.2990	0.4686	0.6845
No log	4.4839	278	0.4766	0.2670	0.4766	0.6904
No log	4.5161	280	0.5078	0.2421	0.5078	0.7126
No log	4.5484	282	0.4943	0.2332	0.4943	0.7030
No log	4.5806	284	0.5028	0.3258	0.5028	0.7091
No log	4.6129	286	0.4283	0.3684	0.4283	0.6544
No log	4.6452	288	0.4544	0.5132	0.4544	0.6741
No log	4.6774	290	0.4294	0.4667	0.4294	0.6553
No log	4.7097	292	0.5857	0.2766	0.5857	0.7653
No log	4.7419	294	0.6896	0.3427	0.6896	0.8304
No log	4.7742	296	0.5176	0.2727	0.5176	0.7195
No log	4.8065	298	0.4589	0.3953	0.4589	0.6774
No log	4.8387	300	0.4995	0.3043	0.4995	0.7067
No log	4.8710	302	0.5699	0.2670	0.5699	0.7549
No log	4.9032	304	0.4867	0.3609	0.4867	0.6976
No log	4.9355	306	0.4207	0.5122	0.4207	0.6486
No log	4.9677	308	0.4183	0.4783	0.4183	0.6468
No log	5.0	310	0.4122	0.4430	0.4122	0.6420
No log	5.0323	312	0.4322	0.3580	0.4322	0.6574
No log	5.0645	314	0.5214	0.3333	0.5214	0.7221
No log	5.0968	316	0.5589	0.2000	0.5589	0.7476
No log	5.1290	318	0.4691	0.3292	0.4691	0.6849
No log	5.1613	320	0.4391	0.4682	0.4391	0.6626
No log	5.1935	322	0.4638	0.3533	0.4638	0.6810
No log	5.2258	324	0.4504	0.4682	0.4504	0.6711
No log	5.2581	326	0.4814	0.3023	0.4814	0.6938
No log	5.2903	328	0.5794	0.2670	0.5794	0.7612
No log	5.3226	330	0.5658	0.2670	0.5658	0.7522
No log	5.3548	332	0.6656	0.2308	0.6656	0.8158
No log	5.3871	334	0.6867	0.2300	0.6867	0.8287
No log	5.4194	336	0.5873	0.1837	0.5873	0.7664
No log	5.4516	338	0.5432	0.2749	0.5432	0.7370
No log	5.4839	340	0.5081	0.5	0.5081	0.7128
No log	5.5161	342	0.5888	0.2688	0.5888	0.7673
No log	5.5484	344	0.7149	0.2941	0.7149	0.8455
No log	5.5806	346	0.6271	0.3143	0.6271	0.7919
No log	5.6129	348	0.5764	0.3462	0.5764	0.7592
No log	5.6452	350	0.5363	0.4468	0.5363	0.7323
No log	5.6774	352	0.4924	0.5307	0.4924	0.7017
No log	5.7097	354	0.5470	0.3043	0.5470	0.7396
No log	5.7419	356	0.6110	0.2621	0.6110	0.7817
No log	5.7742	358	0.6418	0.25	0.6418	0.8011
No log	5.8065	360	0.5126	0.3661	0.5126	0.7160
No log	5.8387	362	0.4923	0.3757	0.4923	0.7016
No log	5.8710	364	0.5783	0.2251	0.5783	0.7605
No log	5.9032	366	0.7153	0.2661	0.7153	0.8458
No log	5.9355	368	0.6303	0.1503	0.6303	0.7939
No log	5.9677	370	0.4928	0.3171	0.4928	0.7020
No log	6.0	372	0.4390	0.5814	0.4390	0.6626
No log	6.0323	374	0.4394	0.5814	0.4394	0.6629
No log	6.0645	376	0.5030	0.3103	0.5030	0.7092
No log	6.0968	378	0.5784	0.2251	0.5784	0.7605
No log	6.1290	380	0.5147	0.2593	0.5147	0.7174
No log	6.1613	382	0.5107	0.2593	0.5107	0.7146
No log	6.1935	384	0.5539	0.2251	0.5539	0.7442
No log	6.2258	386	0.5966	0.2549	0.5966	0.7724
No log	6.2581	388	0.5657	0.2251	0.5657	0.7522
No log	6.2903	390	0.4862	0.3333	0.4862	0.6973
No log	6.3226	392	0.4592	0.5706	0.4592	0.6777
No log	6.3548	394	0.4698	0.3757	0.4698	0.6854
No log	6.3871	396	0.5874	0.2549	0.5874	0.7664
No log	6.4194	398	0.6472	0.25	0.6472	0.8045
No log	6.4516	400	0.6967	0.2566	0.6967	0.8347
No log	6.4839	402	0.5865	0.1832	0.5865	0.7658
No log	6.5161	404	0.5009	0.3224	0.5009	0.7077
No log	6.5484	406	0.4556	0.5165	0.4556	0.6750
No log	6.5806	408	0.4499	0.5706	0.4499	0.6708
No log	6.6129	410	0.4591	0.5165	0.4591	0.6776
No log	6.6452	412	0.5042	0.4286	0.5042	0.7101
No log	6.6774	414	0.5502	0.3407	0.5502	0.7418
No log	6.7097	416	0.6316	0.2233	0.6316	0.7947
No log	6.7419	418	0.8099	0.2993	0.8099	0.9000
No log	6.7742	420	0.7917	0.2797	0.7917	0.8898
No log	6.8065	422	0.6687	0.2711	0.6687	0.8177
No log	6.8387	424	0.6289	0.2711	0.6289	0.7931
No log	6.8710	426	0.5284	0.4475	0.5284	0.7269
No log	6.9032	428	0.5103	0.4783	0.5103	0.7144
No log	6.9355	430	0.5558	0.2842	0.5558	0.7455
No log	6.9677	432	0.6559	0.1527	0.6559	0.8099
No log	7.0	434	0.6442	0.1515	0.6442	0.8026
No log	7.0323	436	0.5673	0.2381	0.5673	0.7532
No log	7.0645	438	0.5422	0.3103	0.5422	0.7363
No log	7.0968	440	0.5014	0.3659	0.5014	0.7081
No log	7.1290	442	0.4735	0.5088	0.4735	0.6881
No log	7.1613	444	0.4740	0.5088	0.4740	0.6885
No log	7.1935	446	0.5118	0.3446	0.5118	0.7154
No log	7.2258	448	0.6029	0.2670	0.6029	0.7765
No log	7.2581	450	0.5940	0.2688	0.5940	0.7707
No log	7.2903	452	0.5836	0.3016	0.5836	0.7639
No log	7.3226	454	0.5062	0.3609	0.5062	0.7115
No log	7.3548	456	0.4687	0.5088	0.4687	0.6846
No log	7.3871	458	0.4573	0.5706	0.4573	0.6762
No log	7.4194	460	0.4604	0.5706	0.4604	0.6785
No log	7.4516	462	0.4946	0.4222	0.4946	0.7033
No log	7.4839	464	0.5371	0.2609	0.5371	0.7329
No log	7.5161	466	0.5697	0.2549	0.5697	0.7548
No log	7.5484	468	0.5469	0.3299	0.5469	0.7395
No log	7.5806	470	0.5029	0.4227	0.5029	0.7091
No log	7.6129	472	0.5118	0.4227	0.5118	0.7154
No log	7.6452	474	0.5544	0.2563	0.5544	0.7445
No log	7.6774	476	0.5627	0.2563	0.5627	0.7501
No log	7.7097	478	0.6050	0.2227	0.6050	0.7778
No log	7.7419	480	0.5701	0.2621	0.5701	0.7550
No log	7.7742	482	0.5362	0.2258	0.5362	0.7322
No log	7.8065	484	0.4696	0.4682	0.4696	0.6852
No log	7.8387	486	0.4312	0.5706	0.4312	0.6567
No log	7.8710	488	0.4287	0.5706	0.4287	0.6547
No log	7.9032	490	0.4401	0.5706	0.4401	0.6634
No log	7.9355	492	0.4691	0.4824	0.4691	0.6849
No log	7.9677	494	0.4935	0.3073	0.4935	0.7025
No log	8.0	496	0.4936	0.3216	0.4936	0.7026
No log	8.0323	498	0.4677	0.4824	0.4677	0.6839
0.3794	8.0645	500	0.4602	0.5145	0.4602	0.6784
0.3794	8.0968	502	0.4813	0.4419	0.4813	0.6937
0.3794	8.1290	504	0.5044	0.2727	0.5044	0.7102
0.3794	8.1613	506	0.5244	0.2707	0.5244	0.7241
0.3794	8.1935	508	0.5144	0.2727	0.5144	0.7172
0.3794	8.2258	510	0.5122	0.2727	0.5122	0.7157
0.3794	8.2581	512	0.4993	0.3103	0.4993	0.7066
0.3794	8.2903	514	0.4770	0.5556	0.4770	0.6907
0.3794	8.3226	516	0.4753	0.5556	0.4753	0.6894
0.3794	8.3548	518	0.4892	0.4607	0.4892	0.6994
0.3794	8.3871	520	0.5167	0.2749	0.5167	0.7188
0.3794	8.4194	522	0.5254	0.2727	0.5254	0.7248
0.3794	8.4516	524	0.5280	0.2265	0.5280	0.7266
0.3794	8.4839	526	0.5145	0.2749	0.5145	0.7173
0.3794	8.5161	528	0.5070	0.2771	0.5070	0.7120
0.3794	8.5484	530	0.5180	0.2771	0.5180	0.7197
0.3794	8.5806	532	0.5257	0.2749	0.5257	0.7251
0.3794	8.6129	534	0.5565	0.2258	0.5565	0.7460
0.3794	8.6452	536	0.5806	0.2637	0.5806	0.7620
0.3794	8.6774	538	0.5749	0.2245	0.5749	0.7582
0.3794	8.7097	540	0.5383	0.2707	0.5383	0.7337
0.3794	8.7419	542	0.5033	0.4607	0.5033	0.7094
0.3794	8.7742	544	0.4854	0.5402	0.4854	0.6967
0.3794	8.8065	546	0.4816	0.5111	0.4816	0.6940
0.3794	8.8387	548	0.4827	0.4973	0.4827	0.6948
0.3794	8.8710	550	0.4855	0.5254	0.4855	0.6968
0.3794	8.9032	552	0.4989	0.5307	0.4989	0.7063
0.3794	8.9355	554	0.5347	0.2727	0.5347	0.7312
0.3794	8.9677	556	0.5748	0.3089	0.5748	0.7582
0.3794	9.0	558	0.5991	0.2607	0.5991	0.7740
0.3794	9.0323	560	0.6029	0.2709	0.6029	0.7764
0.3794	9.0645	562	0.5736	0.3089	0.5736	0.7573
0.3794	9.0968	564	0.5392	0.2727	0.5392	0.7343
0.3794	9.1290	566	0.5057	0.4491	0.5057	0.7112
0.3794	9.1613	568	0.4926	0.5145	0.4926	0.7019
0.3794	9.1935	570	0.4888	0.5145	0.4888	0.6992
0.3794	9.2258	572	0.4932	0.5145	0.4932	0.7023
0.3794	9.2581	574	0.5043	0.4491	0.5043	0.7101
0.3794	9.2903	576	0.5126	0.3609	0.5126	0.7159
0.3794	9.3226	578	0.5268	0.3073	0.5268	0.7258
0.3794	9.3548	580	0.5338	0.2707	0.5338	0.7306
0.3794	9.3871	582	0.5326	0.2707	0.5326	0.7298
0.3794	9.4194	584	0.5350	0.2707	0.5350	0.7315
0.3794	9.4516	586	0.5227	0.3073	0.5227	0.7230
0.3794	9.4839	588	0.5097	0.4350	0.5097	0.7139
0.3794	9.5161	590	0.4940	0.5145	0.4940	0.7029
0.3794	9.5484	592	0.4832	0.5307	0.4832	0.6951
0.3794	9.5806	594	0.4758	0.5307	0.4758	0.6898
0.3794	9.6129	596	0.4703	0.5402	0.4703	0.6858
0.3794	9.6452	598	0.4696	0.5402	0.4696	0.6853
0.3794	9.6774	600	0.4725	0.5402	0.4725	0.6874
0.3794	9.7097	602	0.4754	0.5307	0.4754	0.6895
0.3794	9.7419	604	0.4800	0.5307	0.4800	0.6928
0.3794	9.7742	606	0.4853	0.5	0.4853	0.6967
0.3794	9.8065	608	0.4907	0.5	0.4907	0.7005
0.3794	9.8387	610	0.4932	0.5145	0.4932	0.7022
0.3794	9.8710	612	0.4945	0.4491	0.4945	0.7032
0.3794	9.9032	614	0.4975	0.4491	0.4975	0.7053
0.3794	9.9355	616	0.5008	0.4491	0.5008	0.7077
0.3794	9.9677	618	0.5034	0.4419	0.5034	0.7095
0.3794	10.0	620	0.5046	0.3609	0.5046	0.7103

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1