ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k5_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8405
• Qwk: 0.3014
• Mse: 0.8405
• Rmse: 0.9168

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0833	2	4.0302	0.0024	4.0302	2.0075
No log	0.1667	4	2.5673	-0.0465	2.5673	1.6023
No log	0.25	6	2.0048	-0.0166	2.0048	1.4159
No log	0.3333	8	1.2302	0.2318	1.2302	1.1091
No log	0.4167	10	1.1511	0.2221	1.1511	1.0729
No log	0.5	12	1.1068	0.2441	1.1068	1.0521
No log	0.5833	14	1.0980	0.2049	1.0980	1.0479
No log	0.6667	16	1.1296	0.2049	1.1296	1.0628
No log	0.75	18	1.4621	0.0	1.4621	1.2092
No log	0.8333	20	1.7197	0.1241	1.7197	1.3114
No log	0.9167	22	1.4593	0.0	1.4593	1.2080
No log	1.0	24	1.3248	0.0116	1.3248	1.1510
No log	1.0833	26	1.1389	0.1685	1.1389	1.0672
No log	1.1667	28	1.0427	0.1218	1.0427	1.0211
No log	1.25	30	1.0517	0.1616	1.0517	1.0255
No log	1.3333	32	1.2508	0.0938	1.2508	1.1184
No log	1.4167	34	1.7008	0.0767	1.7008	1.3041
No log	1.5	36	2.1076	-0.0220	2.1076	1.4518
No log	1.5833	38	2.2414	-0.0086	2.2414	1.4971
No log	1.6667	40	2.0788	0.0247	2.0788	1.4418
No log	1.75	42	1.5445	0.0978	1.5445	1.2428
No log	1.8333	44	1.1552	0.0882	1.1552	1.0748
No log	1.9167	46	1.0852	0.1342	1.0852	1.0417
No log	2.0	48	1.1480	0.1453	1.1480	1.0715
No log	2.0833	50	1.3598	0.1814	1.3598	1.1661
No log	2.1667	52	1.5147	0.1322	1.5147	1.2307
No log	2.25	54	1.7910	0.1084	1.7910	1.3383
No log	2.3333	56	1.9299	0.0947	1.9299	1.3892
No log	2.4167	58	1.6687	0.1110	1.6687	1.2918
No log	2.5	60	1.4600	0.1138	1.4600	1.2083
No log	2.5833	62	1.2502	0.1142	1.2502	1.1181
No log	2.6667	64	1.1765	0.1591	1.1765	1.0847
No log	2.75	66	1.1721	0.1416	1.1721	1.0826
No log	2.8333	68	1.1165	0.2038	1.1165	1.0567
No log	2.9167	70	1.0968	0.1693	1.0968	1.0473
No log	3.0	72	1.1067	0.1818	1.1067	1.0520
No log	3.0833	74	1.1985	0.3421	1.1985	1.0948
No log	3.1667	76	1.2895	0.3056	1.2895	1.1356
No log	3.25	78	1.1446	0.3851	1.1446	1.0698
No log	3.3333	80	1.0530	0.1467	1.0530	1.0261
No log	3.4167	82	1.0599	0.2504	1.0599	1.0295
No log	3.5	84	1.0386	0.1481	1.0386	1.0191
No log	3.5833	86	1.1556	0.3106	1.1556	1.0750
No log	3.6667	88	1.4283	0.2411	1.4283	1.1951
No log	3.75	90	1.3870	0.2093	1.3870	1.1777
No log	3.8333	92	1.0843	0.0548	1.0843	1.0413
No log	3.9167	94	1.0684	0.2251	1.0684	1.0336
No log	4.0	96	1.0669	0.1935	1.0669	1.0329
No log	4.0833	98	1.1353	0.1549	1.1353	1.0655
No log	4.1667	100	1.5333	0.1315	1.5333	1.2383
No log	4.25	102	1.7475	0.1106	1.7475	1.3219
No log	4.3333	104	1.5528	0.2072	1.5528	1.2461
No log	4.4167	106	1.1926	0.2166	1.1926	1.0920
No log	4.5	108	1.1361	0.1825	1.1361	1.0659
No log	4.5833	110	1.2156	0.2606	1.2156	1.1025
No log	4.6667	112	1.2526	0.2934	1.2526	1.1192
No log	4.75	114	1.2323	0.3037	1.2323	1.1101
No log	4.8333	116	1.0701	0.2245	1.0701	1.0344
No log	4.9167	118	1.0487	0.2963	1.0487	1.0241
No log	5.0	120	1.1062	0.3468	1.1062	1.0517
No log	5.0833	122	1.1310	0.3831	1.1310	1.0635
No log	5.1667	124	1.0420	0.3013	1.0420	1.0208
No log	5.25	126	1.0203	0.2647	1.0203	1.0101
No log	5.3333	128	1.0120	0.1519	1.0120	1.0060
No log	5.4167	130	1.0256	0.1747	1.0256	1.0127
No log	5.5	132	1.0640	0.2140	1.0640	1.0315
No log	5.5833	134	1.0755	0.2140	1.0755	1.0371
No log	5.6667	136	1.1362	0.2973	1.1362	1.0659
No log	5.75	138	1.1914	0.3140	1.1914	1.0915
No log	5.8333	140	1.1159	0.2060	1.1159	1.0564
No log	5.9167	142	1.1029	0.1396	1.1029	1.0502
No log	6.0	144	1.2795	0.2989	1.2795	1.1311
No log	6.0833	146	1.5707	0.1616	1.5707	1.2533
No log	6.1667	148	1.4741	0.1715	1.4741	1.2141
No log	6.25	150	1.1377	0.2236	1.1377	1.0666
No log	6.3333	152	1.1467	0.2077	1.1467	1.0708
No log	6.4167	154	1.1470	0.2200	1.1470	1.0710
No log	6.5	156	1.0983	0.2200	1.0983	1.0480
No log	6.5833	158	1.0382	0.2744	1.0382	1.0189
No log	6.6667	160	1.0110	0.2351	1.0110	1.0055
No log	6.75	162	1.0037	0.2416	1.0037	1.0018
No log	6.8333	164	1.0070	0.2541	1.0070	1.0035
No log	6.9167	166	1.0096	0.2865	1.0096	1.0048
No log	7.0	168	1.0392	0.1627	1.0392	1.0194
No log	7.0833	170	1.1523	0.2079	1.1523	1.0734
No log	7.1667	172	1.1352	0.2191	1.1352	1.0655
No log	7.25	174	1.1232	0.2138	1.1232	1.0598
No log	7.3333	176	1.0613	0.2302	1.0613	1.0302
No log	7.4167	178	1.0507	0.2199	1.0507	1.0251
No log	7.5	180	1.1457	0.2375	1.1457	1.0704
No log	7.5833	182	1.3834	0.2545	1.3834	1.1762
No log	7.6667	184	1.4377	0.2513	1.4377	1.1990
No log	7.75	186	1.3204	0.25	1.3204	1.1491
No log	7.8333	188	1.1316	0.2457	1.1316	1.0638
No log	7.9167	190	1.0512	0.3294	1.0512	1.0253
No log	8.0	192	1.0703	0.2757	1.0703	1.0346
No log	8.0833	194	1.1301	0.2371	1.1301	1.0631
No log	8.1667	196	1.0879	0.2496	1.0879	1.0430
No log	8.25	198	1.0561	0.2325	1.0561	1.0277
No log	8.3333	200	1.0553	0.1667	1.0553	1.0273
No log	8.4167	202	1.0661	0.2229	1.0661	1.0325
No log	8.5	204	1.0764	0.2325	1.0764	1.0375
No log	8.5833	206	1.1663	0.2690	1.1663	1.0800
No log	8.6667	208	1.1087	0.2953	1.1087	1.0530
No log	8.75	210	1.0589	0.2900	1.0589	1.0290
No log	8.8333	212	1.1456	0.2487	1.1456	1.0703
No log	8.9167	214	1.1125	0.2192	1.1125	1.0548
No log	9.0	216	1.0619	0.1885	1.0619	1.0305
No log	9.0833	218	1.0483	0.2028	1.0483	1.0239
No log	9.1667	220	1.0440	0.2763	1.0440	1.0218
No log	9.25	222	1.0517	0.2784	1.0517	1.0255
No log	9.3333	224	1.0888	0.2857	1.0888	1.0435
No log	9.4167	226	1.2355	0.3601	1.2355	1.1115
No log	9.5	228	1.1561	0.3881	1.1561	1.0752
No log	9.5833	230	1.0054	0.3313	1.0054	1.0027
No log	9.6667	232	1.0943	0.4159	1.0943	1.0461
No log	9.75	234	1.1531	0.3409	1.1531	1.0738
No log	9.8333	236	1.0849	0.4148	1.0849	1.0416
No log	9.9167	238	1.0003	0.3008	1.0003	1.0001
No log	10.0	240	1.1684	0.3606	1.1684	1.0809
No log	10.0833	242	1.3295	0.3169	1.3295	1.1530
No log	10.1667	244	1.2663	0.3375	1.2663	1.1253
No log	10.25	246	1.0938	0.2934	1.0938	1.0459
No log	10.3333	248	1.0012	0.2385	1.0012	1.0006
No log	10.4167	250	1.0099	0.3011	1.0099	1.0050
No log	10.5	252	1.0078	0.2619	1.0078	1.0039
No log	10.5833	254	0.9927	0.2013	0.9927	0.9964
No log	10.6667	256	0.9940	0.2880	0.9940	0.9970
No log	10.75	258	1.0281	0.2822	1.0281	1.0140
No log	10.8333	260	1.0182	0.2822	1.0182	1.0091
No log	10.9167	262	0.9849	0.2164	0.9849	0.9924
No log	11.0	264	1.0137	0.4136	1.0137	1.0068
No log	11.0833	266	1.0290	0.3990	1.0290	1.0144
No log	11.1667	268	0.9886	0.1747	0.9886	0.9943
No log	11.25	270	1.0441	0.2759	1.0441	1.0218
No log	11.3333	272	1.0740	0.2223	1.0740	1.0364
No log	11.4167	274	1.0972	0.1993	1.0972	1.0475
No log	11.5	276	1.0426	0.1869	1.0426	1.0211
No log	11.5833	278	1.0298	0.1844	1.0298	1.0148
No log	11.6667	280	1.0477	0.1507	1.0477	1.0236
No log	11.75	282	1.0855	0.1121	1.0855	1.0419
No log	11.8333	284	1.1646	0.2534	1.1646	1.0792
No log	11.9167	286	1.1300	0.1521	1.1300	1.0630
No log	12.0	288	1.0639	0.2023	1.0639	1.0314
No log	12.0833	290	1.0731	0.2023	1.0731	1.0359
No log	12.1667	292	1.1999	0.3089	1.1999	1.0954
No log	12.25	294	1.2417	0.2851	1.2417	1.1143
No log	12.3333	296	1.1275	0.1557	1.1275	1.0618
No log	12.4167	298	1.0745	0.2325	1.0745	1.0366
No log	12.5	300	1.0744	0.2127	1.0744	1.0365
No log	12.5833	302	1.0833	0.2010	1.0833	1.0408
No log	12.6667	304	1.1554	0.2324	1.1554	1.0749
No log	12.75	306	1.2882	0.3025	1.2882	1.1350
No log	12.8333	308	1.2841	0.2944	1.2841	1.1332
No log	12.9167	310	1.1779	0.2896	1.1779	1.0853
No log	13.0	312	1.1241	0.2864	1.1241	1.0602
No log	13.0833	314	1.1668	0.2792	1.1668	1.0802
No log	13.1667	316	1.2001	0.2304	1.2001	1.0955
No log	13.25	318	1.1182	0.2755	1.1182	1.0575
No log	13.3333	320	1.0376	0.1732	1.0376	1.0186
No log	13.4167	322	1.0506	0.2084	1.0506	1.0250
No log	13.5	324	1.1203	0.2617	1.1203	1.0584
No log	13.5833	326	1.2149	0.2410	1.2149	1.1022
No log	13.6667	328	1.3160	0.2490	1.3160	1.1472
No log	13.75	330	1.2776	0.2845	1.2776	1.1303
No log	13.8333	332	1.2164	0.3336	1.2164	1.1029
No log	13.9167	334	1.1498	0.2650	1.1498	1.0723
No log	14.0	336	1.1355	0.2650	1.1355	1.0656
No log	14.0833	338	1.1231	0.2491	1.1231	1.0598
No log	14.1667	340	1.1618	0.2611	1.1618	1.0779
No log	14.25	342	1.0970	0.2431	1.0970	1.0474
No log	14.3333	344	1.0931	0.2712	1.0931	1.0455
No log	14.4167	346	1.1198	0.2327	1.1198	1.0582
No log	14.5	348	1.0619	0.2755	1.0619	1.0305
No log	14.5833	350	1.0977	0.2271	1.0977	1.0477
No log	14.6667	352	1.1945	0.1880	1.1945	1.0929
No log	14.75	354	1.2802	0.2222	1.2802	1.1314
No log	14.8333	356	1.1806	0.2075	1.1806	1.0865
No log	14.9167	358	1.0244	0.2621	1.0244	1.0121
No log	15.0	360	1.0155	0.3596	1.0155	1.0077
No log	15.0833	362	1.0561	0.2864	1.0561	1.0277
No log	15.1667	364	1.1424	0.2693	1.1424	1.0688
No log	15.25	366	1.1558	0.2813	1.1558	1.0751
No log	15.3333	368	1.1305	0.2424	1.1305	1.0632
No log	15.4167	370	1.0378	0.2620	1.0378	1.0187
No log	15.5	372	1.0128	0.2479	1.0128	1.0064
No log	15.5833	374	1.0030	0.2028	1.0030	1.0015
No log	15.6667	376	0.9983	0.2479	0.9983	0.9991
No log	15.75	378	1.0235	0.2503	1.0235	1.0117
No log	15.8333	380	1.0821	0.1671	1.0821	1.0402
No log	15.9167	382	1.2152	0.3195	1.2152	1.1024
No log	16.0	384	1.2692	0.3111	1.2692	1.1266
No log	16.0833	386	1.1311	0.2777	1.1311	1.0635
No log	16.1667	388	1.0055	0.1637	1.0055	1.0028
No log	16.25	390	0.9885	0.2744	0.9885	0.9942
No log	16.3333	392	1.0080	0.3306	1.0080	1.0040
No log	16.4167	394	0.9943	0.2619	0.9943	0.9972
No log	16.5	396	1.0634	0.2507	1.0634	1.0312
No log	16.5833	398	1.1831	0.3298	1.1831	1.0877
No log	16.6667	400	1.1823	0.3208	1.1823	1.0873
No log	16.75	402	1.0886	0.2424	1.0886	1.0433
No log	16.8333	404	1.0372	0.2647	1.0372	1.0184
No log	16.9167	406	1.0369	0.3465	1.0369	1.0183
No log	17.0	408	1.0403	0.2857	1.0403	1.0199
No log	17.0833	410	1.0402	0.2574	1.0402	1.0199
No log	17.1667	412	1.0645	0.1822	1.0645	1.0317
No log	17.25	414	1.1271	0.2800	1.1271	1.0616
No log	17.3333	416	1.1590	0.1991	1.1590	1.0766
No log	17.4167	418	1.1129	0.1991	1.1129	1.0549
No log	17.5	420	1.0096	0.1588	1.0096	1.0048
No log	17.5833	422	0.9534	0.2888	0.9534	0.9764
No log	17.6667	424	0.9450	0.3280	0.9450	0.9721
No log	17.75	426	0.9366	0.3280	0.9366	0.9678
No log	17.8333	428	0.9338	0.2765	0.9338	0.9663
No log	17.9167	430	0.9525	0.2268	0.9525	0.9759
No log	18.0	432	0.9722	0.2465	0.9722	0.9860
No log	18.0833	434	0.9561	0.2208	0.9561	0.9778
No log	18.1667	436	0.9388	0.2978	0.9388	0.9689
No log	18.25	438	0.9397	0.3041	0.9397	0.9694
No log	18.3333	440	0.9619	0.2468	0.9619	0.9808
No log	18.4167	442	0.9735	0.2490	0.9735	0.9867
No log	18.5	444	0.9435	0.2973	0.9435	0.9713
No log	18.5833	446	0.9336	0.4186	0.9336	0.9662
No log	18.6667	448	0.9214	0.3781	0.9214	0.9599
No log	18.75	450	0.9251	0.4012	0.9251	0.9618
No log	18.8333	452	0.9296	0.3215	0.9296	0.9642
No log	18.9167	454	0.9403	0.3056	0.9403	0.9697
No log	19.0	456	0.9672	0.2145	0.9672	0.9835
No log	19.0833	458	0.9954	0.2138	0.9954	0.9977
No log	19.1667	460	0.9991	0.2455	0.9991	0.9996
No log	19.25	462	0.9606	0.2496	0.9606	0.9801
No log	19.3333	464	0.9380	0.2736	0.9380	0.9685
No log	19.4167	466	0.9244	0.2713	0.9244	0.9614
No log	19.5	468	0.9507	0.2049	0.9507	0.9750
No log	19.5833	470	1.0218	0.2306	1.0218	1.0109
No log	19.6667	472	1.0335	0.2306	1.0335	1.0166
No log	19.75	474	1.0099	0.2306	1.0099	1.0049
No log	19.8333	476	1.0053	0.2306	1.0053	1.0027
No log	19.9167	478	0.9413	0.1995	0.9413	0.9702
No log	20.0	480	0.9133	0.2616	0.9133	0.9557
No log	20.0833	482	0.9126	0.2293	0.9126	0.9553
No log	20.1667	484	0.9309	0.2138	0.9309	0.9648
No log	20.25	486	0.9685	0.2424	0.9685	0.9841
No log	20.3333	488	1.0050	0.3031	1.0050	1.0025
No log	20.4167	490	0.9651	0.3147	0.9651	0.9824
No log	20.5	492	0.8943	0.2902	0.8943	0.9457
No log	20.5833	494	0.8417	0.3310	0.8417	0.9174
No log	20.6667	496	0.8427	0.2619	0.8427	0.9180
No log	20.75	498	0.8539	0.3528	0.8539	0.9241
0.3033	20.8333	500	0.8379	0.4234	0.8379	0.9154
0.3033	20.9167	502	0.8353	0.3184	0.8353	0.9139
0.3033	21.0	504	0.9513	0.3088	0.9513	0.9753
0.3033	21.0833	506	1.0235	0.2590	1.0235	1.0117
0.3033	21.1667	508	0.9363	0.3088	0.9363	0.9676
0.3033	21.25	510	0.8405	0.3014	0.8405	0.9168

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1