ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k20_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0758
• Qwk: 0.3205
• Mse: 1.0758
• Rmse: 1.0372

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0198	2	4.6598	0.0010	4.6598	2.1587
No log	0.0396	4	2.6309	-0.0429	2.6309	1.6220
No log	0.0594	6	1.7708	0.0062	1.7708	1.3307
No log	0.0792	8	1.4543	-0.0524	1.4543	1.2060
No log	0.0990	10	1.6013	-0.0606	1.6013	1.2654
No log	0.1188	12	1.3833	0.0506	1.3833	1.1761
No log	0.1386	14	1.4436	0.0165	1.4436	1.2015
No log	0.1584	16	1.7218	0.0227	1.7218	1.3122
No log	0.1782	18	1.7933	-0.0149	1.7933	1.3391
No log	0.1980	20	1.5922	0.0104	1.5922	1.2618
No log	0.2178	22	1.3960	0.1076	1.3960	1.1815
No log	0.2376	24	1.4294	0.0613	1.4294	1.1956
No log	0.2574	26	1.8323	-0.0114	1.8323	1.3536
No log	0.2772	28	1.9884	-0.0208	1.9884	1.4101
No log	0.2970	30	2.0218	0.0056	2.0218	1.4219
No log	0.3168	32	1.8204	0.0099	1.8204	1.3492
No log	0.3366	34	1.3949	0.1658	1.3949	1.1811
No log	0.3564	36	1.2536	0.1848	1.2536	1.1197
No log	0.3762	38	1.2339	0.1696	1.2339	1.1108
No log	0.3960	40	1.4084	0.1809	1.4084	1.1868
No log	0.4158	42	1.7883	0.0104	1.7883	1.3373
No log	0.4356	44	2.3040	0.0426	2.3040	1.5179
No log	0.4554	46	2.1242	0.0614	2.1242	1.4574
No log	0.4752	48	1.6609	0.0254	1.6609	1.2888
No log	0.4950	50	1.3600	0.0625	1.3600	1.1662
No log	0.5149	52	1.2587	0.1472	1.2587	1.1219
No log	0.5347	54	1.2357	0.1753	1.2357	1.1116
No log	0.5545	56	1.2336	0.1753	1.2336	1.1107
No log	0.5743	58	1.3156	0.1472	1.3156	1.1470
No log	0.5941	60	1.6001	-0.0143	1.6001	1.2650
No log	0.6139	62	1.9968	0.0877	1.9968	1.4131
No log	0.6337	64	1.9142	0.0946	1.9142	1.3835
No log	0.6535	66	1.4574	0.1340	1.4574	1.2072
No log	0.6733	68	1.3180	0.1865	1.3180	1.1481
No log	0.6931	70	1.4286	0.0362	1.4286	1.1952
No log	0.7129	72	1.4339	0.0362	1.4339	1.1974
No log	0.7327	74	1.3017	0.2014	1.3017	1.1409
No log	0.7525	76	1.1332	0.2040	1.1332	1.0645
No log	0.7723	78	1.0683	0.3629	1.0683	1.0336
No log	0.7921	80	1.0727	0.3508	1.0727	1.0357
No log	0.8119	82	1.0701	0.3408	1.0701	1.0345
No log	0.8317	84	1.2240	0.2549	1.2240	1.1063
No log	0.8515	86	1.5565	0.2191	1.5565	1.2476
No log	0.8713	88	1.7485	0.2019	1.7485	1.3223
No log	0.8911	90	2.1680	0.1150	2.1680	1.4724
No log	0.9109	92	1.8363	0.1530	1.8363	1.3551
No log	0.9307	94	1.6126	0.2115	1.6126	1.2699
No log	0.9505	96	1.4756	0.1942	1.4756	1.2147
No log	0.9703	98	1.1945	0.2128	1.1945	1.0929
No log	0.9901	100	1.1097	0.2794	1.1097	1.0534
No log	1.0099	102	1.1425	0.3137	1.1425	1.0689
No log	1.0297	104	1.2489	0.1919	1.2489	1.1175
No log	1.0495	106	1.2792	0.1919	1.2792	1.1310
No log	1.0693	108	1.2634	0.2115	1.2634	1.1240
No log	1.0891	110	1.3416	0.1996	1.3416	1.1583
No log	1.1089	112	1.2990	0.2140	1.2990	1.1398
No log	1.1287	114	1.2546	0.2896	1.2546	1.1201
No log	1.1485	116	1.1397	0.2417	1.1397	1.0676
No log	1.1683	118	1.1384	0.2691	1.1384	1.0669
No log	1.1881	120	1.1287	0.2355	1.1287	1.0624
No log	1.2079	122	1.1279	0.2216	1.1279	1.0620
No log	1.2277	124	1.2048	0.2708	1.2048	1.0976
No log	1.2475	126	1.3285	0.2405	1.3285	1.1526
No log	1.2673	128	1.3965	0.1830	1.3965	1.1817
No log	1.2871	130	1.6470	0.2044	1.6470	1.2834
No log	1.3069	132	1.8830	0.1397	1.8830	1.3722
No log	1.3267	134	1.6455	0.1298	1.6455	1.2828
No log	1.3465	136	1.2829	0.2257	1.2829	1.1327
No log	1.3663	138	1.1580	0.2368	1.1580	1.0761
No log	1.3861	140	1.1547	0.2318	1.1547	1.0746
No log	1.4059	142	1.2024	0.3081	1.2024	1.0965
No log	1.4257	144	1.5737	0.0994	1.5737	1.2545
No log	1.4455	146	1.7079	0.0784	1.7079	1.3069
No log	1.4653	148	1.4522	0.2181	1.4522	1.2051
No log	1.4851	150	1.1993	0.2556	1.1993	1.0951
No log	1.5050	152	1.1359	0.1847	1.1359	1.0658
No log	1.5248	154	1.1512	0.3017	1.1512	1.0729
No log	1.5446	156	1.2133	0.3218	1.2133	1.1015
No log	1.5644	158	1.5373	0.2550	1.5373	1.2399
No log	1.5842	160	1.6444	0.2589	1.6444	1.2823
No log	1.6040	162	1.3655	0.3175	1.3655	1.1686
No log	1.6238	164	1.1686	0.1811	1.1686	1.0810
No log	1.6436	166	1.1776	0.1719	1.1776	1.0852
No log	1.6634	168	1.2515	0.1885	1.2515	1.1187
No log	1.6832	170	1.5546	0.2172	1.5546	1.2468
No log	1.7030	172	1.7871	0.1970	1.7871	1.3368
No log	1.7228	174	1.6782	0.1930	1.6782	1.2954
No log	1.7426	176	1.4135	0.2506	1.4135	1.1889
No log	1.7624	178	1.4083	0.2608	1.4083	1.1867
No log	1.7822	180	1.4411	0.2760	1.4411	1.2005
No log	1.8020	182	1.6825	0.2098	1.6825	1.2971
No log	1.8218	184	1.9854	0.1627	1.9854	1.4090
No log	1.8416	186	1.7004	0.2836	1.7004	1.3040
No log	1.8614	188	1.2320	0.3531	1.2320	1.1100
No log	1.8812	190	1.1573	0.3176	1.1573	1.0758
No log	1.9010	192	1.1652	0.3930	1.1652	1.0794
No log	1.9208	194	1.3076	0.3197	1.3076	1.1435
No log	1.9406	196	1.3880	0.2586	1.3880	1.1781
No log	1.9604	198	1.2675	0.3026	1.2675	1.1258
No log	1.9802	200	1.1513	0.3313	1.1513	1.0730
No log	2.0	202	1.1306	0.2665	1.1306	1.0633
No log	2.0198	204	1.2053	0.3370	1.2053	1.0979
No log	2.0396	206	1.2372	0.3029	1.2372	1.1123
No log	2.0594	208	1.1309	0.2679	1.1309	1.0635
No log	2.0792	210	1.1144	0.2757	1.1144	1.0556
No log	2.0990	212	1.1121	0.2757	1.1121	1.0546
No log	2.1188	214	1.1556	0.2804	1.1556	1.0750
No log	2.1386	216	1.3516	0.3259	1.3516	1.1626
No log	2.1584	218	1.3748	0.2965	1.3748	1.1725
No log	2.1782	220	1.2212	0.2788	1.2212	1.1051
No log	2.1980	222	1.1747	0.3073	1.1747	1.0838
No log	2.2178	224	1.2278	0.3363	1.2278	1.1081
No log	2.2376	226	1.2706	0.2729	1.2706	1.1272
No log	2.2574	228	1.4503	0.2300	1.4503	1.2043
No log	2.2772	230	1.3975	0.2181	1.3975	1.1822
No log	2.2970	232	1.2092	0.2637	1.2092	1.0996
No log	2.3168	234	1.1736	0.3036	1.1736	1.0833
No log	2.3366	236	1.1873	0.3539	1.1873	1.0896
No log	2.3564	238	1.2796	0.3161	1.2796	1.1312
No log	2.3762	240	1.2619	0.3873	1.2619	1.1233
No log	2.3960	242	1.2103	0.2504	1.2103	1.1001
No log	2.4158	244	1.2286	0.3119	1.2286	1.1084
No log	2.4356	246	1.2568	0.2920	1.2568	1.1211
No log	2.4554	248	1.2067	0.2964	1.2067	1.0985
No log	2.4752	250	1.1874	0.2843	1.1874	1.0897
No log	2.4950	252	1.1995	0.2918	1.1995	1.0952
No log	2.5149	254	1.1518	0.2728	1.1518	1.0732
No log	2.5347	256	1.1351	0.2823	1.1351	1.0654
No log	2.5545	258	1.2270	0.3231	1.2270	1.1077
No log	2.5743	260	1.2492	0.2270	1.2492	1.1177
No log	2.5941	262	1.1889	0.3126	1.1889	1.0904
No log	2.6139	264	1.1991	0.3126	1.1991	1.0951
No log	2.6337	266	1.2444	0.3413	1.2444	1.1155
No log	2.6535	268	1.1526	0.3148	1.1526	1.0736
No log	2.6733	270	1.1028	0.3017	1.1028	1.0502
No log	2.6931	272	1.1121	0.2931	1.1121	1.0546
No log	2.7129	274	1.2523	0.3167	1.2523	1.1191
No log	2.7327	276	1.2445	0.2904	1.2445	1.1156
No log	2.7525	278	1.1300	0.2897	1.1300	1.0630
No log	2.7723	280	1.1077	0.3272	1.1077	1.0525
No log	2.7921	282	1.1186	0.3802	1.1186	1.0576
No log	2.8119	284	1.1163	0.3186	1.1163	1.0566
No log	2.8317	286	1.1063	0.3148	1.1063	1.0518
No log	2.8515	288	1.0949	0.3148	1.0949	1.0464
No log	2.8713	290	1.1193	0.3208	1.1193	1.0580
No log	2.8911	292	1.2671	0.2966	1.2671	1.1256
No log	2.9109	294	1.6859	0.2277	1.6859	1.2984
No log	2.9307	296	1.8335	0.1568	1.8335	1.3541
No log	2.9505	298	1.5866	0.2912	1.5866	1.2596
No log	2.9703	300	1.2032	0.2699	1.2032	1.0969
No log	2.9901	302	1.1207	0.3520	1.1207	1.0586
No log	3.0099	304	1.3011	0.3159	1.3011	1.1407
No log	3.0297	306	1.3607	0.3061	1.3607	1.1665
No log	3.0495	308	1.2268	0.3377	1.2268	1.1076
No log	3.0693	310	1.1257	0.3100	1.1257	1.0610
No log	3.0891	312	1.1873	0.3484	1.1873	1.0896
No log	3.1089	314	1.2525	0.3110	1.2525	1.1191
No log	3.1287	316	1.1714	0.3220	1.1714	1.0823
No log	3.1485	318	1.1044	0.2679	1.1044	1.0509
No log	3.1683	320	1.1068	0.2743	1.1068	1.0521
No log	3.1881	322	1.1252	0.2633	1.1252	1.0607
No log	3.2079	324	1.2447	0.3255	1.2447	1.1157
No log	3.2277	326	1.4190	0.2256	1.4190	1.1912
No log	3.2475	328	1.3741	0.3025	1.3741	1.1722
No log	3.2673	330	1.2316	0.3407	1.2316	1.1098
No log	3.2871	332	1.1976	0.3401	1.1976	1.0943
No log	3.3069	334	1.2286	0.3579	1.2286	1.1084
No log	3.3267	336	1.2602	0.2524	1.2602	1.1226
No log	3.3465	338	1.2895	0.2316	1.2895	1.1356
No log	3.3663	340	1.2127	0.3078	1.2127	1.1012
No log	3.3861	342	1.1240	0.3184	1.1240	1.0602
No log	3.4059	344	1.0922	0.3838	1.0922	1.0451
No log	3.4257	346	1.0840	0.3337	1.0840	1.0412
No log	3.4455	348	1.0878	0.3250	1.0878	1.0430
No log	3.4653	350	1.1124	0.3448	1.1124	1.0547
No log	3.4851	352	1.0861	0.3448	1.0861	1.0422
No log	3.5050	354	1.0465	0.3661	1.0465	1.0230
No log	3.5248	356	1.0410	0.4048	1.0410	1.0203
No log	3.5446	358	1.0187	0.3661	1.0187	1.0093
No log	3.5644	360	1.0744	0.3556	1.0744	1.0366
No log	3.5842	362	1.1094	0.3249	1.1094	1.0533
No log	3.6040	364	1.0527	0.3566	1.0527	1.0260
No log	3.6238	366	1.0641	0.3496	1.0641	1.0315
No log	3.6436	368	1.0730	0.3344	1.0730	1.0359
No log	3.6634	370	1.0892	0.3514	1.0892	1.0436
No log	3.6832	372	1.1600	0.2730	1.1600	1.0770
No log	3.7030	374	1.1700	0.2461	1.1700	1.0817
No log	3.7228	376	1.1407	0.2824	1.1407	1.0680
No log	3.7426	378	1.1610	0.2824	1.1610	1.0775
No log	3.7624	380	1.2128	0.2577	1.2128	1.1013
No log	3.7822	382	1.2252	0.2348	1.2252	1.1069
No log	3.8020	384	1.1401	0.2944	1.1401	1.0678
No log	3.8218	386	1.1838	0.3482	1.1838	1.0880
No log	3.8416	388	1.2627	0.3103	1.2627	1.1237
No log	3.8614	390	1.1956	0.2937	1.1956	1.0934
No log	3.8812	392	1.0911	0.3380	1.0911	1.0446
No log	3.9010	394	1.1243	0.2358	1.1243	1.0603
No log	3.9208	396	1.1502	0.2555	1.1502	1.0725
No log	3.9406	398	1.1033	0.2694	1.1033	1.0504
No log	3.9604	400	1.0834	0.3286	1.0834	1.0409
No log	3.9802	402	1.0830	0.3195	1.0830	1.0407
No log	4.0	404	1.0733	0.3496	1.0733	1.0360
No log	4.0198	406	1.0667	0.3059	1.0667	1.0328
No log	4.0396	408	1.0974	0.2682	1.0974	1.0476
No log	4.0594	410	1.0952	0.2824	1.0952	1.0465
No log	4.0792	412	1.0467	0.3268	1.0467	1.0231
No log	4.0990	414	1.0365	0.3379	1.0365	1.0181
No log	4.1188	416	1.0341	0.3301	1.0341	1.0169
No log	4.1386	418	1.0512	0.3695	1.0512	1.0253
No log	4.1584	420	1.0807	0.3196	1.0807	1.0396
No log	4.1782	422	1.0702	0.3263	1.0702	1.0345
No log	4.1980	424	1.0266	0.3497	1.0266	1.0132
No log	4.2178	426	1.0531	0.3086	1.0531	1.0262
No log	4.2376	428	1.0543	0.3184	1.0543	1.0268
No log	4.2574	430	1.0324	0.3085	1.0324	1.0161
No log	4.2772	432	1.0375	0.3085	1.0375	1.0186
No log	4.2970	434	1.0384	0.3852	1.0384	1.0190
No log	4.3168	436	1.0410	0.4081	1.0410	1.0203
No log	4.3366	438	1.0557	0.3399	1.0557	1.0275
No log	4.3564	440	1.0867	0.3301	1.0867	1.0425
No log	4.3762	442	1.1209	0.3566	1.1209	1.0587
No log	4.3960	444	1.1761	0.3567	1.1761	1.0845
No log	4.4158	446	1.3132	0.2839	1.3132	1.1460
No log	4.4356	448	1.3957	0.2586	1.3957	1.1814
No log	4.4554	450	1.2884	0.2857	1.2884	1.1351
No log	4.4752	452	1.1503	0.3661	1.1503	1.0725
No log	4.4950	454	1.1525	0.3232	1.1525	1.0735
No log	4.5149	456	1.1623	0.2907	1.1623	1.0781
No log	4.5347	458	1.1814	0.3436	1.1814	1.0869
No log	4.5545	460	1.2231	0.2876	1.2231	1.1059
No log	4.5743	462	1.1758	0.3081	1.1758	1.0843
No log	4.5941	464	1.1462	0.3085	1.1462	1.0706
No log	4.6139	466	1.1595	0.2664	1.1595	1.0768
No log	4.6337	468	1.1683	0.2776	1.1683	1.0809
No log	4.6535	470	1.1809	0.2776	1.1809	1.0867
No log	4.6733	472	1.1490	0.3415	1.1490	1.0719
No log	4.6931	474	1.1263	0.3415	1.1263	1.0613
No log	4.7129	476	1.1521	0.3174	1.1521	1.0734
No log	4.7327	478	1.2184	0.2478	1.2184	1.1038
No log	4.7525	480	1.1899	0.2397	1.1899	1.0908
No log	4.7723	482	1.1492	0.3033	1.1492	1.0720
No log	4.7921	484	1.0865	0.3301	1.0865	1.0424
No log	4.8119	486	1.0633	0.3885	1.0633	1.0312
No log	4.8317	488	1.0561	0.3885	1.0561	1.0277
No log	4.8515	490	1.0512	0.3885	1.0512	1.0253
No log	4.8713	492	1.0732	0.3154	1.0732	1.0359
No log	4.8911	494	1.0616	0.3154	1.0616	1.0303
No log	4.9109	496	1.0815	0.2795	1.0815	1.0400
No log	4.9307	498	1.0851	0.3397	1.0851	1.0417
0.3827	4.9505	500	1.0799	0.3467	1.0799	1.0392
0.3827	4.9703	502	1.0696	0.4035	1.0696	1.0342
0.3827	4.9901	504	1.0786	0.4	1.0786	1.0386
0.3827	5.0099	506	1.0769	0.3849	1.0769	1.0378
0.3827	5.0297	508	1.0936	0.3278	1.0936	1.0458
0.3827	5.0495	510	1.0888	0.3573	1.0888	1.0434
0.3827	5.0693	512	1.0819	0.2991	1.0819	1.0402
0.3827	5.0891	514	1.1607	0.3476	1.1607	1.0774
0.3827	5.1089	516	1.2217	0.2640	1.2217	1.1053
0.3827	5.1287	518	1.2303	0.2716	1.2303	1.1092
0.3827	5.1485	520	1.2108	0.2356	1.2108	1.1004
0.3827	5.1683	522	1.1097	0.3448	1.1097	1.0534
0.3827	5.1881	524	1.0758	0.3205	1.0758	1.0372

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1