ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k2_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1540
• Qwk: 0.2495
• Mse: 1.1540
• Rmse: 1.0742

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2	2	4.6105	-0.0132	4.6105	2.1472
No log	0.4	4	2.6625	0.0051	2.6625	1.6317
No log	0.6	6	1.9114	0.0062	1.9114	1.3825
No log	0.8	8	2.2536	-0.0433	2.2536	1.5012
No log	1.0	10	1.6315	-0.1174	1.6315	1.2773
No log	1.2	12	1.2712	0.0611	1.2712	1.1275
No log	1.4	14	1.2253	0.1202	1.2253	1.1069
No log	1.6	16	1.2030	0.1549	1.2030	1.0968
No log	1.8	18	1.2044	0.1527	1.2044	1.0974
No log	2.0	20	1.4090	0.1257	1.4090	1.1870
No log	2.2	22	1.3394	0.1257	1.3394	1.1573
No log	2.4	24	1.2164	0.1584	1.2164	1.1029
No log	2.6	26	1.1816	0.2014	1.1816	1.0870
No log	2.8	28	1.1108	0.1959	1.1108	1.0539
No log	3.0	30	1.0465	0.3135	1.0465	1.0230
No log	3.2	32	1.1047	0.2314	1.1047	1.0511
No log	3.4	34	1.1449	0.2408	1.1449	1.0700
No log	3.6	36	1.1448	0.1911	1.1448	1.0700
No log	3.8	38	1.1986	0.2095	1.1986	1.0948
No log	4.0	40	1.3029	0.1980	1.3029	1.1414
No log	4.2	42	1.5770	0.1248	1.5770	1.2558
No log	4.4	44	1.7014	0.1935	1.7014	1.3044
No log	4.6	46	1.5806	0.1328	1.5806	1.2572
No log	4.8	48	1.4696	0.0038	1.4696	1.2123
No log	5.0	50	1.2452	0.2298	1.2452	1.1159
No log	5.2	52	1.1506	0.1968	1.1506	1.0727
No log	5.4	54	1.1547	0.2068	1.1547	1.0746
No log	5.6	56	1.0850	0.2835	1.0850	1.0416
No log	5.8	58	1.0380	0.2378	1.0380	1.0188
No log	6.0	60	1.1066	0.2589	1.1066	1.0520
No log	6.2	62	1.4603	0.1796	1.4603	1.2084
No log	6.4	64	1.7227	0.1020	1.7227	1.3125
No log	6.6	66	1.6574	0.1747	1.6574	1.2874
No log	6.8	68	1.3989	0.1848	1.3989	1.1828
No log	7.0	70	1.2567	0.2150	1.2567	1.1210
No log	7.2	72	1.1751	0.2243	1.1751	1.0840
No log	7.4	74	1.1259	0.2912	1.1259	1.0611
No log	7.6	76	1.1578	0.1830	1.1578	1.0760
No log	7.8	78	1.4456	0.1472	1.4456	1.2023
No log	8.0	80	1.8877	0.0151	1.8877	1.3739
No log	8.2	82	1.7392	0.0525	1.7392	1.3188
No log	8.4	84	1.3148	0.1958	1.3148	1.1467
No log	8.6	86	1.0541	0.2963	1.0541	1.0267
No log	8.8	88	1.0334	0.3356	1.0334	1.0166
No log	9.0	90	1.1866	0.2844	1.1866	1.0893
No log	9.2	92	1.2189	0.2191	1.2189	1.1040
No log	9.4	94	1.1763	0.2432	1.1763	1.0846
No log	9.6	96	1.0832	0.3321	1.0832	1.0408
No log	9.8	98	0.9939	0.4056	0.9939	0.9969
No log	10.0	100	0.9427	0.4016	0.9427	0.9709
No log	10.2	102	0.9336	0.4401	0.9336	0.9662
No log	10.4	104	1.0124	0.3614	1.0124	1.0062
No log	10.6	106	1.1344	0.2796	1.1344	1.0651
No log	10.8	108	1.2291	0.2780	1.2291	1.1087
No log	11.0	110	1.1851	0.3188	1.1851	1.0886
No log	11.2	112	1.0320	0.3699	1.0320	1.0159
No log	11.4	114	0.9991	0.3310	0.9991	0.9995
No log	11.6	116	1.0120	0.2714	1.0120	1.0060
No log	11.8	118	1.1087	0.2647	1.1087	1.0529
No log	12.0	120	1.3646	0.2516	1.3646	1.1682
No log	12.2	122	1.3030	0.2191	1.3030	1.1415
No log	12.4	124	1.0813	0.3210	1.0813	1.0398
No log	12.6	126	1.0713	0.3128	1.0713	1.0350
No log	12.8	128	1.2022	0.2565	1.2022	1.0965
No log	13.0	130	1.2204	0.2565	1.2204	1.1047
No log	13.2	132	1.3315	0.2522	1.3315	1.1539
No log	13.4	134	1.3288	0.2439	1.3288	1.1527
No log	13.6	136	1.0879	0.3321	1.0879	1.0430
No log	13.8	138	0.9602	0.4079	0.9602	0.9799
No log	14.0	140	0.9499	0.4620	0.9499	0.9746
No log	14.2	142	0.9397	0.3938	0.9397	0.9694
No log	14.4	144	0.9938	0.3956	0.9938	0.9969
No log	14.6	146	1.1691	0.3572	1.1691	1.0812
No log	14.8	148	1.2478	0.2673	1.2478	1.1170
No log	15.0	150	1.1472	0.3542	1.1472	1.0711
No log	15.2	152	1.0724	0.3210	1.0724	1.0356
No log	15.4	154	1.0421	0.2676	1.0421	1.0209
No log	15.6	156	1.0650	0.3113	1.0650	1.0320
No log	15.8	158	1.2065	0.2397	1.2065	1.0984
No log	16.0	160	1.2396	0.3157	1.2396	1.1134
No log	16.2	162	1.0596	0.3625	1.0596	1.0294
No log	16.4	164	1.0253	0.3897	1.0253	1.0126
No log	16.6	166	0.9702	0.4598	0.9702	0.9850
No log	16.8	168	0.9655	0.3983	0.9655	0.9826
No log	17.0	170	1.0248	0.3468	1.0248	1.0123
No log	17.2	172	1.0525	0.3415	1.0525	1.0259
No log	17.4	174	1.0461	0.3511	1.0461	1.0228
No log	17.6	176	1.1161	0.2384	1.1161	1.0565
No log	17.8	178	1.1893	0.2687	1.1893	1.0905
No log	18.0	180	1.1212	0.3100	1.1212	1.0589
No log	18.2	182	1.0384	0.3237	1.0384	1.0190
No log	18.4	184	1.0492	0.3448	1.0492	1.0243
No log	18.6	186	1.0299	0.3813	1.0299	1.0148
No log	18.8	188	1.0249	0.3908	1.0249	1.0124
No log	19.0	190	1.0169	0.3741	1.0169	1.0084
No log	19.2	192	1.0549	0.3174	1.0549	1.0271
No log	19.4	194	1.0932	0.3199	1.0932	1.0456
No log	19.6	196	1.0881	0.3294	1.0881	1.0431
No log	19.8	198	1.0745	0.3390	1.0745	1.0366
No log	20.0	200	1.0786	0.3086	1.0786	1.0386
No log	20.2	202	1.1672	0.2289	1.1672	1.0804
No log	20.4	204	1.2153	0.2527	1.2153	1.1024
No log	20.6	206	1.2285	0.2577	1.2285	1.1084
No log	20.8	208	1.2968	0.1858	1.2968	1.1388
No log	21.0	210	1.3179	0.2388	1.3179	1.1480
No log	21.2	212	1.2187	0.1990	1.2187	1.1040
No log	21.4	214	1.0971	0.3328	1.0971	1.0474
No log	21.6	216	1.0984	0.3328	1.0984	1.0481
No log	21.8	218	1.1463	0.2844	1.1463	1.0707
No log	22.0	220	1.2603	0.2417	1.2603	1.1226
No log	22.2	222	1.3335	0.3005	1.3335	1.1548
No log	22.4	224	1.2876	0.2895	1.2876	1.1347
No log	22.6	226	1.1861	0.2452	1.1861	1.0891
No log	22.8	228	1.1507	0.2942	1.1507	1.0727
No log	23.0	230	1.1444	0.2815	1.1444	1.0698
No log	23.2	232	1.1788	0.3152	1.1788	1.0857
No log	23.4	234	1.2486	0.3096	1.2486	1.1174
No log	23.6	236	1.2590	0.2797	1.2590	1.1220
No log	23.8	238	1.2874	0.2780	1.2874	1.1347
No log	24.0	240	1.3273	0.2718	1.3273	1.1521
No log	24.2	242	1.2860	0.2385	1.2860	1.1340
No log	24.4	244	1.3207	0.2385	1.3207	1.1492
No log	24.6	246	1.4641	0.2424	1.4641	1.2100
No log	24.8	248	1.4872	0.2983	1.4872	1.2195
No log	25.0	250	1.4683	0.2983	1.4683	1.2117
No log	25.2	252	1.3762	0.2807	1.3762	1.1731
No log	25.4	254	1.2385	0.2734	1.2385	1.1129
No log	25.6	256	1.1167	0.2913	1.1167	1.0567
No log	25.8	258	1.0432	0.2726	1.0432	1.0214
No log	26.0	260	1.0451	0.3113	1.0451	1.0223
No log	26.2	262	1.0982	0.3199	1.0982	1.0479
No log	26.4	264	1.2210	0.3231	1.2210	1.1050
No log	26.6	266	1.2687	0.3291	1.2687	1.1263
No log	26.8	268	1.2867	0.3005	1.2867	1.1343
No log	27.0	270	1.1829	0.2417	1.1829	1.0876
No log	27.2	272	1.0984	0.2728	1.0984	1.0481
No log	27.4	274	1.0997	0.2709	1.0997	1.0487
No log	27.6	276	1.1656	0.2311	1.1656	1.0796
No log	27.8	278	1.2026	0.2796	1.2026	1.0966
No log	28.0	280	1.1971	0.3165	1.1971	1.0941
No log	28.2	282	1.2167	0.3165	1.2167	1.1030
No log	28.4	284	1.2524	0.2870	1.2524	1.1191
No log	28.6	286	1.2420	0.3005	1.2420	1.1145
No log	28.8	288	1.1579	0.2870	1.1579	1.0761
No log	29.0	290	1.1151	0.3056	1.1151	1.0560
No log	29.2	292	1.0893	0.3243	1.0893	1.0437
No log	29.4	294	1.0773	0.3572	1.0773	1.0379
No log	29.6	296	1.0962	0.3149	1.0962	1.0470
No log	29.8	298	1.0981	0.3390	1.0981	1.0479
No log	30.0	300	1.0947	0.3527	1.0947	1.0463
No log	30.2	302	1.1276	0.3059	1.1276	1.0619
No log	30.4	304	1.1431	0.3104	1.1431	1.0691
No log	30.6	306	1.1625	0.2876	1.1625	1.0782
No log	30.8	308	1.1605	0.3397	1.1605	1.0773
No log	31.0	310	1.2289	0.3008	1.2289	1.1086
No log	31.2	312	1.3497	0.2325	1.3497	1.1618
No log	31.4	314	1.3598	0.2020	1.3598	1.1661
No log	31.6	316	1.2520	0.3466	1.2520	1.1189
No log	31.8	318	1.1119	0.3159	1.1119	1.0544
No log	32.0	320	1.0625	0.2625	1.0625	1.0308
No log	32.2	322	1.0489	0.2970	1.0489	1.0242
No log	32.4	324	1.0400	0.3437	1.0400	1.0198
No log	32.6	326	1.0844	0.3558	1.0844	1.0414
No log	32.8	328	1.2320	0.2890	1.2320	1.1099
No log	33.0	330	1.3634	0.2371	1.3634	1.1676
No log	33.2	332	1.3767	0.2237	1.3767	1.1733
No log	33.4	334	1.3163	0.2417	1.3163	1.1473
No log	33.6	336	1.2646	0.3056	1.2646	1.1245
No log	33.8	338	1.2022	0.2247	1.2022	1.0965
No log	34.0	340	1.2104	0.2247	1.2104	1.1002
No log	34.2	342	1.2456	0.2247	1.2456	1.1161
No log	34.4	344	1.2933	0.2714	1.2933	1.1373
No log	34.6	346	1.3630	0.2283	1.3630	1.1675
No log	34.8	348	1.4583	0.1790	1.4583	1.2076
No log	35.0	350	1.5412	0.1768	1.5412	1.2414
No log	35.2	352	1.5010	0.1634	1.5010	1.2251
No log	35.4	354	1.3536	0.2292	1.3536	1.1635
No log	35.6	356	1.2384	0.2718	1.2384	1.1128
No log	35.8	358	1.2021	0.2276	1.2021	1.0964
No log	36.0	360	1.2178	0.1841	1.2178	1.1035
No log	36.2	362	1.2242	0.2270	1.2242	1.1064
No log	36.4	364	1.2881	0.2937	1.2881	1.1349
No log	36.6	366	1.2950	0.2937	1.2950	1.1380
No log	36.8	368	1.2010	0.2410	1.2010	1.0959
No log	37.0	370	1.1165	0.2918	1.1165	1.0567
No log	37.2	372	1.0913	0.3205	1.0913	1.0447
No log	37.4	374	1.1208	0.3126	1.1208	1.0587
No log	37.6	376	1.1928	0.2492	1.1928	1.0921
No log	37.8	378	1.2588	0.3133	1.2588	1.1220
No log	38.0	380	1.2861	0.3047	1.2861	1.1341
No log	38.2	382	1.2052	0.2876	1.2052	1.0978
No log	38.4	384	1.1081	0.3033	1.1081	1.0527
No log	38.6	386	1.0736	0.3013	1.0736	1.0362
No log	38.8	388	1.0653	0.3486	1.0653	1.0321
No log	39.0	390	1.0799	0.3154	1.0799	1.0392
No log	39.2	392	1.1041	0.3199	1.1041	1.0507
No log	39.4	394	1.1583	0.2824	1.1583	1.0763
No log	39.6	396	1.2414	0.2937	1.2414	1.1142
No log	39.8	398	1.3008	0.3421	1.3008	1.1405
No log	40.0	400	1.2861	0.3005	1.2861	1.1340
No log	40.2	402	1.2219	0.2779	1.2219	1.1054
No log	40.4	404	1.2143	0.2452	1.2143	1.1020
No log	40.6	406	1.2302	0.2361	1.2302	1.1091
No log	40.8	408	1.2056	0.2261	1.2056	1.0980
No log	41.0	410	1.1935	0.2261	1.1935	1.0925
No log	41.2	412	1.1820	0.2261	1.1820	1.0872
No log	41.4	414	1.1537	0.2601	1.1537	1.0741
No log	41.6	416	1.1492	0.2469	1.1492	1.0720
No log	41.8	418	1.1550	0.1984	1.1550	1.0747
No log	42.0	420	1.1596	0.2040	1.1596	1.0769
No log	42.2	422	1.1491	0.2386	1.1491	1.0720
No log	42.4	424	1.1730	0.2180	1.1730	1.0830
No log	42.6	426	1.2107	0.2324	1.2107	1.1003
No log	42.8	428	1.2773	0.2570	1.2773	1.1302
No log	43.0	430	1.3067	0.2484	1.3067	1.1431
No log	43.2	432	1.2789	0.2964	1.2789	1.1309
No log	43.4	434	1.2186	0.3052	1.2186	1.1039
No log	43.6	436	1.1644	0.2824	1.1644	1.0791
No log	43.8	438	1.1274	0.3250	1.1274	1.0618
No log	44.0	440	1.1100	0.3250	1.1100	1.0536
No log	44.2	442	1.0948	0.3250	1.0948	1.0463
No log	44.4	444	1.1056	0.2963	1.1056	1.0515
No log	44.6	446	1.1242	0.2864	1.1242	1.0603
No log	44.8	448	1.1358	0.2669	1.1358	1.0657
No log	45.0	450	1.1298	0.2844	1.1298	1.0629
No log	45.2	452	1.0991	0.2897	1.0991	1.0484
No log	45.4	454	1.0700	0.2823	1.0700	1.0344
No log	45.6	456	1.0717	0.2966	1.0717	1.0352
No log	45.8	458	1.1140	0.2669	1.1140	1.0555
No log	46.0	460	1.1791	0.2702	1.1791	1.0859
No log	46.2	462	1.2885	0.2465	1.2885	1.1351
No log	46.4	464	1.3738	0.2663	1.3738	1.1721
No log	46.6	466	1.3634	0.2534	1.3634	1.1677
No log	46.8	468	1.2886	0.2417	1.2886	1.1352
No log	47.0	470	1.2064	0.2320	1.2064	1.0984
No log	47.2	472	1.1492	0.2637	1.1492	1.0720
No log	47.4	474	1.1211	0.2843	1.1211	1.0588
No log	47.6	476	1.1120	0.3328	1.1120	1.0545
No log	47.8	478	1.1178	0.3059	1.1178	1.0572
No log	48.0	480	1.1153	0.3059	1.1153	1.0561
No log	48.2	482	1.1223	0.2730	1.1223	1.0594
No log	48.4	484	1.1095	0.3390	1.1095	1.0533
No log	48.6	486	1.0877	0.3036	1.0877	1.0429
No log	48.8	488	1.0750	0.2966	1.0750	1.0368
No log	49.0	490	1.0731	0.2966	1.0731	1.0359
No log	49.2	492	1.0989	0.3328	1.0989	1.0483
No log	49.4	494	1.1403	0.2511	1.1403	1.0678
No log	49.6	496	1.1804	0.2324	1.1804	1.0865
No log	49.8	498	1.1823	0.2324	1.1823	1.0873
0.2952	50.0	500	1.1510	0.2685	1.1510	1.0728
0.2952	50.2	502	1.1010	0.3250	1.1010	1.0493
0.2952	50.4	504	1.0842	0.2966	1.0842	1.0412
0.2952	50.6	506	1.1011	0.3328	1.1011	1.0493
0.2952	50.8	508	1.1636	0.2609	1.1636	1.0787
0.2952	51.0	510	1.2450	0.2780	1.2450	1.1158
0.2952	51.2	512	1.2904	0.2601	1.2904	1.1360
0.2952	51.4	514	1.2543	0.2780	1.2543	1.1200
0.2952	51.6	516	1.2098	0.2984	1.2098	1.0999
0.2952	51.8	518	1.1606	0.2815	1.1606	1.0773
0.2952	52.0	520	1.1200	0.2843	1.1200	1.0583
0.2952	52.2	522	1.1058	0.2823	1.1058	1.0515
0.2952	52.4	524	1.1123	0.2966	1.1123	1.0546
0.2952	52.6	526	1.1127	0.2966	1.1127	1.0548
0.2952	52.8	528	1.1024	0.2966	1.1024	1.0499
0.2952	53.0	530	1.1037	0.3036	1.1037	1.0506
0.2952	53.2	532	1.1432	0.2620	1.1432	1.0692
0.2952	53.4	534	1.1959	0.2081	1.1959	1.0936
0.2952	53.6	536	1.2098	0.2524	1.2098	1.0999
0.2952	53.8	538	1.1808	0.2170	1.1808	1.0867
0.2952	54.0	540	1.1540	0.2495	1.1540	1.0742

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1