ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k8_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2527
• Qwk: 0.1944
• Mse: 1.2527
• Rmse: 1.1192

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0488	2	4.8067	-0.0132	4.8067	2.1924
No log	0.0976	4	3.1058	-0.0542	3.1058	1.7623
No log	0.1463	6	2.0871	-0.0575	2.0871	1.4447
No log	0.1951	8	1.8341	0.0062	1.8341	1.3543
No log	0.2439	10	1.5398	0.0363	1.5398	1.2409
No log	0.2927	12	1.3535	0.0247	1.3535	1.1634
No log	0.3415	14	1.2356	0.3168	1.2356	1.1116
No log	0.3902	16	1.2163	0.1772	1.2163	1.1029
No log	0.4390	18	1.4271	0.0750	1.4271	1.1946
No log	0.4878	20	1.5400	0.0019	1.5400	1.2410
No log	0.5366	22	1.3104	0.0750	1.3104	1.1447
No log	0.5854	24	1.1601	0.2835	1.1601	1.0771
No log	0.6341	26	1.1662	0.1247	1.1662	1.0799
No log	0.6829	28	1.2070	0.0904	1.2070	1.0986
No log	0.7317	30	1.2651	0.0454	1.2651	1.1248
No log	0.7805	32	1.2325	0.0904	1.2325	1.1102
No log	0.8293	34	1.1955	0.0802	1.1955	1.0934
No log	0.8780	36	1.1881	0.3307	1.1881	1.0900
No log	0.9268	38	1.2928	0.0688	1.2928	1.1370
No log	0.9756	40	1.3580	0.0838	1.3580	1.1653
No log	1.0244	42	1.4271	0.0987	1.4271	1.1946
No log	1.0732	44	1.3286	0.1165	1.3286	1.1526
No log	1.1220	46	1.1345	0.1579	1.1345	1.0651
No log	1.1707	48	1.1060	0.2821	1.1060	1.0517
No log	1.2195	50	1.1763	0.1596	1.1763	1.0846
No log	1.2683	52	1.1474	0.1801	1.1474	1.0712
No log	1.3171	54	1.0770	0.3710	1.0770	1.0378
No log	1.3659	56	1.1254	0.2824	1.1254	1.0609
No log	1.4146	58	1.0892	0.2824	1.0892	1.0437
No log	1.4634	60	1.0148	0.4385	1.0148	1.0074
No log	1.5122	62	1.0373	0.2076	1.0373	1.0185
No log	1.5610	64	1.0838	0.1903	1.0838	1.0411
No log	1.6098	66	1.1092	0.1896	1.1092	1.0532
No log	1.6585	68	1.1054	0.2046	1.1054	1.0514
No log	1.7073	70	1.0525	0.2926	1.0525	1.0259
No log	1.7561	72	1.0275	0.3382	1.0275	1.0137
No log	1.8049	74	1.0316	0.3382	1.0316	1.0157
No log	1.8537	76	1.0381	0.3720	1.0381	1.0189
No log	1.9024	78	1.0842	0.3022	1.0842	1.0412
No log	1.9512	80	1.1685	0.2743	1.1685	1.0810
No log	2.0	82	1.2137	0.2438	1.2137	1.1017
No log	2.0488	84	1.1984	0.1844	1.1984	1.0947
No log	2.0976	86	1.2312	0.2354	1.2312	1.1096
No log	2.1463	88	1.1919	0.2574	1.1919	1.0918
No log	2.1951	90	1.2353	0.3387	1.2353	1.1114
No log	2.2439	92	1.3683	0.3188	1.3683	1.1697
No log	2.2927	94	1.7416	0.2224	1.7416	1.3197
No log	2.3415	96	2.1056	0.1760	2.1056	1.4511
No log	2.3902	98	2.0199	0.1970	2.0199	1.4212
No log	2.4390	100	1.5599	0.2906	1.5599	1.2490
No log	2.4878	102	1.0507	0.2395	1.0507	1.0250
No log	2.5366	104	0.9799	0.4039	0.9799	0.9899
No log	2.5854	106	1.0091	0.3263	1.0091	1.0046
No log	2.6341	108	1.1793	0.2343	1.1793	1.0860
No log	2.6829	110	1.5700	0.1529	1.5700	1.2530
No log	2.7317	112	1.8258	0.2675	1.8258	1.3512
No log	2.7805	114	1.6091	0.2887	1.6091	1.2685
No log	2.8293	116	1.2350	0.3844	1.2350	1.1113
No log	2.8780	118	1.1906	0.3158	1.1906	1.0911
No log	2.9268	120	1.2724	0.2798	1.2724	1.1280
No log	2.9756	122	1.4519	0.3490	1.4519	1.2050
No log	3.0244	124	1.4623	0.3478	1.4623	1.2093
No log	3.0732	126	1.3792	0.2868	1.3792	1.1744
No log	3.1220	128	1.5020	0.3392	1.5020	1.2255
No log	3.1707	130	1.4737	0.3160	1.4737	1.2140
No log	3.2195	132	1.3466	0.2564	1.3466	1.1604
No log	3.2683	134	1.2471	0.2534	1.2471	1.1167
No log	3.3171	136	1.2842	0.2534	1.2842	1.1332
No log	3.3659	138	1.2949	0.2354	1.2949	1.1379
No log	3.4146	140	1.3428	0.2468	1.3428	1.1588
No log	3.4634	142	1.4033	0.2674	1.4033	1.1846
No log	3.5122	144	1.3128	0.2354	1.3128	1.1458
No log	3.5610	146	1.1768	0.2727	1.1768	1.0848
No log	3.6098	148	1.1805	0.2909	1.1805	1.0865
No log	3.6585	150	1.2588	0.2725	1.2588	1.1219
No log	3.7073	152	1.3469	0.2586	1.3469	1.1606
No log	3.7561	154	1.4772	0.2020	1.4772	1.2154
No log	3.8049	156	1.4897	0.2275	1.4897	1.2205
No log	3.8537	158	1.3158	0.3003	1.3158	1.1471
No log	3.9024	160	1.1967	0.1913	1.1967	1.0939
No log	3.9512	162	1.1866	0.2506	1.1866	1.0893
No log	4.0	164	1.2698	0.2914	1.2698	1.1268
No log	4.0488	166	1.5767	0.2895	1.5767	1.2557
No log	4.0976	168	1.7221	0.2818	1.7221	1.3123
No log	4.1463	170	1.5934	0.2915	1.5934	1.2623
No log	4.1951	172	1.2928	0.2895	1.2928	1.1370
No log	4.2439	174	1.1707	0.2367	1.1707	1.0820
No log	4.2927	176	1.1703	0.2634	1.1703	1.0818
No log	4.3415	178	1.2470	0.2807	1.2470	1.1167
No log	4.3902	180	1.3245	0.3595	1.3245	1.1509
No log	4.4390	182	1.4972	0.3829	1.4972	1.2236
No log	4.4878	184	1.4245	0.3615	1.4245	1.1935
No log	4.5366	186	1.2842	0.3387	1.2842	1.1332
No log	4.5854	188	1.2471	0.3372	1.2471	1.1167
No log	4.6341	190	1.2177	0.3357	1.2177	1.1035
No log	4.6829	192	1.2458	0.3706	1.2458	1.1162
No log	4.7317	194	1.2649	0.3791	1.2649	1.1247
No log	4.7805	196	1.2396	0.3348	1.2396	1.1134
No log	4.8293	198	1.1681	0.2772	1.1681	1.0808
No log	4.8780	200	1.1930	0.2725	1.1930	1.0922
No log	4.9268	202	1.3324	0.3392	1.3324	1.1543
No log	4.9756	204	1.5158	0.2991	1.5158	1.2312
No log	5.0244	206	1.4388	0.3254	1.4388	1.1995
No log	5.0732	208	1.3395	0.3595	1.3395	1.1574
No log	5.1220	210	1.2803	0.3087	1.2803	1.1315
No log	5.1707	212	1.1312	0.2844	1.1312	1.0636
No log	5.2195	214	1.0974	0.2248	1.0974	1.0476
No log	5.2683	216	1.1266	0.2050	1.1266	1.0614
No log	5.3171	218	1.1731	0.2143	1.1731	1.0831
No log	5.3659	220	1.2083	0.1850	1.2083	1.0992
No log	5.4146	222	1.1925	0.2291	1.1925	1.0920
No log	5.4634	224	1.1725	0.1911	1.1725	1.0828
No log	5.5122	226	1.1739	0.2065	1.1739	1.0835
No log	5.5610	228	1.1594	0.2219	1.1594	1.0768
No log	5.6098	230	1.1549	0.2060	1.1549	1.0747
No log	5.6585	232	1.2779	0.2870	1.2779	1.1304
No log	5.7073	234	1.5695	0.3025	1.5695	1.2528
No log	5.7561	236	1.6095	0.2756	1.6095	1.2687
No log	5.8049	238	1.4955	0.2419	1.4955	1.2229
No log	5.8537	240	1.3648	0.2782	1.3648	1.1682
No log	5.9024	242	1.2515	0.2754	1.2515	1.1187
No log	5.9512	244	1.2166	0.2889	1.2166	1.1030
No log	6.0	246	1.2921	0.3475	1.2921	1.1367
No log	6.0488	248	1.4332	0.4005	1.4332	1.1972
No log	6.0976	250	1.4278	0.4005	1.4278	1.1949
No log	6.1463	252	1.3119	0.3387	1.3119	1.1454
No log	6.1951	254	1.1814	0.3046	1.1814	1.0869
No log	6.2439	256	1.1295	0.3178	1.1295	1.0628
No log	6.2927	258	1.1948	0.3639	1.1948	1.0931
No log	6.3415	260	1.4312	0.2852	1.4312	1.1963
No log	6.3902	262	1.5535	0.2572	1.5535	1.2464
No log	6.4390	264	1.4205	0.2704	1.4205	1.1919
No log	6.4878	266	1.2322	0.2725	1.2322	1.1100
No log	6.5366	268	1.1344	0.2343	1.1344	1.0651
No log	6.5854	270	1.1209	0.2439	1.1209	1.0587
No log	6.6341	272	1.2202	0.2725	1.2202	1.1046
No log	6.6829	274	1.3389	0.3332	1.3389	1.1571
No log	6.7317	276	1.3279	0.3348	1.3279	1.1524
No log	6.7805	278	1.2961	0.3332	1.2961	1.1384
No log	6.8293	280	1.1605	0.2725	1.1605	1.0773
No log	6.8780	282	1.0972	0.2809	1.0972	1.0475
No log	6.9268	284	1.1115	0.2809	1.1115	1.0543
No log	6.9756	286	1.2450	0.2617	1.2450	1.1158
No log	7.0244	288	1.5320	0.2465	1.5320	1.2377
No log	7.0732	290	1.6744	0.2132	1.6744	1.2940
No log	7.1220	292	1.5745	0.2378	1.5745	1.2548
No log	7.1707	294	1.3584	0.2844	1.3584	1.1655
No log	7.2195	296	1.1484	0.1379	1.1484	1.0716
No log	7.2683	298	1.1040	0.1701	1.1040	1.0507
No log	7.3171	300	1.1587	0.2602	1.1587	1.0764
No log	7.3659	302	1.3383	0.2918	1.3383	1.1568
No log	7.4146	304	1.4920	0.3026	1.4920	1.2215
No log	7.4634	306	1.4988	0.2658	1.4988	1.2242
No log	7.5122	308	1.4266	0.2964	1.4266	1.1944
No log	7.5610	310	1.2415	0.2617	1.2415	1.1142
No log	7.6098	312	1.1744	0.2602	1.1744	1.0837
No log	7.6585	314	1.2000	0.2317	1.2000	1.0955
No log	7.7073	316	1.3092	0.2870	1.3092	1.1442
No log	7.7561	318	1.3596	0.2918	1.3596	1.1660
No log	7.8049	320	1.4111	0.2918	1.4111	1.1879
No log	7.8537	322	1.3261	0.2870	1.3261	1.1516
No log	7.9024	324	1.1998	0.2725	1.1998	1.0954
No log	7.9512	326	1.1886	0.2184	1.1886	1.0902
No log	8.0	328	1.1317	0.2097	1.1317	1.0638
No log	8.0488	330	1.0748	0.2108	1.0748	1.0367
No log	8.0976	332	1.0694	0.2108	1.0694	1.0341
No log	8.1463	334	1.0939	0.1952	1.0939	1.0459
No log	8.1951	336	1.0925	0.1952	1.0925	1.0452
No log	8.2439	338	1.1545	0.1896	1.1545	1.0745
No log	8.2927	340	1.1741	0.1745	1.1741	1.0836
No log	8.3415	342	1.1249	0.2250	1.1249	1.0606
No log	8.3902	344	1.1191	0.2454	1.1191	1.0579
No log	8.4390	346	1.1508	0.2402	1.1508	1.0727
No log	8.4878	348	1.2310	0.1795	1.2310	1.1095
No log	8.5366	350	1.2783	0.2080	1.2783	1.1306
No log	8.5854	352	1.2944	0.2586	1.2944	1.1377
No log	8.6341	354	1.3303	0.2617	1.3303	1.1534
No log	8.6829	356	1.2632	0.2799	1.2632	1.1239
No log	8.7317	358	1.2563	0.2313	1.2563	1.1208
No log	8.7805	360	1.2894	0.2799	1.2894	1.1355
No log	8.8293	362	1.2589	0.2452	1.2589	1.1220
No log	8.8780	364	1.2010	0.2343	1.2010	1.0959
No log	8.9268	366	1.2164	0.2343	1.2164	1.1029
No log	8.9756	368	1.2546	0.1857	1.2546	1.1201
No log	9.0244	370	1.3170	0.1753	1.3170	1.1476
No log	9.0732	372	1.3169	0.1703	1.3169	1.1476
No log	9.1220	374	1.2256	0.1853	1.2256	1.1071
No log	9.1707	376	1.2075	0.1853	1.2075	1.0989
No log	9.2195	378	1.2574	0.2387	1.2574	1.1213
No log	9.2683	380	1.4389	0.2239	1.4389	1.1996
No log	9.3171	382	1.5244	0.1594	1.5244	1.2347
No log	9.3659	384	1.4551	0.2239	1.4551	1.2063
No log	9.4146	386	1.2840	0.1944	1.2840	1.1331
No log	9.4634	388	1.1561	0.1952	1.1561	1.0752
No log	9.5122	390	1.1356	0.1952	1.1356	1.0656
No log	9.5610	392	1.1813	0.1637	1.1813	1.0869
No log	9.6098	394	1.3101	0.2278	1.3101	1.1446
No log	9.6585	396	1.3738	0.1283	1.3738	1.1721
No log	9.7073	398	1.3192	0.1219	1.3192	1.1486
No log	9.7561	400	1.2108	0.1795	1.2108	1.1004
No log	9.8049	402	1.1504	0.1795	1.1504	1.0726
No log	9.8537	404	1.1342	0.2250	1.1342	1.0650
No log	9.9024	406	1.0851	0.2304	1.0851	1.0417
No log	9.9512	408	1.1169	0.2152	1.1169	1.0568
No log	10.0	410	1.2369	0.2931	1.2369	1.1122
No log	10.0488	412	1.4106	0.3133	1.4106	1.1877
No log	10.0976	414	1.4080	0.3133	1.4080	1.1866
No log	10.1463	416	1.2700	0.3167	1.2700	1.1269
No log	10.1951	418	1.1256	0.2250	1.1256	1.0610
No log	10.2439	420	1.0622	0.1146	1.0622	1.0306
No log	10.2927	422	1.0544	0.1628	1.0544	1.0268
No log	10.3415	424	1.0673	0.2019	1.0673	1.0331
No log	10.3902	426	1.1456	0.2097	1.1456	1.0703
No log	10.4390	428	1.2475	0.3026	1.2475	1.1169
No log	10.4878	430	1.2430	0.3167	1.2430	1.1149
No log	10.5366	432	1.1781	0.2387	1.1781	1.0854
No log	10.5854	434	1.1099	0.2250	1.1099	1.0535
No log	10.6341	436	1.1180	0.2097	1.1180	1.0574
No log	10.6829	438	1.1759	0.2097	1.1759	1.0844
No log	10.7317	440	1.2349	0.3167	1.2349	1.1113
No log	10.7805	442	1.3246	0.3299	1.3246	1.1509
No log	10.8293	444	1.2808	0.3026	1.2808	1.1317
No log	10.8780	446	1.1588	0.2097	1.1588	1.0765
No log	10.9268	448	1.0664	0.2164	1.0664	1.0327
No log	10.9756	450	1.0533	0.2065	1.0533	1.0263
No log	11.0244	452	1.0749	0.2164	1.0749	1.0368
No log	11.0732	454	1.1596	0.2387	1.1596	1.0768
No log	11.1220	456	1.2373	0.2519	1.2373	1.1123
No log	11.1707	458	1.3500	0.3316	1.3500	1.1619
No log	11.2195	460	1.3616	0.3363	1.3616	1.1669
No log	11.2683	462	1.2563	0.3316	1.2563	1.1208
No log	11.3171	464	1.1857	0.2097	1.1857	1.0889
No log	11.3659	466	1.1123	0.2250	1.1123	1.0547
No log	11.4146	468	1.0917	0.1952	1.0917	1.0448
No log	11.4634	470	1.1271	0.1795	1.1271	1.0616
No log	11.5122	472	1.1855	0.2097	1.1855	1.0888
No log	11.5610	474	1.2136	0.2097	1.2136	1.1016
No log	11.6098	476	1.1870	0.2097	1.1870	1.0895
No log	11.6585	478	1.1497	0.2250	1.1497	1.0722
No log	11.7073	480	1.1712	0.2250	1.1712	1.0822
No log	11.7561	482	1.2027	0.2387	1.2027	1.0967
No log	11.8049	484	1.1964	0.2097	1.1964	1.0938
No log	11.8537	486	1.1485	0.1853	1.1485	1.0717
No log	11.9024	488	1.1053	0.2009	1.1053	1.0513
No log	11.9512	490	1.0943	0.2009	1.0943	1.0461
No log	12.0	492	1.1106	0.2304	1.1106	1.0539
No log	12.0488	494	1.1431	0.2250	1.1431	1.0692
No log	12.0976	496	1.2245	0.2097	1.2245	1.1066
No log	12.1463	498	1.2635	0.2278	1.2635	1.1240
0.3312	12.1951	500	1.2569	0.2278	1.2569	1.1211
0.3312	12.2439	502	1.1655	0.2439	1.1655	1.0796
0.3312	12.2927	504	1.1440	0.2439	1.1440	1.0696
0.3312	12.3415	506	1.1569	0.2439	1.1569	1.0756
0.3312	12.3902	508	1.2034	0.2141	1.2034	1.0970
0.3312	12.4390	510	1.3031	0.1637	1.3031	1.1415
0.3312	12.4878	512	1.3512	0.0887	1.3512	1.1624
0.3312	12.5366	514	1.3381	0.1316	1.3381	1.1568
0.3312	12.5854	516	1.2527	0.1944	1.2527	1.1192

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1