ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k10_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3531
• Qwk: 0.1541
• Mse: 1.3531
• Rmse: 1.1632

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	4.5272	0.0010	4.5272	2.1277
No log	0.0769	4	2.5102	0.0163	2.5102	1.5844
No log	0.1154	6	1.7013	0.0062	1.7013	1.3044
No log	0.1538	8	1.3742	0.0290	1.3742	1.1723
No log	0.1923	10	1.3086	0.1413	1.3086	1.1439
No log	0.2308	12	1.3891	0.1174	1.3891	1.1786
No log	0.2692	14	1.3810	0.0704	1.3810	1.1752
No log	0.3077	16	1.2298	0.1852	1.2298	1.1090
No log	0.3462	18	1.1919	0.2784	1.1919	1.0917
No log	0.3846	20	1.2905	0.1288	1.2905	1.1360
No log	0.4231	22	1.2672	0.0984	1.2672	1.1257
No log	0.4615	24	1.2157	0.2632	1.2157	1.1026
No log	0.5	26	1.1757	0.1935	1.1757	1.0843
No log	0.5385	28	1.1821	0.2478	1.1821	1.0872
No log	0.5769	30	1.1970	0.2684	1.1970	1.0941
No log	0.6154	32	1.2635	0.1138	1.2635	1.1241
No log	0.6538	34	1.4264	0.0426	1.4264	1.1943
No log	0.6923	36	1.4317	0.0723	1.4317	1.1965
No log	0.7308	38	1.2785	0.1045	1.2785	1.1307
No log	0.7692	40	1.1736	0.2416	1.1736	1.0833
No log	0.8077	42	1.2034	0.1379	1.2034	1.0970
No log	0.8462	44	1.2571	0.1042	1.2571	1.1212
No log	0.8846	46	1.3058	0.1110	1.3058	1.1427
No log	0.9231	48	1.3135	0.0847	1.3135	1.1461
No log	0.9615	50	1.3281	0.0600	1.3281	1.1524
No log	1.0	52	1.3174	0.0161	1.3174	1.1478
No log	1.0385	54	1.2603	0.1632	1.2603	1.1226
No log	1.0769	56	1.2831	0.0527	1.2831	1.1327
No log	1.1154	58	1.3137	0.1247	1.3137	1.1462
No log	1.1538	60	1.2933	0.0353	1.2933	1.1372
No log	1.1923	62	1.2947	0.0958	1.2947	1.1379
No log	1.2308	64	1.3194	0.1431	1.3194	1.1486
No log	1.2692	66	1.4041	0.0741	1.4041	1.1849
No log	1.3077	68	1.6870	0.1960	1.6870	1.2989
No log	1.3462	70	1.6491	0.1616	1.6491	1.2842
No log	1.3846	72	1.3982	0.1500	1.3982	1.1825
No log	1.4231	74	1.3101	0.1488	1.3101	1.1446
No log	1.4615	76	1.3030	0.1488	1.3030	1.1415
No log	1.5	78	1.3092	0.1928	1.3092	1.1442
No log	1.5385	80	1.3598	0.2056	1.3598	1.1661
No log	1.5769	82	1.4322	0.2105	1.4322	1.1968
No log	1.6154	84	1.3490	0.1943	1.3490	1.1615
No log	1.6538	86	1.2558	0.1548	1.2558	1.1206
No log	1.6923	88	1.2517	0.1491	1.2517	1.1188
No log	1.7308	90	1.2335	0.2134	1.2335	1.1106
No log	1.7692	92	1.4080	0.3324	1.4080	1.1866
No log	1.8077	94	1.6261	0.2188	1.6261	1.2752
No log	1.8462	96	1.5604	0.2285	1.5604	1.2492
No log	1.8846	98	1.3958	0.1929	1.3958	1.1815
No log	1.9231	100	1.2748	0.2602	1.2748	1.1291
No log	1.9615	102	1.2239	0.2686	1.2239	1.1063
No log	2.0	104	1.2487	0.2446	1.2487	1.1175
No log	2.0385	106	1.3548	0.2354	1.3548	1.1640
No log	2.0769	108	1.3006	0.2909	1.3006	1.1404
No log	2.1154	110	1.2437	0.2735	1.2437	1.1152
No log	2.1538	112	1.2915	0.2458	1.2915	1.1364
No log	2.1923	114	1.4661	0.2206	1.4661	1.2108
No log	2.2308	116	1.5597	0.2314	1.5597	1.2489
No log	2.2692	118	1.6123	0.1966	1.6123	1.2698
No log	2.3077	120	1.5634	0.1255	1.5634	1.2503
No log	2.3462	122	1.5908	0.1590	1.5908	1.2613
No log	2.3846	124	1.7406	0.2270	1.7406	1.3193
No log	2.4231	126	1.7438	0.2376	1.7438	1.3205
No log	2.4615	128	1.6586	0.1685	1.6586	1.2879
No log	2.5	130	1.5773	0.1673	1.5773	1.2559
No log	2.5385	132	1.4964	0.0234	1.4964	1.2233
No log	2.5769	134	1.4823	0.1185	1.4823	1.2175
No log	2.6154	136	1.6388	0.1547	1.6388	1.2802
No log	2.6538	138	1.8417	0.2656	1.8417	1.3571
No log	2.6923	140	1.9305	0.1417	1.9305	1.3894
No log	2.7308	142	1.6898	0.2514	1.6898	1.2999
No log	2.7692	144	1.4706	0.2164	1.4706	1.2127
No log	2.8077	146	1.4799	0.2248	1.4799	1.2165
No log	2.8462	148	1.5239	0.2226	1.5239	1.2344
No log	2.8846	150	1.5382	0.1817	1.5382	1.2402
No log	2.9231	152	1.4511	0.1560	1.4511	1.2046
No log	2.9615	154	1.4455	0.1492	1.4455	1.2023
No log	3.0	156	1.4899	0.1670	1.4899	1.2206
No log	3.0385	158	1.5752	0.2857	1.5752	1.2551
No log	3.0769	160	1.5962	0.2505	1.5962	1.2634
No log	3.1154	162	1.5241	0.1910	1.5241	1.2346
No log	3.1538	164	1.5973	0.2123	1.5973	1.2638
No log	3.1923	166	1.7028	0.1619	1.7028	1.3049
No log	3.2308	168	1.6523	0.2164	1.6523	1.2854
No log	3.2692	170	1.5374	0.1438	1.5374	1.2399
No log	3.3077	172	1.4243	0.1834	1.4243	1.1935
No log	3.3462	174	1.4800	0.2345	1.4800	1.2166
No log	3.3846	176	1.6836	0.0533	1.6836	1.2975
No log	3.4231	178	1.9461	0.0618	1.9461	1.3950
No log	3.4615	180	1.9745	0.0668	1.9745	1.4052
No log	3.5	182	1.6871	0.1135	1.6871	1.2989
No log	3.5385	184	1.3936	0.2248	1.3936	1.1805
No log	3.5769	186	1.3245	0.2123	1.3245	1.1509
No log	3.6154	188	1.3383	0.2716	1.3383	1.1568
No log	3.6538	190	1.5496	0.1009	1.5496	1.2448
No log	3.6923	192	1.6542	0.1767	1.6542	1.2861
No log	3.7308	194	1.5363	0.1929	1.5363	1.2395
No log	3.7692	196	1.3887	0.2466	1.3887	1.1784
No log	3.8077	198	1.3624	0.2375	1.3624	1.1672
No log	3.8462	200	1.3321	0.2547	1.3321	1.1542
No log	3.8846	202	1.4416	0.2635	1.4416	1.2007
No log	3.9231	204	1.4434	0.2783	1.4434	1.2014
No log	3.9615	206	1.3979	0.3121	1.3979	1.1823
No log	4.0	208	1.3367	0.2937	1.3367	1.1561
No log	4.0385	210	1.3548	0.3325	1.3548	1.1640
No log	4.0769	212	1.4045	0.3261	1.4045	1.1851
No log	4.1154	214	1.3298	0.2263	1.3298	1.1532
No log	4.1538	216	1.3011	0.2590	1.3011	1.1407
No log	4.1923	218	1.3411	0.2738	1.3411	1.1581
No log	4.2308	220	1.3759	0.2738	1.3759	1.1730
No log	4.2692	222	1.5212	0.3064	1.5212	1.2334
No log	4.3077	224	1.4887	0.2145	1.4887	1.2201
No log	4.3462	226	1.4231	0.2485	1.4231	1.1930
No log	4.3846	228	1.3195	0.1769	1.3195	1.1487
No log	4.4231	230	1.2667	0.1548	1.2667	1.1255
No log	4.4615	232	1.2879	0.1584	1.2879	1.1349
No log	4.5	234	1.3976	0.2650	1.3976	1.1822
No log	4.5385	236	1.4474	0.2173	1.4474	1.2031
No log	4.5769	238	1.3927	0.2650	1.3927	1.1801
No log	4.6154	240	1.4255	0.2084	1.4255	1.1939
No log	4.6538	242	1.4419	0.2084	1.4419	1.2008
No log	4.6923	244	1.3679	0.2288	1.3679	1.1696
No log	4.7308	246	1.3239	0.1968	1.3239	1.1506
No log	4.7692	248	1.3796	0.1903	1.3796	1.1746
No log	4.8077	250	1.4953	0.1761	1.4953	1.2228
No log	4.8462	252	1.4759	0.1761	1.4759	1.2148
No log	4.8846	254	1.3391	0.1911	1.3391	1.1572
No log	4.9231	256	1.2953	0.1211	1.2953	1.1381
No log	4.9615	258	1.2913	0.1211	1.2913	1.1364
No log	5.0	260	1.2964	0.2522	1.2964	1.1386
No log	5.0385	262	1.4206	0.1850	1.4206	1.1919
No log	5.0769	264	1.4430	0.1795	1.4430	1.2012
No log	5.1154	266	1.4151	0.1554	1.4151	1.1896
No log	5.1538	268	1.3395	0.2304	1.3395	1.1574
No log	5.1923	270	1.3026	0.2772	1.3026	1.1413
No log	5.2308	272	1.3140	0.2424	1.3140	1.1463
No log	5.2692	274	1.3524	0.2375	1.3524	1.1629
No log	5.3077	276	1.3740	0.2375	1.3740	1.1722
No log	5.3462	278	1.3042	0.2506	1.3042	1.1420
No log	5.3846	280	1.2661	0.2273	1.2661	1.1252
No log	5.4231	282	1.2524	0.2470	1.2524	1.1191
No log	5.4615	284	1.2848	0.2065	1.2848	1.1335
No log	5.5	286	1.3240	0.1405	1.3240	1.1507
No log	5.5385	288	1.4036	0.1597	1.4036	1.1847
No log	5.5769	290	1.4651	0.1687	1.4651	1.2104
No log	5.6154	292	1.3764	0.2568	1.3764	1.1732
No log	5.6538	294	1.3032	0.2800	1.3032	1.1416
No log	5.6923	296	1.2685	0.2610	1.2685	1.1263
No log	5.7308	298	1.2665	0.2506	1.2665	1.1254
No log	5.7692	300	1.3961	0.2846	1.3961	1.1816
No log	5.8077	302	1.5751	0.2531	1.5751	1.2550
No log	5.8462	304	1.6708	0.2508	1.6708	1.2926
No log	5.8846	306	1.5955	0.2610	1.5955	1.2631
No log	5.9231	308	1.4503	0.2054	1.4503	1.2043
No log	5.9615	310	1.2420	0.2461	1.2420	1.1145
No log	6.0	312	1.1801	0.1628	1.1801	1.0863
No log	6.0385	314	1.1614	0.1986	1.1614	1.0777
No log	6.0769	316	1.1718	0.1935	1.1718	1.0825
No log	6.1154	318	1.2397	0.2028	1.2397	1.1134
No log	6.1538	320	1.3106	0.1310	1.3106	1.1448
No log	6.1923	322	1.3477	0.1864	1.3477	1.1609
No log	6.2308	324	1.3302	0.2246	1.3302	1.1533
No log	6.2692	326	1.3665	0.2147	1.3665	1.1690
No log	6.3077	328	1.3388	0.2191	1.3388	1.1571
No log	6.3462	330	1.3101	0.2708	1.3101	1.1446
No log	6.3846	332	1.3746	0.2791	1.3746	1.1724
No log	6.4231	334	1.3895	0.2559	1.3895	1.1788
No log	6.4615	336	1.3392	0.2164	1.3392	1.1572
No log	6.5	338	1.2617	0.2154	1.2617	1.1233
No log	6.5385	340	1.2623	0.1911	1.2623	1.1235
No log	6.5769	342	1.2590	0.1379	1.2590	1.1220
No log	6.6154	344	1.2342	0.1114	1.2342	1.1110
No log	6.6538	346	1.2402	0.1443	1.2402	1.1137
No log	6.6923	348	1.2359	0.1662	1.2359	1.1117
No log	6.7308	350	1.2462	0.2260	1.2462	1.1163
No log	6.7692	352	1.3258	0.2466	1.3258	1.1514
No log	6.8077	354	1.3485	0.2485	1.3485	1.1613
No log	6.8462	356	1.3308	0.2485	1.3308	1.1536
No log	6.8846	358	1.2231	0.1920	1.2231	1.1060
No log	6.9231	360	1.1670	0.1431	1.1670	1.0803
No log	6.9615	362	1.1536	0.2089	1.1536	1.0741
No log	7.0	364	1.1803	0.1825	1.1803	1.0864
No log	7.0385	366	1.2866	0.2103	1.2866	1.1343
No log	7.0769	368	1.3533	0.2485	1.3533	1.1633
No log	7.1154	370	1.2811	0.2300	1.2811	1.1318
No log	7.1538	372	1.2064	0.2365	1.2064	1.0984
No log	7.1923	374	1.2110	0.2230	1.2110	1.1004
No log	7.2308	376	1.2471	0.2260	1.2471	1.1167
No log	7.2692	378	1.2634	0.2260	1.2634	1.1240
No log	7.3077	380	1.2237	0.2371	1.2237	1.1062
No log	7.3462	382	1.2125	0.2230	1.2125	1.1011
No log	7.3846	384	1.2298	0.2218	1.2298	1.1090
No log	7.4231	386	1.2879	0.2395	1.2879	1.1349
No log	7.4615	388	1.3500	0.1308	1.3500	1.1619
No log	7.5	390	1.3160	0.2357	1.3160	1.1472
No log	7.5385	392	1.2435	0.2327	1.2435	1.1151
No log	7.5769	394	1.2310	0.2134	1.2310	1.1095
No log	7.6154	396	1.2505	0.1935	1.2505	1.1183
No log	7.6538	398	1.2730	0.1871	1.2730	1.1283
No log	7.6923	400	1.3590	0.1429	1.3590	1.1658
No log	7.7308	402	1.4378	0.1251	1.4378	1.1991
No log	7.7692	404	1.4142	0.1101	1.4142	1.1892
No log	7.8077	406	1.3384	0.1429	1.3384	1.1569
No log	7.8462	408	1.3494	0.1485	1.3494	1.1616
No log	7.8846	410	1.4560	0.1126	1.4560	1.2067
No log	7.9231	412	1.5474	0.1618	1.5474	1.2439
No log	7.9615	414	1.5102	0.1281	1.5102	1.2289
No log	8.0	416	1.4914	0.1335	1.4914	1.2212
No log	8.0385	418	1.4305	0.1519	1.4305	1.1960
No log	8.0769	420	1.3588	0.1959	1.3588	1.1657
No log	8.1154	422	1.3463	0.1712	1.3463	1.1603
No log	8.1538	424	1.3734	0.1764	1.3734	1.1719
No log	8.1923	426	1.4667	0.1438	1.4667	1.2111
No log	8.2308	428	1.5976	0.1028	1.5976	1.2640
No log	8.2692	430	1.6444	0.0938	1.6444	1.2823
No log	8.3077	432	1.5836	0.1009	1.5836	1.2584
No log	8.3462	434	1.4318	0.1611	1.4318	1.1966
No log	8.3846	436	1.3009	0.1919	1.3009	1.1406
No log	8.4231	438	1.2643	0.2231	1.2643	1.1244
No log	8.4615	440	1.2712	0.1646	1.2712	1.1275
No log	8.5	442	1.2788	0.1054	1.2788	1.1309
No log	8.5385	444	1.2715	0.1683	1.2715	1.1276
No log	8.5769	446	1.2950	0.1919	1.2950	1.1380
No log	8.6154	448	1.3742	0.1311	1.3742	1.1723
No log	8.6538	450	1.4102	0.1614	1.4102	1.1875
No log	8.6923	452	1.3656	0.2060	1.3656	1.1686
No log	8.7308	454	1.3358	0.2079	1.3358	1.1558
No log	8.7692	456	1.3476	0.2113	1.3476	1.1608
No log	8.8077	458	1.3911	0.2144	1.3911	1.1795
No log	8.8462	460	1.4304	0.1418	1.4304	1.1960
No log	8.8846	462	1.4318	0.1334	1.4318	1.1966
No log	8.9231	464	1.3231	0.1958	1.3231	1.1503
No log	8.9615	466	1.2406	0.2079	1.2406	1.1138
No log	9.0	468	1.2281	0.2134	1.2281	1.1082
No log	9.0385	470	1.2346	0.2134	1.2346	1.1111
No log	9.0769	472	1.2779	0.2121	1.2779	1.1304
No log	9.1154	474	1.3807	0.1364	1.3807	1.1750
No log	9.1538	476	1.4146	0.1641	1.4146	1.1894
No log	9.1923	478	1.3859	0.1364	1.3859	1.1772
No log	9.2308	480	1.3128	0.1245	1.3128	1.1458
No log	9.2692	482	1.2916	0.2134	1.2916	1.1365
No log	9.3077	484	1.2967	0.2283	1.2967	1.1387
No log	9.3462	486	1.3147	0.2283	1.3147	1.1466
No log	9.3846	488	1.3681	0.1396	1.3681	1.1697
No log	9.4231	490	1.4952	0.1171	1.4952	1.2228
No log	9.4615	492	1.6264	0.1777	1.6264	1.2753
No log	9.5	494	1.6823	0.1637	1.6823	1.2970
No log	9.5385	496	1.6430	0.1212	1.6430	1.2818
No log	9.5769	498	1.6228	0.1602	1.6228	1.2739
0.3429	9.6154	500	1.4912	0.1742	1.4912	1.2211
0.3429	9.6538	502	1.3483	0.2310	1.3483	1.1612
0.3429	9.6923	504	1.3191	0.2134	1.3191	1.1485
0.3429	9.7308	506	1.3121	0.2134	1.3121	1.1455
0.3429	9.7692	508	1.3562	0.1247	1.3562	1.1645
0.3429	9.8077	510	1.3916	0.1037	1.3916	1.1797
0.3429	9.8462	512	1.3927	0.0885	1.3927	1.1801
0.3429	9.8846	514	1.3816	0.1190	1.3816	1.1754
0.3429	9.9231	516	1.3531	0.1541	1.3531	1.1632

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1