ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k13_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3130
• Qwk: 0.1477
• Mse: 1.3130
• Rmse: 1.1459

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0303	2	4.5412	0.0010	4.5412	2.1310
No log	0.0606	4	2.5952	0.0025	2.5952	1.6110
No log	0.0909	6	1.9774	0.0169	1.9774	1.4062
No log	0.1212	8	1.4364	0.0682	1.4364	1.1985
No log	0.1515	10	1.2422	0.1239	1.2422	1.1146
No log	0.1818	12	1.2489	0.1910	1.2489	1.1175
No log	0.2121	14	1.3504	0.1076	1.3504	1.1621
No log	0.2424	16	1.3516	0.1173	1.3516	1.1626
No log	0.2727	18	1.3164	0.0771	1.3164	1.1473
No log	0.3030	20	1.2870	0.1110	1.2870	1.1345
No log	0.3333	22	1.3314	0.0768	1.3314	1.1538
No log	0.3636	24	1.6891	0.0637	1.6891	1.2997
No log	0.3939	26	1.8618	-0.0156	1.8618	1.3645
No log	0.4242	28	1.6069	0.0637	1.6069	1.2676
No log	0.4545	30	1.3262	0.0811	1.3262	1.1516
No log	0.4848	32	1.2948	0.2203	1.2948	1.1379
No log	0.5152	34	1.3496	0.1834	1.3496	1.1617
No log	0.5455	36	1.3401	-0.0120	1.3401	1.1576
No log	0.5758	38	1.2543	0.0599	1.2543	1.1200
No log	0.6061	40	1.2673	0.0571	1.2673	1.1257
No log	0.6364	42	1.3361	0.0817	1.3361	1.1559
No log	0.6667	44	1.3562	0.0982	1.3562	1.1646
No log	0.6970	46	1.4030	0.1481	1.4030	1.1845
No log	0.7273	48	1.3617	0.1107	1.3617	1.1669
No log	0.7576	50	1.3778	0.1882	1.3778	1.1738
No log	0.7879	52	1.4490	0.1296	1.4490	1.2037
No log	0.8182	54	1.8022	-0.0262	1.8022	1.3425
No log	0.8485	56	1.5822	0.1524	1.5822	1.2578
No log	0.8788	58	1.2761	0.3522	1.2761	1.1296
No log	0.9091	60	1.3019	0.2707	1.3019	1.1410
No log	0.9394	62	1.3925	0.2311	1.3925	1.1800
No log	0.9697	64	1.3044	0.3394	1.3044	1.1421
No log	1.0	66	1.0326	0.3970	1.0326	1.0162
No log	1.0303	68	1.0358	0.3862	1.0358	1.0177
No log	1.0606	70	1.0185	0.4772	1.0185	1.0092
No log	1.0909	72	0.9904	0.3819	0.9904	0.9952
No log	1.1212	74	1.0680	0.3249	1.0680	1.0334
No log	1.1515	76	0.9937	0.3838	0.9937	0.9969
No log	1.1818	78	1.2729	0.1533	1.2729	1.1282
No log	1.2121	80	1.1855	0.3689	1.1855	1.0888
No log	1.2424	82	1.0455	0.4086	1.0455	1.0225
No log	1.2727	84	1.5452	0.2749	1.5452	1.2431
No log	1.3030	86	1.7469	0.2170	1.7469	1.3217
No log	1.3333	88	1.5499	0.2572	1.5499	1.2449
No log	1.3636	90	1.1913	0.3249	1.1913	1.0915
No log	1.3939	92	1.1495	0.2966	1.1495	1.0721
No log	1.4242	94	1.1482	0.3346	1.1482	1.0715
No log	1.4545	96	1.1103	0.3548	1.1103	1.0537
No log	1.4848	98	1.5504	0.3166	1.5504	1.2452
No log	1.5152	100	1.7648	0.1914	1.7648	1.3285
No log	1.5455	102	1.4439	0.3200	1.4439	1.2016
No log	1.5758	104	1.1863	0.2999	1.1863	1.0892
No log	1.6061	106	1.1411	0.2794	1.1411	1.0682
No log	1.6364	108	1.2069	0.2698	1.2069	1.0986
No log	1.6667	110	1.5976	0.1957	1.5976	1.2640
No log	1.6970	112	1.7934	0.1851	1.7934	1.3392
No log	1.7273	114	1.4839	0.2971	1.4839	1.2181
No log	1.7576	116	1.2031	0.3061	1.2031	1.0969
No log	1.7879	118	1.0797	0.2714	1.0797	1.0391
No log	1.8182	120	1.0865	0.2857	1.0865	1.0424
No log	1.8485	122	1.2249	0.2894	1.2249	1.1068
No log	1.8788	124	1.1669	0.2397	1.1669	1.0803
No log	1.9091	126	1.1572	0.3043	1.1572	1.0757
No log	1.9394	128	1.2033	0.2783	1.2033	1.0969
No log	1.9697	130	1.4179	0.2131	1.4179	1.1908
No log	2.0	132	1.9300	0.1571	1.9300	1.3892
No log	2.0303	134	1.9597	0.1700	1.9597	1.3999
No log	2.0606	136	1.6487	0.2555	1.6487	1.2840
No log	2.0909	138	1.5498	0.2510	1.5498	1.2449
No log	2.1212	140	1.7557	0.2700	1.7557	1.3250
No log	2.1515	142	1.9510	0.2102	1.9510	1.3968
No log	2.1818	144	1.5681	0.2942	1.5681	1.2523
No log	2.2121	146	1.2710	0.3098	1.2710	1.1274
No log	2.2424	148	1.1992	0.2579	1.1992	1.0951
No log	2.2727	150	1.1339	0.2773	1.1339	1.0649
No log	2.3030	152	1.1180	0.3249	1.1180	1.0573
No log	2.3333	154	1.2542	0.2918	1.2542	1.1199
No log	2.3636	156	1.3624	0.3228	1.3624	1.1672
No log	2.3939	158	1.1564	0.2864	1.1564	1.0754
No log	2.4242	160	1.1491	0.3134	1.1491	1.0720
No log	2.4545	162	1.2642	0.3166	1.2642	1.1244
No log	2.4848	164	1.4121	0.3111	1.4121	1.1883
No log	2.5152	166	1.6510	0.2838	1.6510	1.2849
No log	2.5455	168	1.5991	0.2838	1.5991	1.2646
No log	2.5758	170	1.2695	0.3361	1.2695	1.1267
No log	2.6061	172	1.0979	0.3243	1.0979	1.0478
No log	2.6364	174	1.1696	0.3151	1.1696	1.0815
No log	2.6667	176	1.4253	0.3585	1.4253	1.1938
No log	2.6970	178	1.4821	0.3371	1.4821	1.2174
No log	2.7273	180	1.3259	0.3824	1.3259	1.1515
No log	2.7576	182	1.2679	0.3261	1.2679	1.1260
No log	2.7879	184	1.1831	0.2743	1.1831	1.0877
No log	2.8182	186	1.1861	0.2542	1.1861	1.0891
No log	2.8485	188	1.2616	0.3375	1.2616	1.1232
No log	2.8788	190	1.3776	0.3797	1.3776	1.1737
No log	2.9091	192	1.3287	0.3797	1.3287	1.1527
No log	2.9394	194	1.2099	0.3458	1.2099	1.0999
No log	2.9697	196	1.2012	0.3446	1.2012	1.0960
No log	3.0	198	1.2489	0.3708	1.2489	1.1176
No log	3.0303	200	1.2534	0.3708	1.2534	1.1196
No log	3.0606	202	1.1750	0.3585	1.1750	1.0840
No log	3.0909	204	1.1871	0.3265	1.1871	1.0895
No log	3.1212	206	1.3138	0.3785	1.3138	1.1462
No log	3.1515	208	1.3144	0.3608	1.3144	1.1465
No log	3.1818	210	1.2129	0.2549	1.2129	1.1013
No log	3.2121	212	1.0563	0.3115	1.0563	1.0278
No log	3.2424	214	1.0368	0.3136	1.0368	1.0182
No log	3.2727	216	1.1669	0.2894	1.1669	1.0802
No log	3.3030	218	1.2649	0.3325	1.2649	1.1247
No log	3.3333	220	1.2095	0.3916	1.2095	1.0998
No log	3.3636	222	1.1720	0.3238	1.1720	1.0826
No log	3.3939	224	1.1417	0.3409	1.1417	1.0685
No log	3.4242	226	1.2124	0.2710	1.2124	1.1011
No log	3.4545	228	1.2652	0.2875	1.2652	1.1248
No log	3.4848	230	1.1117	0.2343	1.1117	1.0544
No log	3.5152	232	1.0566	0.2621	1.0566	1.0279
No log	3.5455	234	1.0951	0.2395	1.0951	1.0465
No log	3.5758	236	1.0669	0.3317	1.0669	1.0329
No log	3.6061	238	1.0219	0.4165	1.0219	1.0109
No log	3.6364	240	1.0278	0.4165	1.0278	1.0138
No log	3.6667	242	0.9608	0.3602	0.9608	0.9802
No log	3.6970	244	0.9483	0.3590	0.9483	0.9738
No log	3.7273	246	1.0119	0.3677	1.0119	1.0059
No log	3.7576	248	0.9707	0.3841	0.9707	0.9852
No log	3.7879	250	0.9893	0.4072	0.9893	0.9946
No log	3.8182	252	1.2396	0.3534	1.2396	1.1134
No log	3.8485	254	1.4977	0.3008	1.4977	1.2238
No log	3.8788	256	1.3726	0.3272	1.3726	1.1716
No log	3.9091	258	1.1723	0.3024	1.1723	1.0827
No log	3.9394	260	1.2478	0.3580	1.2478	1.1171
No log	3.9697	262	1.4203	0.3026	1.4203	1.1918
No log	4.0	264	1.5937	0.3093	1.5937	1.2624
No log	4.0303	266	1.3943	0.2935	1.3943	1.1808
No log	4.0606	268	1.2209	0.3548	1.2209	1.1049
No log	4.0909	270	1.1815	0.3474	1.1815	1.0870
No log	4.1212	272	1.2106	0.2956	1.2106	1.1003
No log	4.1515	274	1.2794	0.2736	1.2794	1.1311
No log	4.1818	276	1.3173	0.2704	1.3173	1.1478
No log	4.2121	278	1.2357	0.2509	1.2357	1.1116
No log	4.2424	280	1.1067	0.2248	1.1067	1.0520
No log	4.2727	282	1.1575	0.2343	1.1575	1.0759
No log	4.3030	284	1.2222	0.2417	1.2222	1.1055
No log	4.3333	286	1.4320	0.2929	1.4320	1.1967
No log	4.3636	288	1.5945	0.2739	1.5945	1.2627
No log	4.3939	290	1.5368	0.3173	1.5368	1.2397
No log	4.4242	292	1.3374	0.3067	1.3374	1.1565
No log	4.4545	294	1.1444	0.2417	1.1444	1.0698
No log	4.4848	296	1.1339	0.2417	1.1339	1.0648
No log	4.5152	298	1.1838	0.3734	1.1838	1.0880
No log	4.5455	300	1.1846	0.3947	1.1846	1.0884
No log	4.5758	302	1.2029	0.3947	1.2029	1.0968
No log	4.6061	304	1.1360	0.2509	1.1360	1.0658
No log	4.6364	306	1.0373	0.2357	1.0373	1.0185
No log	4.6667	308	1.0079	0.2772	1.0079	1.0039
No log	4.6970	310	1.0481	0.2752	1.0481	1.0237
No log	4.7273	312	1.0991	0.2558	1.0991	1.0484
No log	4.7576	314	1.0645	0.3022	1.0645	1.0318
No log	4.7879	316	1.0537	0.2752	1.0537	1.0265
No log	4.8182	318	1.1807	0.2772	1.1807	1.0866
No log	4.8485	320	1.2039	0.2743	1.2039	1.0972
No log	4.8788	322	1.1416	0.2402	1.1416	1.0684
No log	4.9091	324	1.0527	0.1701	1.0527	1.0260
No log	4.9394	326	0.9736	0.2132	0.9736	0.9867
No log	4.9697	328	0.9993	0.2522	0.9993	0.9997
No log	5.0	330	1.1461	0.2683	1.1461	1.0706
No log	5.0303	332	1.1707	0.2475	1.1707	1.0820
No log	5.0606	334	1.1855	0.2714	1.1855	1.0888
No log	5.0909	336	1.0671	0.2207	1.0671	1.0330
No log	5.1212	338	0.9729	0.1986	0.9729	0.9864
No log	5.1515	340	0.9846	0.1986	0.9846	0.9923
No log	5.1818	342	1.0850	0.2304	1.0850	1.0416
No log	5.2121	344	1.2707	0.3136	1.2707	1.1273
No log	5.2424	346	1.2706	0.3590	1.2706	1.1272
No log	5.2727	348	1.1387	0.2586	1.1387	1.0671
No log	5.3030	350	1.1271	0.2586	1.1271	1.0616
No log	5.3333	352	1.1705	0.3049	1.1705	1.0819
No log	5.3636	354	1.1467	0.2683	1.1467	1.0708
No log	5.3939	356	1.1380	0.2304	1.1380	1.0668
No log	5.4242	358	1.1505	0.2402	1.1505	1.0726
No log	5.4545	360	1.1299	0.2304	1.1299	1.0629
No log	5.4848	362	1.1974	0.2439	1.1974	1.0943
No log	5.5152	364	1.1994	0.2439	1.1994	1.0952
No log	5.5455	366	1.1219	0.2343	1.1219	1.0592
No log	5.5758	368	1.0735	0.2733	1.0735	1.0361
No log	5.6061	370	1.1188	0.3000	1.1188	1.0578
No log	5.6364	372	1.1614	0.2619	1.1614	1.0777
No log	5.6667	374	1.2140	0.3212	1.2140	1.1018
No log	5.6970	376	1.1862	0.2714	1.1862	1.0891
No log	5.7273	378	1.1942	0.2439	1.1942	1.0928
No log	5.7576	380	1.1608	0.2402	1.1608	1.0774
No log	5.7879	382	1.1454	0.2402	1.1454	1.0702
No log	5.8182	384	1.0995	0.2304	1.0995	1.0485
No log	5.8485	386	1.0588	0.2454	1.0588	1.0290
No log	5.8788	388	1.0565	0.2454	1.0565	1.0279
No log	5.9091	390	1.0621	0.2454	1.0621	1.0306
No log	5.9394	392	1.0498	0.2454	1.0498	1.0246
No log	5.9697	394	1.0985	0.3367	1.0985	1.0481
No log	6.0	396	1.1717	0.3851	1.1717	1.0824
No log	6.0303	398	1.3291	0.3752	1.3291	1.1529
No log	6.0606	400	1.3762	0.3444	1.3762	1.1731
No log	6.0909	402	1.2495	0.3800	1.2495	1.1178
No log	6.1212	404	1.0546	0.2304	1.0546	1.0269
No log	6.1515	406	0.9658	0.2752	0.9658	0.9827
No log	6.1818	408	0.9813	0.2752	0.9813	0.9906
No log	6.2121	410	1.0437	0.3629	1.0437	1.0216
No log	6.2424	412	1.1258	0.4270	1.1258	1.0611
No log	6.2727	414	1.0376	0.3540	1.0376	1.0186
No log	6.3030	416	0.9959	0.3677	0.9959	0.9979
No log	6.3333	418	0.9831	0.3069	0.9831	0.9915
No log	6.3636	420	0.9372	0.2801	0.9372	0.9681
No log	6.3939	422	0.9203	0.3191	0.9203	0.9593
No log	6.4242	424	0.9385	0.3191	0.9385	0.9688
No log	6.4545	426	0.9506	0.3069	0.9506	0.9750
No log	6.4848	428	0.9363	0.3449	0.9363	0.9676
No log	6.5152	430	0.9470	0.3191	0.9470	0.9731
No log	6.5455	432	0.9746	0.2801	0.9746	0.9872
No log	6.5758	434	0.9885	0.2801	0.9885	0.9942
No log	6.6061	436	0.9711	0.3191	0.9711	0.9855
No log	6.6364	438	0.9559	0.3191	0.9559	0.9777
No log	6.6667	440	1.0279	0.2801	1.0279	1.0138
No log	6.6970	442	1.1830	0.3474	1.1830	1.0877
No log	6.7273	444	1.2573	0.4240	1.2573	1.1213
No log	6.7576	446	1.2491	0.4027	1.2491	1.1176
No log	6.7879	448	1.3249	0.4318	1.3249	1.1510
No log	6.8182	450	1.2922	0.4238	1.2922	1.1367
No log	6.8485	452	1.2399	0.4027	1.2399	1.1135
No log	6.8788	454	1.2599	0.4237	1.2599	1.1224
No log	6.9091	456	1.3386	0.3752	1.3386	1.1570
No log	6.9394	458	1.2412	0.4030	1.2412	1.1141
No log	6.9697	460	1.2258	0.4116	1.2258	1.1072
No log	7.0	462	1.2587	0.4116	1.2587	1.1219
No log	7.0303	464	1.2199	0.3669	1.2199	1.1045
No log	7.0606	466	1.1480	0.2439	1.1480	1.0714
No log	7.0909	468	1.1049	0.1961	1.1049	1.0511
No log	7.1212	470	1.0630	0.1820	1.0630	1.0310
No log	7.1515	472	1.0949	0.1801	1.0949	1.0464
No log	7.1818	474	1.1843	0.2809	1.1843	1.0882
No log	7.2121	476	1.2242	0.3072	1.2242	1.1064
No log	7.2424	478	1.1682	0.2291	1.1682	1.0808
No log	7.2727	480	1.1093	0.1801	1.1093	1.0532
No log	7.3030	482	1.0963	0.1015	1.0963	1.0471
No log	7.3333	484	1.1065	0.1015	1.1065	1.0519
No log	7.3636	486	1.1431	0.1801	1.1431	1.0692
No log	7.3939	488	1.1864	0.2250	1.1864	1.0892
No log	7.4242	490	1.2606	0.3578	1.2606	1.1228
No log	7.4545	492	1.2828	0.3814	1.2828	1.1326
No log	7.4848	494	1.2698	0.3578	1.2698	1.1268
No log	7.5152	496	1.2147	0.2772	1.2147	1.1022
No log	7.5455	498	1.2065	0.2250	1.2065	1.0984
0.3438	7.5758	500	1.2483	0.2195	1.2483	1.1173
0.3438	7.6061	502	1.2625	0.1477	1.2625	1.1236
0.3438	7.6364	504	1.2524	0.1894	1.2524	1.1191
0.3438	7.6667	506	1.2213	0.1379	1.2213	1.1051
0.3438	7.6970	508	1.1577	0.2065	1.1577	1.0760
0.3438	7.7273	510	1.0487	0.2386	1.0487	1.0241
0.3438	7.7576	512	1.0044	0.2503	1.0044	1.0022
0.3438	7.7879	514	1.0535	0.2522	1.0535	1.0264
0.3438	7.8182	516	1.1046	0.2899	1.1046	1.0510
0.3438	7.8485	518	1.1650	0.2454	1.1650	1.0793
0.3438	7.8788	520	1.2230	0.2402	1.2230	1.1059
0.3438	7.9091	522	1.2031	0.2402	1.2031	1.0969
0.3438	7.9394	524	1.0892	0.1214	1.0892	1.0437
0.3438	7.9697	526	1.0111	0.1546	1.0111	1.0055
0.3438	8.0	528	0.9837	0.1505	0.9837	0.9918
0.3438	8.0303	530	0.9860	0.2076	0.9860	0.9930
0.3438	8.0606	532	0.9858	0.2470	0.9858	0.9929
0.3438	8.0909	534	0.9971	0.2850	0.9971	0.9986
0.3438	8.1212	536	0.9549	0.2752	0.9549	0.9772
0.3438	8.1515	538	0.9008	0.3317	0.9008	0.9491
0.3438	8.1818	540	0.8765	0.3045	0.8765	0.9362
0.3438	8.2121	542	0.8950	0.3045	0.8950	0.9460
0.3438	8.2424	544	0.9254	0.2522	0.9254	0.9620
0.3438	8.2727	546	0.9888	0.2506	0.9888	0.9944
0.3438	8.3030	548	1.0846	0.3117	1.0846	1.0414
0.3438	8.3333	550	1.0982	0.2304	1.0982	1.0480
0.3438	8.3636	552	1.0682	0.1761	1.0682	1.0335
0.3438	8.3939	554	1.0675	0.1761	1.0675	1.0332
0.3438	8.4242	556	1.0927	0.1180	1.0927	1.0453
0.3438	8.4545	558	1.1964	0.0948	1.1964	1.0938
0.3438	8.4848	560	1.3130	0.1477	1.3130	1.1459

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1