ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k9_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4806
• Qwk: 0.4328
• Mse: 1.4806
• Rmse: 1.2168

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0476	2	6.8649	0.0	6.8649	2.6201
No log	0.0952	4	4.5736	0.0167	4.5736	2.1386
No log	0.1429	6	5.5296	-0.0741	5.5296	2.3515
No log	0.1905	8	5.0320	-0.0978	5.0320	2.2432
No log	0.2381	10	3.0356	0.0128	3.0356	1.7423
No log	0.2857	12	2.2545	0.1159	2.2545	1.5015
No log	0.3333	14	2.0765	0.2273	2.0765	1.4410
No log	0.3810	16	1.9419	0.2031	1.9419	1.3935
No log	0.4286	18	1.9181	0.2295	1.9181	1.3850
No log	0.4762	20	1.9996	0.1719	1.9996	1.4141
No log	0.5238	22	1.8527	0.256	1.8527	1.3611
No log	0.5714	24	1.8725	0.24	1.8725	1.3684
No log	0.6190	26	1.8925	0.2114	1.8925	1.3757
No log	0.6667	28	1.7913	0.2435	1.7913	1.3384
No log	0.7143	30	1.7861	0.1429	1.7861	1.3365
No log	0.7619	32	1.6795	0.1308	1.6795	1.2960
No log	0.8095	34	1.5665	0.2857	1.5665	1.2516
No log	0.8571	36	1.7427	0.3780	1.7427	1.3201
No log	0.9048	38	1.7724	0.3876	1.7724	1.3313
No log	0.9524	40	1.5857	0.3871	1.5857	1.2592
No log	1.0	42	1.5441	0.3130	1.5441	1.2426
No log	1.0476	44	1.6772	0.1724	1.6772	1.2951
No log	1.0952	46	1.6307	0.1930	1.6307	1.2770
No log	1.1429	48	1.3045	0.4167	1.3045	1.1421
No log	1.1905	50	1.2939	0.4882	1.2939	1.1375
No log	1.2381	52	1.2627	0.5039	1.2627	1.1237
No log	1.2857	54	1.1153	0.5041	1.1153	1.0561
No log	1.3333	56	1.2624	0.4174	1.2624	1.1236
No log	1.3810	58	1.3844	0.3860	1.3844	1.1766
No log	1.4286	60	1.2953	0.4483	1.2953	1.1381
No log	1.4762	62	1.2741	0.4615	1.2741	1.1287
No log	1.5238	64	1.2698	0.4237	1.2698	1.1268
No log	1.5714	66	1.6762	0.2632	1.6762	1.2947
No log	1.6190	68	2.5322	-0.0351	2.5322	1.5913
No log	1.6667	70	2.2247	0.0171	2.2247	1.4916
No log	1.7143	72	1.3870	0.4167	1.3870	1.1777
No log	1.7619	74	1.1692	0.4959	1.1692	1.0813
No log	1.8095	76	1.3444	0.5203	1.3444	1.1595
No log	1.8571	78	1.6867	0.2951	1.6867	1.2987
No log	1.9048	80	1.5665	0.3594	1.5665	1.2516
No log	1.9524	82	1.3313	0.4462	1.3313	1.1538
No log	2.0	84	1.0234	0.6107	1.0234	1.0116
No log	2.0476	86	1.2066	0.5496	1.2066	1.0984
No log	2.0952	88	1.6168	0.3721	1.6168	1.2715
No log	2.1429	90	1.8256	0.2344	1.8256	1.3511
No log	2.1905	92	1.5318	0.3969	1.5318	1.2376
No log	2.2381	94	1.2333	0.5161	1.2333	1.1105
No log	2.2857	96	1.2671	0.5323	1.2671	1.1256
No log	2.3333	98	1.7314	0.2742	1.7314	1.3158
No log	2.3810	100	2.2677	0.0165	2.2677	1.5059
No log	2.4286	102	2.4681	-0.1368	2.4681	1.5710
No log	2.4762	104	2.2797	-0.1228	2.2797	1.5099
No log	2.5238	106	2.0145	0.0893	2.0145	1.4193
No log	2.5714	108	2.0915	0.0702	2.0915	1.4462
No log	2.6190	110	2.2204	-0.0174	2.2204	1.4901
No log	2.6667	112	1.8201	0.2783	1.8201	1.3491
No log	2.7143	114	1.5162	0.4034	1.5162	1.2313
No log	2.7619	116	1.3081	0.4426	1.3081	1.1437
No log	2.8095	118	1.2736	0.4918	1.2736	1.1286
No log	2.8571	120	1.5513	0.3053	1.5513	1.2455
No log	2.9048	122	1.7810	0.2154	1.7810	1.3346
No log	2.9524	124	1.7776	0.2764	1.7776	1.3333
No log	3.0	126	1.5684	0.3740	1.5684	1.2524
No log	3.0476	128	1.5129	0.3967	1.5129	1.2300
No log	3.0952	130	1.6401	0.3548	1.6401	1.2807
No log	3.1429	132	1.6722	0.3680	1.6722	1.2931
No log	3.1905	134	1.5501	0.4160	1.5501	1.2450
No log	3.2381	136	1.5192	0.4160	1.5192	1.2326
No log	3.2857	138	1.6550	0.3759	1.6550	1.2865
No log	3.3333	140	1.8187	0.2590	1.8187	1.3486
No log	3.3810	142	1.6915	0.2734	1.6915	1.3006
No log	3.4286	144	1.2760	0.5231	1.2760	1.1296
No log	3.4762	146	1.1802	0.5039	1.1802	1.0864
No log	3.5238	148	1.3025	0.4885	1.3025	1.1413
No log	3.5714	150	1.4429	0.4444	1.4429	1.2012
No log	3.6190	152	1.5218	0.4179	1.5218	1.2336
No log	3.6667	154	1.5325	0.4091	1.5325	1.2380
No log	3.7143	156	1.4712	0.4603	1.4712	1.2129
No log	3.7619	158	1.3343	0.4667	1.3343	1.1551
No log	3.8095	160	1.2196	0.3036	1.2196	1.1044
No log	3.8571	162	1.2491	0.3509	1.2491	1.1176
No log	3.9048	164	1.4117	0.4068	1.4117	1.1881
No log	3.9524	166	1.5713	0.4132	1.5713	1.2535
No log	4.0	168	1.5874	0.4160	1.5874	1.2599
No log	4.0476	170	1.6156	0.3906	1.6156	1.2711
No log	4.0952	172	1.5522	0.4094	1.5522	1.2459
No log	4.1429	174	1.3933	0.4463	1.3933	1.1804
No log	4.1905	176	1.2902	0.3966	1.2902	1.1359
No log	4.2381	178	1.3919	0.4211	1.3919	1.1798
No log	4.2857	180	1.5316	0.4035	1.5316	1.2376
No log	4.3333	182	1.4482	0.3894	1.4482	1.2034
No log	4.3810	184	1.2379	0.3273	1.2379	1.1126
No log	4.4286	186	1.1366	0.4828	1.1366	1.0661
No log	4.4762	188	1.1005	0.4522	1.1005	1.0490
No log	4.5238	190	1.2747	0.4237	1.2747	1.1290
No log	4.5714	192	1.4461	0.4	1.4461	1.2025
No log	4.6190	194	1.3459	0.4333	1.3459	1.1601
No log	4.6667	196	1.2188	0.544	1.2188	1.1040
No log	4.7143	198	1.2132	0.544	1.2132	1.1014
No log	4.7619	200	1.3596	0.4677	1.3596	1.1660
No log	4.8095	202	1.6621	0.2222	1.6621	1.2892
No log	4.8571	204	1.7737	0.2063	1.7737	1.3318
No log	4.9048	206	1.5988	0.2787	1.5988	1.2645
No log	4.9524	208	1.3469	0.4538	1.3469	1.1606
No log	5.0	210	1.3017	0.4706	1.3017	1.1409
No log	5.0476	212	1.4567	0.3793	1.4567	1.2069
No log	5.0952	214	1.5073	0.4065	1.5073	1.2277
No log	5.1429	216	1.3921	0.4160	1.3921	1.1799
No log	5.1905	218	1.3263	0.4961	1.3263	1.1517
No log	5.2381	220	1.4095	0.4697	1.4095	1.1872
No log	5.2857	222	1.6248	0.3731	1.6248	1.2747
No log	5.3333	224	1.6707	0.3556	1.6707	1.2925
No log	5.3810	226	1.4682	0.4341	1.4682	1.2117
No log	5.4286	228	1.2078	0.5124	1.2078	1.0990
No log	5.4762	230	1.1355	0.4615	1.1355	1.0656
No log	5.5238	232	1.1494	0.4	1.1494	1.0721
No log	5.5714	234	1.2763	0.4310	1.2763	1.1297
No log	5.6190	236	1.4450	0.4103	1.4450	1.2021
No log	5.6667	238	1.4825	0.4	1.4825	1.2176
No log	5.7143	240	1.5004	0.4	1.5004	1.2249
No log	5.7619	242	1.4563	0.4132	1.4563	1.2068
No log	5.8095	244	1.3665	0.4167	1.3665	1.1690
No log	5.8571	246	1.3853	0.3710	1.3853	1.1770
No log	5.9048	248	1.4145	0.4094	1.4145	1.1893
No log	5.9524	250	1.6257	0.3759	1.6257	1.2750
No log	6.0	252	1.7349	0.3235	1.7349	1.3172
No log	6.0476	254	1.6305	0.3731	1.6305	1.2769
No log	6.0952	256	1.3391	0.4462	1.3391	1.1572
No log	6.1429	258	1.2252	0.4918	1.2252	1.1069
No log	6.1905	260	1.2523	0.4370	1.2523	1.1191
No log	6.2381	262	1.2694	0.4667	1.2694	1.1267
No log	6.2857	264	1.3468	0.3966	1.3468	1.1605
No log	6.3333	266	1.4683	0.4068	1.4683	1.2117
No log	6.3810	268	1.5512	0.3866	1.5512	1.2455
No log	6.4286	270	1.5545	0.4	1.5545	1.2468
No log	6.4762	272	1.5165	0.4	1.5165	1.2314
No log	6.5238	274	1.4341	0.4237	1.4341	1.1975
No log	6.5714	276	1.3370	0.4103	1.3370	1.1563
No log	6.6190	278	1.3570	0.3966	1.3570	1.1649
No log	6.6667	280	1.4689	0.4103	1.4689	1.2120
No log	6.7143	282	1.5884	0.3363	1.5884	1.2603
No log	6.7619	284	1.5990	0.3652	1.5990	1.2645
No log	6.8095	286	1.5332	0.3833	1.5332	1.2382
No log	6.8571	288	1.4466	0.4062	1.4466	1.2028
No log	6.9048	290	1.3970	0.4186	1.3970	1.1820
No log	6.9524	292	1.4624	0.4580	1.4624	1.2093
No log	7.0	294	1.4378	0.4580	1.4378	1.1991
No log	7.0476	296	1.3794	0.4651	1.3794	1.1745
No log	7.0952	298	1.3847	0.4651	1.3847	1.1767
No log	7.1429	300	1.4522	0.4531	1.4522	1.2051
No log	7.1905	302	1.4489	0.4553	1.4489	1.2037
No log	7.2381	304	1.3620	0.5203	1.3620	1.1670
No log	7.2857	306	1.2839	0.4615	1.2839	1.1331
No log	7.3333	308	1.2581	0.4793	1.2581	1.1216
No log	7.3810	310	1.2173	0.5041	1.2173	1.1033
No log	7.4286	312	1.2202	0.5	1.2202	1.1046
No log	7.4762	314	1.3416	0.4724	1.3416	1.1583
No log	7.5238	316	1.4531	0.4308	1.4531	1.2054
No log	7.5714	318	1.4141	0.4724	1.4141	1.1892
No log	7.6190	320	1.2781	0.4839	1.2781	1.1305
No log	7.6667	322	1.2331	0.4878	1.2331	1.1104
No log	7.7143	324	1.3340	0.4463	1.3340	1.1550
No log	7.7619	326	1.4333	0.4202	1.4333	1.1972
No log	7.8095	328	1.4118	0.4538	1.4118	1.1882
No log	7.8571	330	1.2408	0.4444	1.2408	1.1139
No log	7.9048	332	1.1833	0.5042	1.1833	1.0878
No log	7.9524	334	1.2109	0.4615	1.2109	1.1004
No log	8.0	336	1.3029	0.4655	1.3029	1.1414
No log	8.0476	338	1.4926	0.4444	1.4926	1.2217
No log	8.0952	340	1.5980	0.3621	1.5980	1.2641
No log	8.1429	342	1.6202	0.3932	1.6202	1.2729
No log	8.1905	344	1.5936	0.3898	1.5936	1.2624
No log	8.2381	346	1.4731	0.4628	1.4731	1.2137
No log	8.2857	348	1.4102	0.4444	1.4102	1.1875
No log	8.3333	350	1.4842	0.4310	1.4842	1.2183
No log	8.3810	352	1.5467	0.4103	1.5467	1.2437
No log	8.4286	354	1.6255	0.3590	1.6255	1.2749
No log	8.4762	356	1.6174	0.3793	1.6174	1.2718
No log	8.5238	358	1.6759	0.3390	1.6759	1.2945
No log	8.5714	360	1.6692	0.3248	1.6692	1.2920
No log	8.6190	362	1.5911	0.3590	1.5911	1.2614
No log	8.6667	364	1.5402	0.3871	1.5402	1.2410
No log	8.7143	366	1.4451	0.4793	1.4451	1.2021
No log	8.7619	368	1.4208	0.4407	1.4208	1.1920
No log	8.8095	370	1.4478	0.4538	1.4478	1.2032
No log	8.8571	372	1.4552	0.4878	1.4552	1.2063
No log	8.9048	374	1.4481	0.5079	1.4481	1.2034
No log	8.9524	376	1.5292	0.4615	1.5292	1.2366
No log	9.0	378	1.5066	0.4545	1.5066	1.2274
No log	9.0476	380	1.3011	0.5397	1.3011	1.1407
No log	9.0952	382	1.2122	0.544	1.2122	1.1010
No log	9.1429	384	1.2617	0.5397	1.2617	1.1233
No log	9.1905	386	1.3895	0.4923	1.3895	1.1788
No log	9.2381	388	1.3646	0.4961	1.3646	1.1682
No log	9.2857	390	1.2864	0.5197	1.2864	1.1342
No log	9.3333	392	1.1365	0.544	1.1365	1.0661
No log	9.3810	394	1.1336	0.544	1.1336	1.0647
No log	9.4286	396	1.1394	0.544	1.1394	1.0674
No log	9.4762	398	1.1316	0.5556	1.1316	1.0637
No log	9.5238	400	1.2349	0.5238	1.2349	1.1113
No log	9.5714	402	1.3771	0.4882	1.3771	1.1735
No log	9.6190	404	1.3977	0.4882	1.3977	1.1822
No log	9.6667	406	1.3375	0.5469	1.3375	1.1565
No log	9.7143	408	1.2732	0.5469	1.2732	1.1284
No log	9.7619	410	1.1862	0.5512	1.1862	1.0891
No log	9.8095	412	1.1657	0.5512	1.1657	1.0797
No log	9.8571	414	1.2168	0.5469	1.2168	1.1031
No log	9.9048	416	1.2057	0.5397	1.2057	1.0981
No log	9.9524	418	1.1937	0.5512	1.1937	1.0926
No log	10.0	420	1.2107	0.5512	1.2107	1.1003
No log	10.0476	422	1.2514	0.5469	1.2514	1.1187
No log	10.0952	424	1.2516	0.5512	1.2516	1.1187
No log	10.1429	426	1.2484	0.5512	1.2484	1.1173
No log	10.1905	428	1.2961	0.5469	1.2961	1.1385
No log	10.2381	430	1.3389	0.5469	1.3389	1.1571
No log	10.2857	432	1.3315	0.5469	1.3315	1.1539
No log	10.3333	434	1.2639	0.5512	1.2639	1.1243
No log	10.3810	436	1.1692	0.5366	1.1692	1.0813
No log	10.4286	438	1.1378	0.4274	1.1378	1.0667
No log	10.4762	440	1.1647	0.4706	1.1647	1.0792
No log	10.5238	442	1.2633	0.5556	1.2633	1.1240
No log	10.5714	444	1.4137	0.4651	1.4137	1.1890
No log	10.6190	446	1.5118	0.4462	1.5118	1.2295
No log	10.6667	448	1.5357	0.4651	1.5357	1.2392
No log	10.7143	450	1.4497	0.5238	1.4497	1.2040
No log	10.7619	452	1.3616	0.5366	1.3616	1.1669
No log	10.8095	454	1.3720	0.4103	1.3720	1.1713
No log	10.8571	456	1.4714	0.4793	1.4714	1.2130
No log	10.9048	458	1.6142	0.4590	1.6142	1.2705
No log	10.9524	460	1.6871	0.4516	1.6871	1.2989
No log	11.0	462	1.6456	0.4590	1.6456	1.2828
No log	11.0476	464	1.5328	0.4590	1.5328	1.2381
No log	11.0952	466	1.3932	0.5397	1.3932	1.1803
No log	11.1429	468	1.2784	0.5366	1.2784	1.1306
No log	11.1905	470	1.2716	0.528	1.2716	1.1276
No log	11.2381	472	1.2962	0.528	1.2962	1.1385
No log	11.2857	474	1.2151	0.5397	1.2151	1.1023
No log	11.3333	476	1.1410	0.5323	1.1410	1.0682
No log	11.3810	478	1.0498	0.5124	1.0498	1.0246
No log	11.4286	480	1.0273	0.4706	1.0273	1.0136
No log	11.4762	482	1.0678	0.4833	1.0678	1.0333
No log	11.5238	484	1.1462	0.5041	1.1462	1.0706
No log	11.5714	486	1.2477	0.5	1.2477	1.1170
No log	11.6190	488	1.3058	0.5	1.3058	1.1427
No log	11.6667	490	1.2700	0.5	1.2700	1.1269
No log	11.7143	492	1.2091	0.5323	1.2091	1.0996
No log	11.7619	494	1.1571	0.5323	1.1571	1.0757
No log	11.8095	496	1.1530	0.5082	1.1530	1.0738
No log	11.8571	498	1.2297	0.5323	1.2297	1.1089
0.3766	11.9048	500	1.3741	0.5161	1.3741	1.1722
0.3766	11.9524	502	1.4454	0.4878	1.4454	1.2022
0.3766	12.0	504	1.4133	0.5161	1.4133	1.1888
0.3766	12.0476	506	1.3494	0.5203	1.3494	1.1616
0.3766	12.0952	508	1.2632	0.4959	1.2632	1.1239
0.3766	12.1429	510	1.1990	0.5082	1.1990	1.0950
0.3766	12.1905	512	1.1399	0.5512	1.1399	1.0677
0.3766	12.2381	514	1.1800	0.5469	1.1800	1.0863
0.3766	12.2857	516	1.2825	0.5231	1.2825	1.1325
0.3766	12.3333	518	1.2332	0.5469	1.2332	1.1105
0.3766	12.3810	520	1.1469	0.5512	1.1469	1.0709
0.3766	12.4286	522	1.1252	0.544	1.1252	1.0607
0.3766	12.4762	524	1.1179	0.5714	1.1179	1.0573
0.3766	12.5238	526	1.1927	0.544	1.1927	1.0921
0.3766	12.5714	528	1.2375	0.5512	1.2375	1.1124
0.3766	12.6190	530	1.1978	0.5469	1.1978	1.0944
0.3766	12.6667	532	1.2616	0.5038	1.2616	1.1232
0.3766	12.7143	534	1.3544	0.4848	1.3544	1.1638
0.3766	12.7619	536	1.3805	0.4848	1.3805	1.1750
0.3766	12.8095	538	1.3684	0.4848	1.3684	1.1698
0.3766	12.8571	540	1.4806	0.4328	1.4806	1.2168

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1