ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k3_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2431
• Qwk: 0.1943
• Mse: 1.2431
• Rmse: 1.1150

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1333	2	4.8934	-0.0161	4.8934	2.2121
No log	0.2667	4	3.1330	-0.0272	3.1330	1.7700
No log	0.4	6	2.0528	-0.0494	2.0528	1.4328
No log	0.5333	8	1.9542	-0.0233	1.9542	1.3979
No log	0.6667	10	1.3928	0.0133	1.3928	1.1802
No log	0.8	12	1.2597	0.1109	1.2597	1.1224
No log	0.9333	14	1.3411	0.0481	1.3411	1.1581
No log	1.0667	16	1.3046	0.0883	1.3046	1.1422
No log	1.2	18	1.3433	0.0230	1.3433	1.1590
No log	1.3333	20	1.2608	0.2569	1.2608	1.1228
No log	1.4667	22	1.2906	0.1020	1.2906	1.1360
No log	1.6	24	1.2639	0.3263	1.2639	1.1243
No log	1.7333	26	1.2768	0.3018	1.2768	1.1300
No log	1.8667	28	1.3665	0.0741	1.3665	1.1690
No log	2.0	30	1.4697	0.0964	1.4697	1.2123
No log	2.1333	32	1.4091	0.1753	1.4091	1.1871
No log	2.2667	34	1.3162	0.2011	1.3162	1.1473
No log	2.4	36	1.4055	0.1851	1.4055	1.1855
No log	2.5333	38	1.5766	0.1304	1.5766	1.2556
No log	2.6667	40	1.4193	0.2055	1.4193	1.1914
No log	2.8	42	1.2987	0.2309	1.2987	1.1396
No log	2.9333	44	1.1877	0.3987	1.1877	1.0898
No log	3.0667	46	1.2158	0.2699	1.2158	1.1026
No log	3.2	48	1.4038	0.2266	1.4038	1.1848
No log	3.3333	50	1.3939	0.2171	1.3939	1.1806
No log	3.4667	52	1.3309	0.2424	1.3309	1.1537
No log	3.6	54	1.3260	0.1511	1.3260	1.1515
No log	3.7333	56	1.2848	0.2399	1.2848	1.1335
No log	3.8667	58	1.3016	0.2524	1.3016	1.1409
No log	4.0	60	1.1596	0.2712	1.1596	1.0769
No log	4.1333	62	1.1324	0.2776	1.1324	1.0642
No log	4.2667	64	1.0927	0.2676	1.0927	1.0453
No log	4.4	66	1.1646	0.2978	1.1646	1.0792
No log	4.5333	68	1.1490	0.2755	1.1490	1.0719
No log	4.6667	70	1.0902	0.4023	1.0902	1.0441
No log	4.8	72	1.1228	0.4023	1.1228	1.0596
No log	4.9333	74	1.0889	0.3310	1.0889	1.0435
No log	5.0667	76	1.2721	0.3448	1.2721	1.1279
No log	5.2	78	1.6244	0.2810	1.6244	1.2745
No log	5.3333	80	1.4526	0.3511	1.4526	1.2052
No log	5.4667	82	1.0581	0.4143	1.0581	1.0287
No log	5.6	84	1.1284	0.3736	1.1284	1.0623
No log	5.7333	86	1.0618	0.4218	1.0618	1.0304
No log	5.8667	88	1.1481	0.3564	1.1481	1.0715
No log	6.0	90	1.5787	0.2894	1.5787	1.2565
No log	6.1333	92	1.5419	0.3690	1.5419	1.2417
No log	6.2667	94	1.2229	0.2758	1.2229	1.1059
No log	6.4	96	1.0903	0.2739	1.0903	1.0442
No log	6.5333	98	1.1273	0.3021	1.1273	1.0617
No log	6.6667	100	1.0969	0.3021	1.0969	1.0473
No log	6.8	102	1.2502	0.3960	1.2502	1.1181
No log	6.9333	104	1.5148	0.3825	1.5148	1.2308
No log	7.0667	106	1.4352	0.3809	1.4352	1.1980
No log	7.2	108	1.4892	0.3643	1.4892	1.2203
No log	7.3333	110	1.3173	0.3889	1.3173	1.1477
No log	7.4667	112	1.1775	0.3278	1.1775	1.0851
No log	7.6	114	1.1573	0.2579	1.1573	1.0758
No log	7.7333	116	1.2919	0.2983	1.2919	1.1366
No log	7.8667	118	1.5300	0.3521	1.5300	1.2369
No log	8.0	120	1.5295	0.3521	1.5295	1.2367
No log	8.1333	122	1.3118	0.2201	1.3118	1.1453
No log	8.2667	124	1.1451	0.1776	1.1451	1.0701
No log	8.4	126	1.1880	0.2391	1.1880	1.0900
No log	8.5333	128	1.4049	0.3641	1.4049	1.1853
No log	8.6667	130	1.7339	0.2516	1.7339	1.3168
No log	8.8	132	1.7698	0.2190	1.7698	1.3303
No log	8.9333	134	1.7994	0.1911	1.7994	1.3414
No log	9.0667	136	1.6055	0.3861	1.6055	1.2671
No log	9.2	138	1.2005	0.3832	1.2005	1.0957
No log	9.3333	140	1.0572	0.2757	1.0572	1.0282
No log	9.4667	142	1.0800	0.3209	1.0800	1.0392
No log	9.6	144	1.2448	0.3325	1.2448	1.1157
No log	9.7333	146	1.4567	0.4230	1.4567	1.2070
No log	9.8667	148	1.5393	0.3894	1.5393	1.2407
No log	10.0	150	1.4690	0.3894	1.4690	1.2120
No log	10.1333	152	1.1224	0.3290	1.1224	1.0595
No log	10.2667	154	0.9865	0.4409	0.9865	0.9932
No log	10.4	156	0.9828	0.4277	0.9828	0.9913
No log	10.5333	158	1.0919	0.3227	1.0919	1.0449
No log	10.6667	160	1.5040	0.4024	1.5040	1.2264
No log	10.8	162	1.6296	0.3851	1.6296	1.2766
No log	10.9333	164	1.4966	0.4024	1.4966	1.2233
No log	11.0667	166	1.2765	0.3442	1.2765	1.1298
No log	11.2	168	1.0921	0.2270	1.0921	1.0450
No log	11.3333	170	1.0381	0.3914	1.0381	1.0189
No log	11.4667	172	1.0664	0.2530	1.0664	1.0327
No log	11.6	174	1.3104	0.3045	1.3104	1.1447
No log	11.7333	176	1.5074	0.3713	1.5074	1.2278
No log	11.8667	178	1.3213	0.3259	1.3213	1.1495
No log	12.0	180	1.0851	0.2054	1.0851	1.0417
No log	12.1333	182	1.0304	0.2520	1.0304	1.0151
No log	12.2667	184	1.0277	0.1671	1.0277	1.0138
No log	12.4	186	1.0807	0.2011	1.0807	1.0396
No log	12.5333	188	1.4008	0.3926	1.4008	1.1836
No log	12.6667	190	1.6188	0.3500	1.6188	1.2723
No log	12.8	192	1.5168	0.3835	1.5168	1.2316
No log	12.9333	194	1.2258	0.3301	1.2258	1.1072
No log	13.0667	196	1.0165	0.2904	1.0165	1.0082
No log	13.2	198	0.9904	0.3548	0.9904	0.9952
No log	13.3333	200	1.0243	0.2594	1.0243	1.0121
No log	13.4667	202	1.1092	0.3478	1.1092	1.0532
No log	13.6	204	1.2315	0.3375	1.2315	1.1097
No log	13.7333	206	1.2668	0.3534	1.2668	1.1255
No log	13.8667	208	1.1569	0.2634	1.1569	1.0756
No log	14.0	210	1.0447	0.2654	1.0447	1.0221
No log	14.1333	212	1.0044	0.3427	1.0044	1.0022
No log	14.2667	214	1.0261	0.2976	1.0261	1.0130
No log	14.4	216	1.1251	0.2622	1.1251	1.0607
No log	14.5333	218	1.3076	0.3401	1.3076	1.1435
No log	14.6667	220	1.3876	0.4127	1.3876	1.1780
No log	14.8	222	1.5058	0.3652	1.5058	1.2271
No log	14.9333	224	1.3696	0.4310	1.3696	1.1703
No log	15.0667	226	1.2700	0.2885	1.2700	1.1269
No log	15.2	228	1.1320	0.2723	1.1320	1.0640
No log	15.3333	230	1.0706	0.3243	1.0706	1.0347
No log	15.4667	232	1.0607	0.2446	1.0607	1.0299
No log	15.6	234	1.0715	0.2060	1.0715	1.0352
No log	15.7333	236	1.1089	0.1857	1.1089	1.0531
No log	15.8667	238	1.1025	0.1857	1.1025	1.0500
No log	16.0	240	1.0590	0.2446	1.0590	1.0291
No log	16.1333	242	1.0620	0.2446	1.0620	1.0305
No log	16.2667	244	1.1544	0.1997	1.1544	1.0744
No log	16.4	246	1.2204	0.1899	1.2204	1.1047
No log	16.5333	248	1.2228	0.2349	1.2228	1.1058
No log	16.6667	250	1.1913	0.2041	1.1913	1.0915
No log	16.8	252	1.1614	0.1707	1.1614	1.0777
No log	16.9333	254	1.1336	0.1707	1.1336	1.0647
No log	17.0667	256	1.0837	0.1864	1.0837	1.0410
No log	17.2	258	1.1371	0.1654	1.1371	1.0664
No log	17.3333	260	1.2776	0.1980	1.2776	1.1303
No log	17.4667	262	1.3569	0.2325	1.3569	1.1648
No log	17.6	264	1.2728	0.1980	1.2728	1.1282
No log	17.7333	266	1.2170	0.1807	1.2170	1.1032
No log	17.8667	268	1.1414	0.2144	1.1414	1.0683
No log	18.0	270	1.1629	0.2184	1.1629	1.0784
No log	18.1333	272	1.2481	0.2399	1.2481	1.1172
No log	18.2667	274	1.3092	0.2568	1.3092	1.1442
No log	18.4	276	1.4226	0.3173	1.4226	1.1927
No log	18.5333	278	1.3660	0.3366	1.3660	1.1688
No log	18.6667	280	1.1928	0.3004	1.1928	1.0921
No log	18.8	282	1.1112	0.2766	1.1112	1.0541
No log	18.9333	284	1.1142	0.2981	1.1142	1.0555
No log	19.0667	286	1.1259	0.3222	1.1259	1.0611
No log	19.2	288	1.1269	0.3222	1.1269	1.0616
No log	19.3333	290	1.2100	0.3281	1.2100	1.1000
No log	19.4667	292	1.3318	0.3317	1.3318	1.1540
No log	19.6	294	1.3093	0.3339	1.3093	1.1443
No log	19.7333	296	1.2582	0.3163	1.2582	1.1217
No log	19.8667	298	1.2238	0.2534	1.2238	1.1063
No log	20.0	300	1.2329	0.2301	1.2329	1.1104
No log	20.1333	302	1.1730	0.1801	1.1730	1.0831
No log	20.2667	304	1.1408	0.1807	1.1408	1.0681
No log	20.4	306	1.1579	0.1854	1.1579	1.0760
No log	20.5333	308	1.2056	0.2163	1.2056	1.0980
No log	20.6667	310	1.2511	0.2767	1.2511	1.1185
No log	20.8	312	1.1979	0.2758	1.1979	1.0945
No log	20.9333	314	1.1161	0.2054	1.1161	1.0564
No log	21.0667	316	1.1285	0.1913	1.1285	1.0623
No log	21.2	318	1.2060	0.2261	1.2060	1.0982
No log	21.3333	320	1.3566	0.2947	1.3566	1.1647
No log	21.4667	322	1.4233	0.3254	1.4233	1.1930
No log	21.6	324	1.3281	0.2540	1.3281	1.1524
No log	21.7333	326	1.1611	0.2530	1.1611	1.0775
No log	21.8667	328	1.1043	0.2830	1.1043	1.0508
No log	22.0	330	1.1211	0.2830	1.1211	1.0588
No log	22.1333	332	1.1949	0.2819	1.1949	1.0931
No log	22.2667	334	1.3422	0.2945	1.3422	1.1585
No log	22.4	336	1.5354	0.2768	1.5354	1.2391
No log	22.5333	338	1.5296	0.2731	1.5296	1.2368
No log	22.6667	340	1.3255	0.2568	1.3255	1.1513
No log	22.8	342	1.1945	0.2593	1.1945	1.0929
No log	22.9333	344	1.1913	0.2333	1.1913	1.0915
No log	23.0667	346	1.2196	0.2028	1.2196	1.1043
No log	23.2	348	1.3054	0.1928	1.3054	1.1426
No log	23.3333	350	1.3086	0.1928	1.3086	1.1439
No log	23.4667	352	1.2751	0.2289	1.2751	1.1292
No log	23.6	354	1.2593	0.1935	1.2593	1.1222
No log	23.7333	356	1.2718	0.2607	1.2718	1.1277
No log	23.8667	358	1.3291	0.2206	1.3291	1.1529
No log	24.0	360	1.3825	0.2363	1.3825	1.1758
No log	24.1333	362	1.3296	0.2295	1.3296	1.1531
No log	24.2667	364	1.2570	0.2471	1.2570	1.1211
No log	24.4	366	1.1631	0.2362	1.1631	1.0785
No log	24.5333	368	1.1089	0.2727	1.1089	1.0530
No log	24.6667	370	1.0968	0.2637	1.0968	1.0473
No log	24.8	372	1.1375	0.2727	1.1375	1.0665
No log	24.9333	374	1.2133	0.2518	1.2133	1.1015
No log	25.0667	376	1.2388	0.3106	1.2388	1.1130
No log	25.2	378	1.1762	0.2250	1.1762	1.0845
No log	25.3333	380	1.1378	0.2384	1.1378	1.0667
No log	25.4667	382	1.1317	0.2431	1.1317	1.0638
No log	25.6	384	1.1221	0.2463	1.1221	1.0593
No log	25.7333	386	1.1485	0.2706	1.1485	1.0717
No log	25.8667	388	1.2468	0.3025	1.2468	1.1166
No log	26.0	390	1.4123	0.3421	1.4123	1.1884
No log	26.1333	392	1.4247	0.2899	1.4247	1.1936
No log	26.2667	394	1.2984	0.3324	1.2984	1.1395
No log	26.4	396	1.1484	0.2706	1.1484	1.0716
No log	26.5333	398	1.0786	0.2054	1.0786	1.0386
No log	26.6667	400	1.0830	0.2144	1.0830	1.0407
No log	26.8	402	1.0839	0.2054	1.0839	1.0411
No log	26.9333	404	1.1294	0.2235	1.1294	1.0627
No log	27.0667	406	1.1566	0.2273	1.1566	1.0755
No log	27.2	408	1.1169	0.2144	1.1169	1.0569
No log	27.3333	410	1.0660	0.2496	1.0660	1.0325
No log	27.4667	412	1.0434	0.3663	1.0434	1.0215
No log	27.6	414	1.0593	0.2995	1.0593	1.0292
No log	27.7333	416	1.0793	0.2206	1.0793	1.0389
No log	27.8667	418	1.1143	0.2195	1.1143	1.0556
No log	28.0	420	1.1551	0.1860	1.1551	1.0747
No log	28.1333	422	1.1466	0.1860	1.1466	1.0708
No log	28.2667	424	1.0789	0.2195	1.0789	1.0387
No log	28.4	426	1.0475	0.2530	1.0475	1.0235
No log	28.5333	428	1.0621	0.2515	1.0621	1.0306
No log	28.6667	430	1.1352	0.2235	1.1352	1.0655
No log	28.8	432	1.2066	0.2431	1.2066	1.0985
No log	28.9333	434	1.2819	0.3145	1.2819	1.1322
No log	29.0667	436	1.2371	0.3084	1.2371	1.1123
No log	29.2	438	1.2156	0.3084	1.2156	1.1025
No log	29.3333	440	1.2119	0.3084	1.2119	1.1009
No log	29.4667	442	1.2008	0.3303	1.2008	1.0958
No log	29.6	444	1.1822	0.3408	1.1822	1.0873
No log	29.7333	446	1.1963	0.3408	1.1963	1.0937
No log	29.8667	448	1.2196	0.3084	1.2196	1.1043
No log	30.0	450	1.2110	0.3084	1.2110	1.1004
No log	30.1333	452	1.1578	0.3084	1.1578	1.0760
No log	30.2667	454	1.1119	0.3064	1.1119	1.0545
No log	30.4	456	1.1161	0.3022	1.1161	1.0564
No log	30.5333	458	1.1356	0.3022	1.1356	1.0657
No log	30.6667	460	1.1458	0.2411	1.1458	1.0704
No log	30.8	462	1.1923	0.2755	1.1923	1.0919
No log	30.9333	464	1.3188	0.2437	1.3188	1.1484
No log	31.0667	466	1.3892	0.2506	1.3892	1.1786
No log	31.2	468	1.3408	0.2574	1.3408	1.1579
No log	31.3333	470	1.2414	0.1995	1.2414	1.1142
No log	31.4667	472	1.1289	0.2515	1.1289	1.0625
No log	31.6	474	1.1009	0.2563	1.1009	1.0492
No log	31.7333	476	1.1444	0.2322	1.1444	1.0698
No log	31.8667	478	1.1988	0.2826	1.1988	1.0949
No log	32.0	480	1.2432	0.2154	1.2432	1.1150
No log	32.1333	482	1.2570	0.2430	1.2570	1.1212
No log	32.2667	484	1.2756	0.2662	1.2756	1.1294
No log	32.4	486	1.1952	0.25	1.1952	1.0933
No log	32.5333	488	1.1123	0.2864	1.1123	1.0547
No log	32.6667	490	1.0898	0.2683	1.0898	1.0439
No log	32.8	492	1.1108	0.2683	1.1108	1.0539
No log	32.9333	494	1.1696	0.2695	1.1696	1.0815
No log	33.0667	496	1.2395	0.3222	1.2395	1.1133
No log	33.2	498	1.2885	0.3719	1.2885	1.1351
0.251	33.3333	500	1.3712	0.2985	1.3712	1.1710
0.251	33.4667	502	1.3382	0.2568	1.3382	1.1568
0.251	33.6	504	1.2383	0.2362	1.2383	1.1128
0.251	33.7333	506	1.2062	0.2362	1.2062	1.0983
0.251	33.8667	508	1.2130	0.1995	1.2130	1.1014
0.251	34.0	510	1.2431	0.1943	1.2431	1.1150

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1