ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k4_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1995
• Qwk: 0.1379
• Mse: 1.1995
• Rmse: 1.0952

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1667	2	4.7841	0.0010	4.7841	2.1873
No log	0.3333	4	2.7856	0.0	2.7856	1.6690
No log	0.5	6	2.0168	-0.0164	2.0168	1.4201
No log	0.6667	8	1.7539	0.0444	1.7539	1.3244
No log	0.8333	10	1.5072	0.0076	1.5072	1.2277
No log	1.0	12	1.3825	0.0357	1.3825	1.1758
No log	1.1667	14	1.3544	0.0030	1.3544	1.1638
No log	1.3333	16	1.2901	0.1014	1.2901	1.1358
No log	1.5	18	1.3139	-0.0182	1.3139	1.1462
No log	1.6667	20	1.6583	-0.0149	1.6583	1.2878
No log	1.8333	22	1.7799	0.0585	1.7799	1.3341
No log	2.0	24	1.4922	-0.0199	1.4922	1.2216
No log	2.1667	26	1.2118	0.1875	1.2118	1.1008
No log	2.3333	28	1.2558	0.1249	1.2558	1.1206
No log	2.5	30	1.2410	0.0980	1.2410	1.1140
No log	2.6667	32	1.1366	0.2408	1.1366	1.0661
No log	2.8333	34	1.1000	0.2939	1.1000	1.0488
No log	3.0	36	1.1246	0.2835	1.1246	1.0605
No log	3.1667	38	1.1201	0.3603	1.1201	1.0584
No log	3.3333	40	1.1878	0.2446	1.1878	1.0899
No log	3.5	42	1.2704	0.1404	1.2704	1.1271
No log	3.6667	44	1.2563	0.1959	1.2563	1.1209
No log	3.8333	46	1.2000	0.2632	1.2000	1.0954
No log	4.0	48	1.1321	0.3347	1.1321	1.0640
No log	4.1667	50	1.3041	0.1404	1.3041	1.1420
No log	4.3333	52	1.6427	0.0622	1.6427	1.2817
No log	4.5	54	1.5936	0.0622	1.5936	1.2624
No log	4.6667	56	1.3245	0.1552	1.3245	1.1509
No log	4.8333	58	1.0780	0.2167	1.0780	1.0382
No log	5.0	60	1.1052	0.1042	1.1052	1.0513
No log	5.1667	62	1.2020	0.0802	1.2020	1.0963
No log	5.3333	64	1.1696	0.0612	1.1696	1.0815
No log	5.5	66	1.0527	0.2993	1.0527	1.0260
No log	5.6667	68	1.0322	0.2835	1.0322	1.0160
No log	5.8333	70	1.0268	0.2167	1.0268	1.0133
No log	6.0	72	1.0108	0.2167	1.0108	1.0054
No log	6.1667	74	0.9803	0.3374	0.9803	0.9901
No log	6.3333	76	1.0468	0.1344	1.0468	1.0232
No log	6.5	78	1.1586	0.0843	1.1586	1.0764
No log	6.6667	80	1.1476	0.0843	1.1476	1.0713
No log	6.8333	82	1.0972	0.0857	1.0972	1.0475
No log	7.0	84	0.9757	0.2360	0.9757	0.9878
No log	7.1667	86	0.9784	0.2991	0.9784	0.9891
No log	7.3333	88	1.0107	0.1935	1.0107	1.0053
No log	7.5	90	1.1134	0.0513	1.1134	1.0552
No log	7.6667	92	1.2349	0.0444	1.2349	1.1113
No log	7.8333	94	1.1761	0.1345	1.1761	1.0845
No log	8.0	96	1.0462	0.1761	1.0462	1.0228
No log	8.1667	98	0.9383	0.4588	0.9383	0.9687
No log	8.3333	100	0.9904	0.3635	0.9904	0.9952
No log	8.5	102	0.9724	0.3590	0.9724	0.9861
No log	8.6667	104	0.9852	0.2331	0.9852	0.9926
No log	8.8333	106	1.2392	0.1896	1.2392	1.1132
No log	9.0	108	1.5681	0.1884	1.5681	1.2522
No log	9.1667	110	1.6556	0.1179	1.6556	1.2867
No log	9.3333	112	1.4848	0.1462	1.4848	1.2185
No log	9.5	114	1.2836	0.0642	1.2836	1.1330
No log	9.6667	116	1.2218	0.1343	1.2218	1.1054
No log	9.8333	118	1.1811	0.1278	1.1811	1.0868
No log	10.0	120	1.1810	0.1442	1.1810	1.0868
No log	10.1667	122	1.1952	0.1118	1.1952	1.0932
No log	10.3333	124	1.2722	0.1557	1.2722	1.1279
No log	10.5	126	1.2502	0.1557	1.2502	1.1181
No log	10.6667	128	1.1155	0.2470	1.1155	1.0562
No log	10.8333	130	1.0650	0.3021	1.0650	1.0320
No log	11.0	132	1.0575	0.3021	1.0575	1.0283
No log	11.1667	134	1.1922	0.3088	1.1922	1.0919
No log	11.3333	136	1.3939	0.3060	1.3939	1.1806
No log	11.5	138	1.3991	0.3253	1.3991	1.1828
No log	11.6667	140	1.2562	0.3118	1.2562	1.1208
No log	11.8333	142	1.1918	0.375	1.1918	1.0917
No log	12.0	144	1.1894	0.3631	1.1894	1.0906
No log	12.1667	146	1.1707	0.3136	1.1707	1.0820
No log	12.3333	148	1.2171	0.3688	1.2171	1.1032
No log	12.5	150	1.2520	0.3277	1.2520	1.1189
No log	12.6667	152	1.4029	0.3324	1.4029	1.1845
No log	12.8333	154	1.3852	0.3324	1.3852	1.1769
No log	13.0	156	1.2216	0.2367	1.2216	1.1052
No log	13.1667	158	1.0815	0.2056	1.0815	1.0399
No log	13.3333	160	1.0820	0.2056	1.0820	1.0402
No log	13.5	162	1.0835	0.1755	1.0835	1.0409
No log	13.6667	164	1.1593	0.2330	1.1593	1.0767
No log	13.8333	166	1.1950	0.2634	1.1950	1.0931
No log	14.0	168	1.1960	0.3155	1.1960	1.0936
No log	14.1667	170	1.1562	0.3155	1.1562	1.0753
No log	14.3333	172	1.0664	0.2953	1.0664	1.0327
No log	14.5	174	1.0292	0.3377	1.0292	1.0145
No log	14.6667	176	0.9747	0.4165	0.9747	0.9873
No log	14.8333	178	1.0335	0.4186	1.0335	1.0166
No log	15.0	180	1.2179	0.3556	1.2179	1.1036
No log	15.1667	182	1.2444	0.3931	1.2444	1.1155
No log	15.3333	184	1.2418	0.3512	1.2418	1.1144
No log	15.5	186	1.1220	0.2864	1.1220	1.0592
No log	15.6667	188	1.1028	0.2535	1.1028	1.0501
No log	15.8333	190	1.0440	0.2152	1.0440	1.0218
No log	16.0	192	0.9930	0.3851	0.9930	0.9965
No log	16.1667	194	1.0584	0.3739	1.0584	1.0288
No log	16.3333	196	1.2873	0.3353	1.2873	1.1346
No log	16.5	198	1.3681	0.2895	1.3681	1.1697
No log	16.6667	200	1.2845	0.2647	1.2845	1.1333
No log	16.8333	202	1.2148	0.3136	1.2148	1.1022
No log	17.0	204	1.2265	0.2494	1.2265	1.1075
No log	17.1667	206	1.1770	0.1026	1.1770	1.0849
No log	17.3333	208	1.0958	0.0974	1.0958	1.0468
No log	17.5	210	1.0502	0.0974	1.0502	1.0248
No log	17.6667	212	1.0049	0.1814	1.0049	1.0025
No log	17.8333	214	1.0211	0.1480	1.0211	1.0105
No log	18.0	216	1.0975	0.1217	1.0975	1.0476
No log	18.1667	218	1.1478	0.1637	1.1478	1.0714
No log	18.3333	220	1.2107	0.1440	1.2107	1.1003
No log	18.5	222	1.2666	0.1795	1.2666	1.1255
No log	18.6667	224	1.2191	0.3071	1.2191	1.1041
No log	18.8333	226	1.1256	0.1943	1.1256	1.0609
No log	19.0	228	1.0437	0.1860	1.0437	1.0216
No log	19.1667	230	1.0297	0.1662	1.0297	1.0147
No log	19.3333	232	1.0609	0.1701	1.0609	1.0300
No log	19.5	234	1.0948	0.1379	1.0948	1.0463
No log	19.6667	236	1.1005	0.1379	1.1005	1.0490
No log	19.8333	238	1.0687	0.1480	1.0687	1.0338
No log	20.0	240	1.0285	0.1605	1.0285	1.0142
No log	20.1667	242	1.0318	0.1706	1.0318	1.0158
No log	20.3333	244	1.0996	0.1541	1.0996	1.0486
No log	20.5	246	1.1307	0.1185	1.1307	1.0633
No log	20.6667	248	1.0854	0.1541	1.0854	1.0418
No log	20.8333	250	1.0424	0.1605	1.0424	1.0210
No log	21.0	252	1.0500	0.1706	1.0500	1.0247
No log	21.1667	254	1.0738	0.1543	1.0738	1.0362
No log	21.3333	256	1.1453	0.1379	1.1453	1.0702
No log	21.5	258	1.2520	0.2184	1.2520	1.1189
No log	21.6667	260	1.2944	0.2553	1.2944	1.1377
No log	21.8333	262	1.2168	0.1345	1.2168	1.1031
No log	22.0	264	1.1020	0.1214	1.1020	1.0498
No log	22.1667	266	1.0393	0.1868	1.0393	1.0195
No log	22.3333	268	1.0025	0.3070	1.0025	1.0012
No log	22.5	270	0.9806	0.3243	0.9806	0.9902
No log	22.6667	272	1.0127	0.1968	1.0127	1.0063
No log	22.8333	274	1.1199	0.2343	1.1199	1.0582
No log	23.0	276	1.2215	0.3094	1.2215	1.1052
No log	23.1667	278	1.2460	0.3357	1.2460	1.1162
No log	23.3333	280	1.1598	0.3231	1.1598	1.0769
No log	23.5	282	1.1126	0.2683	1.1126	1.0548
No log	23.6667	284	1.1215	0.2683	1.1215	1.0590
No log	23.8333	286	1.1055	0.2829	1.1055	1.0514
No log	24.0	288	1.1227	0.2304	1.1227	1.0596
No log	24.1667	290	1.1917	0.1650	1.1917	1.0917
No log	24.3333	292	1.2948	0.2080	1.2948	1.1379
No log	24.5	294	1.3763	0.3316	1.3763	1.1732
No log	24.6667	296	1.3288	0.2354	1.3288	1.1527
No log	24.8333	298	1.1986	0.1538	1.1986	1.0948
No log	25.0	300	1.1034	0.1442	1.1034	1.0504
No log	25.1667	302	1.0816	0.1442	1.0816	1.0400
No log	25.3333	304	1.1170	0.1281	1.1170	1.0569
No log	25.5	306	1.1786	0.1217	1.1786	1.0856
No log	25.6667	308	1.2454	0.1846	1.2454	1.1160
No log	25.8333	310	1.3467	0.3243	1.3467	1.1605
No log	26.0	312	1.4450	0.2578	1.4450	1.2021
No log	26.1667	314	1.4605	0.3082	1.4605	1.2085
No log	26.3333	316	1.3336	0.3006	1.3336	1.1548
No log	26.5	318	1.1790	0.3525	1.1790	1.0858
No log	26.6667	320	1.0682	0.3317	1.0682	1.0335
No log	26.8333	322	1.0775	0.2698	1.0775	1.0380
No log	27.0	324	1.1292	0.2864	1.1292	1.0627
No log	27.1667	326	1.2453	0.2589	1.2453	1.1159
No log	27.3333	328	1.3375	0.3324	1.3375	1.1565
No log	27.5	330	1.3346	0.3324	1.3346	1.1553
No log	27.6667	332	1.2444	0.3601	1.2444	1.1155
No log	27.8333	334	1.1290	0.2953	1.1290	1.0626
No log	28.0	336	1.0721	0.2304	1.0721	1.0354
No log	28.1667	338	1.0488	0.2009	1.0488	1.0241
No log	28.3333	340	1.0340	0.2175	1.0340	1.0169
No log	28.5	342	1.0791	0.1853	1.0791	1.0388
No log	28.6667	344	1.1145	0.1379	1.1145	1.0557
No log	28.8333	346	1.1309	0.1379	1.1309	1.0634
No log	29.0	348	1.1600	0.1379	1.1600	1.0771
No log	29.1667	350	1.2223	0.1696	1.2223	1.1056
No log	29.3333	352	1.2966	0.1696	1.2966	1.1387
No log	29.5	354	1.3027	0.1801	1.3027	1.1414
No log	29.6667	356	1.2530	0.2000	1.2530	1.1194
No log	29.8333	358	1.1868	0.1853	1.1868	1.0894
No log	30.0	360	1.1343	0.1853	1.1343	1.0650
No log	30.1667	362	1.1083	0.2009	1.1083	1.0528
No log	30.3333	364	1.1450	0.1853	1.1450	1.0701
No log	30.5	366	1.2109	0.1500	1.2109	1.1004
No log	30.6667	368	1.3084	0.2090	1.3084	1.1438
No log	30.8333	370	1.4263	0.2941	1.4263	1.1943
No log	31.0	372	1.4529	0.2895	1.4529	1.2054
No log	31.1667	374	1.3866	0.3316	1.3866	1.1775
No log	31.3333	376	1.2704	0.1500	1.2704	1.1271
No log	31.5	378	1.1966	0.1853	1.1966	1.0939
No log	31.6667	380	1.1564	0.1853	1.1564	1.0754
No log	31.8333	382	1.1391	0.1696	1.1391	1.0673
No log	32.0	384	1.1594	0.1696	1.1594	1.0767
No log	32.1667	386	1.2243	0.1795	1.2243	1.1065
No log	32.3333	388	1.3177	0.1944	1.3177	1.1479
No log	32.5	390	1.3591	0.3049	1.3591	1.1658
No log	32.6667	392	1.2998	0.1991	1.2998	1.1401
No log	32.8333	394	1.1725	0.1853	1.1725	1.0828
No log	33.0	396	1.0877	0.2009	1.0877	1.0429
No log	33.1667	398	1.0318	0.2721	1.0318	1.0158
No log	33.3333	400	1.0343	0.2569	1.0343	1.0170
No log	33.5	402	1.0794	0.2152	1.0794	1.0389
No log	33.6667	404	1.1804	0.2291	1.1804	1.0865
No log	33.8333	406	1.3063	0.3402	1.3063	1.1429
No log	34.0	408	1.3354	0.3715	1.3354	1.1556
No log	34.1667	410	1.2984	0.3372	1.2984	1.1395
No log	34.3333	412	1.2215	0.2330	1.2215	1.1052
No log	34.5	414	1.1665	0.2000	1.1665	1.0801
No log	34.6667	416	1.1041	0.1696	1.1041	1.0508
No log	34.8333	418	1.0617	0.2263	1.0617	1.0304
No log	35.0	420	1.0233	0.2019	1.0233	1.0116
No log	35.1667	422	1.0218	0.2175	1.0218	1.0108
No log	35.3333	424	1.0638	0.2417	1.0638	1.0314
No log	35.5	426	1.1150	0.1696	1.1150	1.0560
No log	35.6667	428	1.1309	0.1801	1.1309	1.0634
No log	35.8333	430	1.1496	0.2090	1.1496	1.0722
No log	36.0	432	1.1328	0.2090	1.1328	1.0643
No log	36.1667	434	1.1053	0.2291	1.1053	1.0513
No log	36.3333	436	1.0950	0.2291	1.0950	1.0464
No log	36.5	438	1.0919	0.2683	1.0919	1.0449
No log	36.6667	440	1.1146	0.2330	1.1146	1.0557
No log	36.8333	442	1.1572	0.2634	1.1572	1.0757
No log	37.0	444	1.1665	0.2634	1.1665	1.0801
No log	37.1667	446	1.1318	0.2809	1.1318	1.0639
No log	37.3333	448	1.1077	0.2683	1.1077	1.0525
No log	37.5	450	1.0632	0.2304	1.0632	1.0311
No log	37.6667	452	1.0216	0.2604	1.0216	1.0108
No log	37.8333	454	1.0075	0.3045	1.0075	1.0037
No log	38.0	456	1.0238	0.2604	1.0238	1.0118
No log	38.1667	458	1.0662	0.2402	1.0662	1.0326
No log	38.3333	460	1.1122	0.2000	1.1122	1.0546
No log	38.5	462	1.1106	0.2000	1.1106	1.0539
No log	38.6667	464	1.1118	0.2000	1.1118	1.0544
No log	38.8333	466	1.0902	0.2000	1.0902	1.0441
No log	39.0	468	1.0420	0.2263	1.0420	1.0208
No log	39.1667	470	1.0038	0.2175	1.0038	1.0019
No log	39.3333	472	0.9823	0.2386	0.9823	0.9911
No log	39.5	474	0.9817	0.2386	0.9817	0.9908
No log	39.6667	476	1.0000	0.2470	1.0000	1.0000
No log	39.8333	478	1.0266	0.2702	1.0266	1.0132
No log	40.0	480	1.0609	0.2552	1.0609	1.0300
No log	40.1667	482	1.0925	0.2108	1.0925	1.0452
No log	40.3333	484	1.1466	0.1696	1.1466	1.0708
No log	40.5	486	1.1921	0.1500	1.1921	1.0919
No log	40.6667	488	1.1977	0.1500	1.1977	1.0944
No log	40.8333	490	1.1466	0.1500	1.1466	1.0708
No log	41.0	492	1.0962	0.2108	1.0962	1.0470
No log	41.1667	494	1.0614	0.2402	1.0614	1.0302
No log	41.3333	496	1.0449	0.2552	1.0449	1.0222
No log	41.5	498	1.0215	0.2454	1.0215	1.0107
0.3069	41.6667	500	1.0254	0.2552	1.0254	1.0126
0.3069	41.8333	502	1.0683	0.2000	1.0683	1.0336
0.3069	42.0	504	1.1436	0.2046	1.1436	1.0694
0.3069	42.1667	506	1.2035	0.2664	1.2035	1.0970
0.3069	42.3333	508	1.2126	0.2664	1.2126	1.1012
0.3069	42.5	510	1.2016	0.2664	1.2016	1.0962
0.3069	42.6667	512	1.1689	0.2602	1.1689	1.0812
0.3069	42.8333	514	1.1228	0.2439	1.1228	1.0596
0.3069	43.0	516	1.1185	0.2152	1.1185	1.0576
0.3069	43.1667	518	1.1329	0.2152	1.1329	1.0644
0.3069	43.3333	520	1.1755	0.2602	1.1755	1.0842
0.3069	43.5	522	1.1846	0.2602	1.1846	1.0884
0.3069	43.6667	524	1.1599	0.2152	1.1599	1.0770
0.3069	43.8333	526	1.1553	0.2152	1.1553	1.0749
0.3069	44.0	528	1.1831	0.2000	1.1831	1.0877
0.3069	44.1667	530	1.1979	0.2000	1.1979	1.0945
0.3069	44.3333	532	1.1995	0.1379	1.1995	1.0952

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1