ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k3_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2524
• Qwk: 0.0454
• Mse: 1.2524
• Rmse: 1.1191

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1333	2	4.6704	-0.0132	4.6704	2.1611
No log	0.2667	4	3.0272	-0.0396	3.0272	1.7399
No log	0.4	6	1.7978	0.0062	1.7978	1.3408
No log	0.5333	8	1.5300	0.0372	1.5300	1.2369
No log	0.6667	10	1.2728	0.0611	1.2728	1.1282
No log	0.8	12	1.2382	0.1711	1.2382	1.1127
No log	0.9333	14	1.2741	0.0979	1.2741	1.1287
No log	1.0667	16	1.3047	0.0276	1.3047	1.1422
No log	1.2	18	1.5184	0.0019	1.5184	1.2322
No log	1.3333	20	1.4802	0.0019	1.4802	1.2166
No log	1.4667	22	1.2908	0.0098	1.2908	1.1361
No log	1.6	24	1.3363	-0.0321	1.3363	1.1560
No log	1.7333	26	1.2885	0.0639	1.2885	1.1351
No log	1.8667	28	1.2651	0.1852	1.2651	1.1248
No log	2.0	30	1.2571	0.1138	1.2571	1.1212
No log	2.1333	32	1.3302	0.0651	1.3302	1.1534
No log	2.2667	34	1.3217	0.0865	1.3217	1.1496
No log	2.4	36	1.2318	0.0731	1.2318	1.1099
No log	2.5333	38	1.2532	0.0599	1.2532	1.1195
No log	2.6667	40	1.2463	0.0974	1.2463	1.1164
No log	2.8	42	1.2220	0.0769	1.2220	1.1055
No log	2.9333	44	1.2483	0.1406	1.2483	1.1173
No log	3.0667	46	1.2638	0.0927	1.2638	1.1242
No log	3.2	48	1.3221	0.1264	1.3221	1.1498
No log	3.3333	50	1.3467	0.0967	1.3467	1.1605
No log	3.4667	52	1.4692	0.0675	1.4692	1.2121
No log	3.6	54	1.3984	0.1820	1.3984	1.1825
No log	3.7333	56	1.3002	0.2547	1.3002	1.1402
No log	3.8667	58	1.3550	0.2333	1.3550	1.1641
No log	4.0	60	1.6095	0.1923	1.6095	1.2687
No log	4.1333	62	1.3999	0.1845	1.3999	1.1832
No log	4.2667	64	1.1347	0.2621	1.1347	1.0652
No log	4.4	66	1.2049	0.2263	1.2049	1.0977
No log	4.5333	68	1.3770	0.1980	1.3770	1.1735
No log	4.6667	70	1.2110	0.1969	1.2110	1.1004
No log	4.8	72	1.1580	0.1480	1.1580	1.0761
No log	4.9333	74	1.1715	0.2761	1.1715	1.0824
No log	5.0667	76	1.4600	0.2122	1.4600	1.2083
No log	5.2	78	1.5282	0.2617	1.5282	1.2362
No log	5.3333	80	1.3423	0.0843	1.3423	1.1586
No log	5.4667	82	1.1321	0.2792	1.1321	1.0640
No log	5.6	84	1.1894	0.1761	1.1894	1.0906
No log	5.7333	86	1.5349	0.1845	1.5349	1.2389
No log	5.8667	88	1.7110	0.1101	1.7110	1.3080
No log	6.0	90	1.5662	0.2006	1.5662	1.2515
No log	6.1333	92	1.5117	0.2295	1.5117	1.2295
No log	6.2667	94	1.3969	0.2498	1.3969	1.1819
No log	6.4	96	1.2753	0.3024	1.2753	1.1293
No log	6.5333	98	1.0510	0.3493	1.0510	1.0252
No log	6.6667	100	1.0447	0.3621	1.0447	1.0221
No log	6.8	102	1.2660	0.3416	1.2660	1.1251
No log	6.9333	104	1.7420	0.1448	1.7420	1.3199
No log	7.0667	106	1.7314	0.1720	1.7314	1.3158
No log	7.2	108	1.2883	0.2815	1.2883	1.1350
No log	7.3333	110	1.2546	0.1889	1.2546	1.1201
No log	7.4667	112	1.2546	0.2221	1.2546	1.1201
No log	7.6	114	1.1928	0.3191	1.1928	1.0922
No log	7.7333	116	1.4788	0.2841	1.4788	1.2161
No log	7.8667	118	1.5239	0.2363	1.5239	1.2345
No log	8.0	120	1.2838	0.2108	1.2838	1.1330
No log	8.1333	122	1.1067	0.3613	1.1067	1.0520
No log	8.2667	124	1.0771	0.3845	1.0771	1.0378
No log	8.4	126	1.1002	0.3613	1.1002	1.0489
No log	8.5333	128	1.2730	0.2227	1.2730	1.1283
No log	8.6667	130	1.3628	0.2328	1.3628	1.1674
No log	8.8	132	1.4279	0.1533	1.4279	1.1949
No log	8.9333	134	1.4210	0.2240	1.4210	1.1921
No log	9.0667	136	1.2604	0.3025	1.2604	1.1227
No log	9.2	138	1.1208	0.2357	1.1208	1.0587
No log	9.3333	140	1.1888	0.2108	1.1888	1.0903
No log	9.4667	142	1.2090	0.2132	1.2090	1.0996
No log	9.6	144	1.0707	0.3634	1.0707	1.0348
No log	9.7333	146	1.0386	0.4067	1.0386	1.0191
No log	9.8667	148	1.1687	0.3552	1.1687	1.0811
No log	10.0	150	1.3546	0.2206	1.3546	1.1639
No log	10.1333	152	1.2684	0.2781	1.2684	1.1262
No log	10.2667	154	1.0929	0.2392	1.0929	1.0454
No log	10.4	156	1.0494	0.3505	1.0494	1.0244
No log	10.5333	158	1.1183	0.2636	1.1183	1.0575
No log	10.6667	160	1.3954	0.2964	1.3954	1.1813
No log	10.8	162	1.4625	0.2595	1.4625	1.2093
No log	10.9333	164	1.2155	0.3578	1.2155	1.1025
No log	11.0667	166	1.0116	0.3250	1.0116	1.0058
No log	11.2	168	0.9893	0.4140	0.9893	0.9946
No log	11.3333	170	1.0833	0.1860	1.0833	1.0408
No log	11.4667	172	1.4333	0.2217	1.4333	1.1972
No log	11.6	174	1.5932	0.2251	1.5932	1.2622
No log	11.7333	176	1.4530	0.2239	1.4530	1.2054
No log	11.8667	178	1.2409	0.0789	1.2409	1.1140
No log	12.0	180	1.0954	0.2674	1.0954	1.0466
No log	12.1333	182	1.0615	0.3307	1.0615	1.0303
No log	12.2667	184	1.0610	0.3151	1.0610	1.0301
No log	12.4	186	1.1876	0.0628	1.1876	1.0898
No log	12.5333	188	1.3635	0.1554	1.3635	1.1677
No log	12.6667	190	1.3592	0.0263	1.3592	1.1659
No log	12.8	192	1.2276	0.0628	1.2276	1.1080
No log	12.9333	194	1.0770	0.2865	1.0770	1.0378
No log	13.0667	196	1.0536	0.3478	1.0536	1.0265
No log	13.2	198	1.0696	0.2969	1.0696	1.0342
No log	13.3333	200	1.1720	0.0628	1.1720	1.0826
No log	13.4667	202	1.2548	0.0628	1.2548	1.1202
No log	13.6	204	1.2079	0.1122	1.2079	1.0990
No log	13.7333	206	1.0768	0.2972	1.0768	1.0377
No log	13.8667	208	1.0349	0.4280	1.0349	1.0173
No log	14.0	210	1.0496	0.4280	1.0496	1.0245
No log	14.1333	212	1.1095	0.3848	1.1095	1.0534
No log	14.2667	214	1.2767	0.2328	1.2767	1.1299
No log	14.4	216	1.3016	0.2389	1.3016	1.1409
No log	14.5333	218	1.2359	0.3067	1.2359	1.1117
No log	14.6667	220	1.3354	0.2493	1.3354	1.1556
No log	14.8	222	1.4034	0.2455	1.4034	1.1847
No log	14.9333	224	1.3286	0.2334	1.3286	1.1527
No log	15.0667	226	1.3137	0.0454	1.3137	1.1462
No log	15.2	228	1.2691	0.0628	1.2691	1.1265
No log	15.3333	230	1.2601	0.0628	1.2601	1.1225
No log	15.4667	232	1.2083	0.0880	1.2083	1.0992
No log	15.6	234	1.2291	0.0692	1.2291	1.1086
No log	15.7333	236	1.2992	0.1745	1.2992	1.1398
No log	15.8667	238	1.2511	0.1650	1.2511	1.1185
No log	16.0	240	1.1601	0.2409	1.1601	1.0771
No log	16.1333	242	1.1732	0.2093	1.1732	1.0831
No log	16.2667	244	1.3512	0.3006	1.3512	1.1624
No log	16.4	246	1.4249	0.2731	1.4249	1.1937
No log	16.5333	248	1.4470	0.3082	1.4470	1.2029
No log	16.6667	250	1.2866	0.1188	1.2866	1.1343
No log	16.8	252	1.1268	0.1247	1.1268	1.0615
No log	16.9333	254	1.0636	0.2023	1.0636	1.0313
No log	17.0667	256	1.0337	0.2023	1.0337	1.0167
No log	17.2	258	1.1303	0.2046	1.1303	1.0631
No log	17.3333	260	1.3946	0.2569	1.3946	1.1809
No log	17.4667	262	1.4894	0.2595	1.4894	1.2204
No log	17.6	264	1.3523	0.2289	1.3523	1.1629
No log	17.7333	266	1.1222	0.1247	1.1222	1.0593
No log	17.8667	268	1.0442	0.2188	1.0442	1.0218
No log	18.0	270	1.0254	0.2619	1.0254	1.0126
No log	18.1333	272	1.0862	0.1582	1.0862	1.0422
No log	18.2667	274	1.2366	0.2956	1.2366	1.1120
No log	18.4	276	1.3024	0.3026	1.3024	1.1412
No log	18.5333	278	1.2341	0.3093	1.2341	1.1109
No log	18.6667	280	1.0812	0.3072	1.0812	1.0398
No log	18.8	282	0.9860	0.3663	0.9860	0.9930
No log	18.9333	284	0.9717	0.3453	0.9717	0.9857
No log	19.0667	286	0.9874	0.3663	0.9874	0.9937
No log	19.2	288	1.0885	0.2829	1.0885	1.0433
No log	19.3333	290	1.2885	0.2935	1.2885	1.1351
No log	19.4667	292	1.3762	0.3005	1.3762	1.1731
No log	19.6	294	1.3593	0.3238	1.3593	1.1659
No log	19.7333	296	1.2488	0.3093	1.2488	1.1175
No log	19.8667	298	1.1717	0.1345	1.1717	1.0824
No log	20.0	300	1.1499	0.1952	1.1499	1.0723
No log	20.1333	302	1.2232	0.1379	1.2232	1.1060
No log	20.2667	304	1.3876	0.2678	1.3876	1.1779
No log	20.4	306	1.4499	0.2325	1.4499	1.2041
No log	20.5333	308	1.4018	0.1345	1.4018	1.1840
No log	20.6667	310	1.2581	0.1379	1.2581	1.1217
No log	20.8	312	1.0999	0.2317	1.0999	1.0487
No log	20.9333	314	1.0528	0.3448	1.0528	1.0261
No log	21.0667	316	1.0422	0.3201	1.0422	1.0209
No log	21.2	318	1.0424	0.3596	1.0424	1.0210
No log	21.3333	320	1.1050	0.3122	1.1050	1.0512
No log	21.4667	322	1.2984	0.1254	1.2984	1.1395
No log	21.6	324	1.5406	0.2711	1.5406	1.2412
No log	21.7333	326	1.6342	0.2759	1.6342	1.2784
No log	21.8667	328	1.5592	0.3105	1.5592	1.2487
No log	22.0	330	1.3871	0.0920	1.3871	1.1777
No log	22.1333	332	1.1973	0.0628	1.1973	1.0942
No log	22.2667	334	1.0950	0.2023	1.0950	1.0464
No log	22.4	336	1.0596	0.2457	1.0596	1.0294
No log	22.5333	338	1.0850	0.2457	1.0850	1.0416
No log	22.6667	340	1.2086	0.1538	1.2086	1.0993
No log	22.8	342	1.4116	0.3205	1.4116	1.1881
No log	22.9333	344	1.4807	0.2863	1.4807	1.2168
No log	23.0667	346	1.4185	0.2122	1.4185	1.1910
No log	23.2	348	1.2807	0.1316	1.2807	1.1317
No log	23.3333	350	1.1589	0.1417	1.1589	1.0765
No log	23.4667	352	1.1186	0.1857	1.1186	1.0576
No log	23.6	354	1.1413	0.1417	1.1413	1.0683
No log	23.7333	356	1.2397	0.1316	1.2397	1.1134
No log	23.8667	358	1.3550	0.1592	1.3550	1.1640
No log	24.0	360	1.3949	0.2736	1.3949	1.1811
No log	24.1333	362	1.3164	0.1646	1.3164	1.1473
No log	24.2667	364	1.2092	0.1379	1.2092	1.0996
No log	24.4	366	1.1119	0.2516	1.1119	1.0545
No log	24.5333	368	1.1101	0.2516	1.1101	1.0536
No log	24.6667	370	1.1565	0.2141	1.1565	1.0754
No log	24.8	372	1.2669	0.2163	1.2669	1.1256
No log	24.9333	374	1.3772	0.2685	1.3772	1.1735
No log	25.0667	376	1.3688	0.2886	1.3688	1.1700
No log	25.2	378	1.2671	0.1162	1.2671	1.1256
No log	25.3333	380	1.2027	0.1692	1.2027	1.0967
No log	25.4667	382	1.1533	0.1795	1.1533	1.0739
No log	25.6	384	1.1596	0.1379	1.1596	1.0769
No log	25.7333	386	1.2194	0.1692	1.2194	1.1043
No log	25.8667	388	1.3332	0.1404	1.3332	1.1546
No log	26.0	390	1.3954	0.2659	1.3954	1.1813
No log	26.1333	392	1.3583	0.2325	1.3583	1.1655
No log	26.2667	394	1.2713	0.1536	1.2713	1.1275
No log	26.4	396	1.1840	0.0980	1.1840	1.0881
No log	26.5333	398	1.1493	0.1417	1.1493	1.0720
No log	26.6667	400	1.1730	0.1417	1.1730	1.0831
No log	26.8	402	1.1832	0.1747	1.1832	1.0878
No log	26.9333	404	1.2656	0.0898	1.2656	1.1250
No log	27.0667	406	1.2900	0.1196	1.2900	1.1358
No log	27.2	408	1.2544	0.1371	1.2544	1.1200
No log	27.3333	410	1.1675	0.2250	1.1675	1.0805
No log	27.4667	412	1.0678	0.2821	1.0678	1.0333
No log	27.6	414	1.0400	0.3122	1.0400	1.0198
No log	27.7333	416	1.0537	0.2821	1.0537	1.0265
No log	27.8667	418	1.1146	0.2516	1.1146	1.0557
No log	28.0	420	1.2374	0.0980	1.2374	1.1124
No log	28.1333	422	1.3007	0.1249	1.3007	1.1405
No log	28.2667	424	1.2832	0.0628	1.2832	1.1328
No log	28.4	426	1.2203	0.1076	1.2203	1.1046
No log	28.5333	428	1.1439	0.1417	1.1439	1.0695
No log	28.6667	430	1.1071	0.1417	1.1071	1.0522
No log	28.8	432	1.1119	0.1857	1.1119	1.0544
No log	28.9333	434	1.1677	0.1582	1.1677	1.0806
No log	29.0667	436	1.2605	0.2390	1.2605	1.1227
No log	29.2	438	1.3052	0.2574	1.3052	1.1424
No log	29.3333	440	1.2712	0.2574	1.2712	1.1275
No log	29.4667	442	1.1951	0.1188	1.1951	1.0932
No log	29.6	444	1.1238	0.1795	1.1238	1.0601
No log	29.7333	446	1.0571	0.2922	1.0571	1.0282
No log	29.8667	448	1.0068	0.2972	1.0068	1.0034
No log	30.0	450	0.9741	0.3720	0.9741	0.9870
No log	30.1333	452	0.9749	0.3720	0.9749	0.9874
No log	30.2667	454	1.0203	0.3073	1.0203	1.0101
No log	30.4	456	1.0801	0.2922	1.0801	1.0393
No log	30.5333	458	1.1403	0.1997	1.1403	1.0678
No log	30.6667	460	1.1662	0.1935	1.1662	1.0799
No log	30.8	462	1.1752	0.1224	1.1752	1.0841
No log	30.9333	464	1.2155	0.1345	1.2155	1.1025
No log	31.0667	466	1.2269	0.1219	1.2269	1.1076
No log	31.2	468	1.1861	0.0887	1.1861	1.0891
No log	31.3333	470	1.1666	0.0887	1.1666	1.0801
No log	31.4667	472	1.1335	0.0887	1.1335	1.0647
No log	31.6	474	1.1022	0.2061	1.1022	1.0499
No log	31.7333	476	1.0891	0.2220	1.0891	1.0436
No log	31.8667	478	1.1138	0.2061	1.1138	1.0554
No log	32.0	480	1.1216	0.2363	1.1216	1.0591
No log	32.1333	482	1.1247	0.1641	1.1247	1.0605
No log	32.2667	484	1.1340	0.1053	1.1340	1.0649
No log	32.4	486	1.1332	0.0628	1.1332	1.0645
No log	32.5333	488	1.1074	0.0628	1.1074	1.0523
No log	32.6667	490	1.1128	0.1053	1.1128	1.0549
No log	32.8	492	1.1486	0.1379	1.1486	1.0717
No log	32.9333	494	1.2128	0.1536	1.2128	1.1013
No log	33.0667	496	1.3271	0.1889	1.3271	1.1520
No log	33.2	498	1.3295	0.1536	1.3295	1.1530
0.2629	33.3333	500	1.2474	0.1219	1.2474	1.1169
0.2629	33.4667	502	1.1484	0.1053	1.1484	1.0717
0.2629	33.6	504	1.0736	0.1417	1.0736	1.0361
0.2629	33.7333	506	1.0532	0.2351	1.0532	1.0263
0.2629	33.8667	508	1.0599	0.2351	1.0599	1.0295
0.2629	34.0	510	1.0827	0.2377	1.0827	1.0405
0.2629	34.1333	512	1.1126	0.1801	1.1126	1.0548
0.2629	34.2667	514	1.1306	0.2108	1.1306	1.0633
0.2629	34.4	516	1.1513	0.1538	1.1513	1.0730
0.2629	34.5333	518	1.2538	0.2317	1.2538	1.1197
0.2629	34.6667	520	1.3419	0.3377	1.3419	1.1584
0.2629	34.8	522	1.3537	0.3188	1.3537	1.1635
0.2629	34.9333	524	1.3310	0.2941	1.3310	1.1537
0.2629	35.0667	526	1.2841	0.2586	1.2841	1.1332
0.2629	35.2	528	1.2135	0.1745	1.2135	1.1016
0.2629	35.3333	530	1.1557	0.1696	1.1557	1.0750
0.2629	35.4667	532	1.1704	0.1538	1.1704	1.0819
0.2629	35.6	534	1.2456	0.1188	1.2456	1.1161
0.2629	35.7333	536	1.3459	0.2173	1.3459	1.1601
0.2629	35.8667	538	1.4298	0.3183	1.4298	1.1958
0.2629	36.0	540	1.4860	0.3287	1.4860	1.2190
0.2629	36.1333	542	1.4957	0.3271	1.4957	1.2230
0.2629	36.2667	544	1.4121	0.3183	1.4121	1.1883
0.2629	36.4	546	1.2956	0.1345	1.2956	1.1382
0.2629	36.5333	548	1.2434	0.1846	1.2434	1.1151
0.2629	36.6667	550	1.2397	0.1846	1.2397	1.1134
0.2629	36.8	552	1.2740	0.1692	1.2740	1.1287
0.2629	36.9333	554	1.2736	0.1536	1.2736	1.1285
0.2629	37.0667	556	1.2448	0.0811	1.2448	1.1157
0.2629	37.2	558	1.2279	0.0811	1.2279	1.1081
0.2629	37.3333	560	1.2367	0.0811	1.2367	1.1121
0.2629	37.4667	562	1.2443	0.1536	1.2443	1.1155
0.2629	37.6	564	1.2322	0.1536	1.2322	1.1101
0.2629	37.7333	566	1.2069	0.1692	1.2069	1.0986
0.2629	37.8667	568	1.2008	0.1692	1.2008	1.0958
0.2629	38.0	570	1.2054	0.1692	1.2054	1.0979
0.2629	38.1333	572	1.2299	0.1536	1.2299	1.1090
0.2629	38.2667	574	1.2525	0.1536	1.2525	1.1191
0.2629	38.4	576	1.2268	0.1692	1.2268	1.1076
0.2629	38.5333	578	1.2544	0.1692	1.2544	1.1200
0.2629	38.6667	580	1.3140	0.1646	1.3140	1.1463
0.2629	38.8	582	1.3960	0.1547	1.3960	1.1815
0.2629	38.9333	584	1.4887	0.2047	1.4887	1.2201
0.2629	39.0667	586	1.5341	0.2485	1.5341	1.2386
0.2629	39.2	588	1.4767	0.1162	1.4767	1.2152
0.2629	39.3333	590	1.3616	0.0454	1.3616	1.1669
0.2629	39.4667	592	1.2718	0.0628	1.2718	1.1278
0.2629	39.6	594	1.2520	0.0454	1.2520	1.1189
0.2629	39.7333	596	1.2524	0.0454	1.2524	1.1191

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1