ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k12_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1941
• Qwk: 0.1944
• Mse: 1.1941
• Rmse: 1.0927

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0571	2	4.8838	-0.0104	4.8838	2.2099
No log	0.1143	4	2.8157	0.0537	2.8157	1.6780
No log	0.1714	6	2.0922	-0.0102	2.0922	1.4464
No log	0.2286	8	2.0388	-0.0370	2.0388	1.4279
No log	0.2857	10	2.1018	-0.0690	2.1018	1.4498
No log	0.3429	12	1.8533	0.0372	1.8533	1.3614
No log	0.4	14	1.7694	0.1060	1.7694	1.3302
No log	0.4571	16	1.6398	0.0691	1.6398	1.2806
No log	0.5143	18	1.2587	0.0230	1.2587	1.1219
No log	0.5714	20	1.1692	0.1689	1.1692	1.0813
No log	0.6286	22	1.1803	0.1247	1.1803	1.0864
No log	0.6857	24	1.1890	0.1689	1.1890	1.0904
No log	0.7429	26	1.2154	0.1247	1.2154	1.1024
No log	0.8	28	1.2148	0.1144	1.2148	1.1022
No log	0.8571	30	1.2261	0.1423	1.2261	1.1073
No log	0.9143	32	1.2372	0.1733	1.2372	1.1123
No log	0.9714	34	1.2094	0.1605	1.2094	1.0997
No log	1.0286	36	1.2322	0.0612	1.2322	1.1100
No log	1.0857	38	1.3038	0.0442	1.3038	1.1418
No log	1.1429	40	1.3008	0.0253	1.3008	1.1405
No log	1.2	42	1.3142	-0.0218	1.3142	1.1464
No log	1.2571	44	1.3672	-0.0160	1.3672	1.1693
No log	1.3143	46	1.3534	-0.0735	1.3534	1.1634
No log	1.3714	48	1.2178	0.2108	1.2178	1.1036
No log	1.4286	50	1.5847	0.1135	1.5847	1.2588
No log	1.4857	52	1.8125	0.0084	1.8125	1.3463
No log	1.5429	54	1.6617	0.0	1.6617	1.2891
No log	1.6	56	1.4469	0.0488	1.4469	1.2029
No log	1.6571	58	1.2315	0.1165	1.2315	1.1097
No log	1.7143	60	1.1165	0.2886	1.1165	1.0566
No log	1.7714	62	1.1385	0.0974	1.1385	1.0670
No log	1.8286	64	1.2224	0.0527	1.2224	1.1056
No log	1.8857	66	1.2263	0.1755	1.2263	1.1074
No log	1.9429	68	1.2246	0.1904	1.2246	1.1066
No log	2.0	70	1.2434	0.2047	1.2434	1.1151
No log	2.0571	72	1.4092	0.1685	1.4092	1.1871
No log	2.1143	74	1.9516	0.1385	1.9516	1.3970
No log	2.1714	76	1.9469	0.1135	1.9469	1.3953
No log	2.2286	78	1.9344	0.0165	1.9344	1.3908
No log	2.2857	80	1.5262	0.2051	1.5262	1.2354
No log	2.3429	82	1.3282	0.1837	1.3282	1.1525
No log	2.4	84	1.2960	0.1795	1.2960	1.1384
No log	2.4571	86	1.4351	0.2662	1.4351	1.1980
No log	2.5143	88	1.3190	0.3525	1.3190	1.1485
No log	2.5714	90	1.2753	0.3303	1.2753	1.1293
No log	2.6286	92	1.2241	0.3148	1.2241	1.1064
No log	2.6857	94	1.1955	0.3148	1.1955	1.0934
No log	2.7429	96	1.2738	0.2742	1.2738	1.1286
No log	2.8	98	1.2101	0.2605	1.2101	1.1000
No log	2.8571	100	1.0232	0.3943	1.0232	1.0115
No log	2.9143	102	1.0033	0.4397	1.0033	1.0016
No log	2.9714	104	1.0493	0.3173	1.0493	1.0243
No log	3.0286	106	1.6060	0.3541	1.6060	1.2673
No log	3.0857	108	1.6162	0.3720	1.6162	1.2713
No log	3.1429	110	1.2439	0.3364	1.2439	1.1153
No log	3.2	112	1.1553	0.3614	1.1553	1.0749
No log	3.2571	114	1.0697	0.3516	1.0697	1.0342
No log	3.3143	116	1.2607	0.3513	1.2607	1.1228
No log	3.3714	118	1.2394	0.3466	1.2394	1.1133
No log	3.4286	120	1.3292	0.3467	1.3292	1.1529
No log	3.4857	122	1.3292	0.3467	1.3292	1.1529
No log	3.5429	124	1.0613	0.3923	1.0613	1.0302
No log	3.6	126	1.0279	0.3664	1.0279	1.0138
No log	3.6571	128	1.1649	0.3398	1.1649	1.0793
No log	3.7143	130	1.5627	0.3099	1.5627	1.2501
No log	3.7714	132	1.6844	0.2804	1.6844	1.2978
No log	3.8286	134	1.5542	0.2804	1.5542	1.2467
No log	3.8857	136	1.2511	0.3101	1.2511	1.1185
No log	3.9429	138	1.1411	0.3201	1.1411	1.0682
No log	4.0	140	1.1346	0.3505	1.1346	1.0652
No log	4.0571	142	1.2403	0.3079	1.2403	1.1137
No log	4.1143	144	1.6380	0.2770	1.6380	1.2798
No log	4.1714	146	1.9107	0.1100	1.9107	1.3823
No log	4.2286	148	1.8453	0.1745	1.8453	1.3584
No log	4.2857	150	1.6032	0.2435	1.6032	1.2662
No log	4.3429	152	1.2442	0.2511	1.2442	1.1154
No log	4.4	154	1.0990	0.2883	1.0990	1.0483
No log	4.4571	156	1.1292	0.3000	1.1292	1.0627
No log	4.5143	158	1.2858	0.3180	1.2858	1.1339
No log	4.5714	160	1.3342	0.3045	1.3342	1.1551
No log	4.6286	162	1.2584	0.2471	1.2584	1.1218
No log	4.6857	164	1.2060	0.2367	1.2060	1.0982
No log	4.7429	166	1.2187	0.2664	1.2187	1.1040
No log	4.8	168	1.2565	0.2773	1.2565	1.1209
No log	4.8571	170	1.1106	0.2930	1.1106	1.0538
No log	4.9143	172	1.0847	0.2930	1.0847	1.0415
No log	4.9714	174	1.1536	0.3975	1.1536	1.0740
No log	5.0286	176	1.3565	0.2582	1.3565	1.1647
No log	5.0857	178	1.4385	0.3063	1.4385	1.1994
No log	5.1429	180	1.3185	0.2698	1.3185	1.1483
No log	5.2	182	1.2357	0.3361	1.2357	1.1116
No log	5.2571	184	1.3461	0.2633	1.3461	1.1602
No log	5.3143	186	1.4521	0.3283	1.4521	1.2050
No log	5.3714	188	1.2770	0.2457	1.2770	1.1301
No log	5.4286	190	1.1309	0.1379	1.1309	1.0635
No log	5.4857	192	1.1033	0.1860	1.1033	1.0504
No log	5.5429	194	1.1692	0.1951	1.1692	1.0813
No log	5.6	196	1.3330	0.3006	1.3330	1.1545
No log	5.6571	198	1.3998	0.2829	1.3998	1.1831
No log	5.7143	200	1.2539	0.2080	1.2539	1.1198
No log	5.7714	202	1.0799	0.1379	1.0799	1.0392
No log	5.8286	204	1.0145	0.2086	1.0145	1.0072
No log	5.8857	206	1.0118	0.2244	1.0118	1.0059
No log	5.9429	208	1.0710	0.2304	1.0710	1.0349
No log	6.0	210	1.2286	0.2881	1.2286	1.1084
No log	6.0571	212	1.4335	0.3416	1.4335	1.1973
No log	6.1143	214	1.4186	0.3416	1.4186	1.1910
No log	6.1714	216	1.2753	0.3209	1.2753	1.1293
No log	6.2286	218	1.1010	0.3618	1.1010	1.0493
No log	6.2857	220	1.1098	0.3094	1.1098	1.0535
No log	6.3429	222	1.2406	0.3003	1.2406	1.1138
No log	6.4	224	1.2555	0.2754	1.2555	1.1205
No log	6.4571	226	1.1744	0.1896	1.1744	1.0837
No log	6.5143	228	1.0545	0.1911	1.0545	1.0269
No log	6.5714	230	1.0130	0.2486	1.0130	1.0065
No log	6.6286	232	1.0512	0.2486	1.0512	1.0253
No log	6.6857	234	1.2159	0.2851	1.2159	1.1027
No log	6.7429	236	1.4123	0.2782	1.4123	1.1884
No log	6.8	238	1.4639	0.2782	1.4639	1.2099
No log	6.8571	240	1.3351	0.2721	1.3351	1.1555
No log	6.9143	242	1.2484	0.2313	1.2484	1.1173
No log	6.9714	244	1.2123	0.2275	1.2123	1.1011
No log	7.0286	246	1.2565	0.1997	1.2565	1.1210
No log	7.0857	248	1.2773	0.1997	1.2773	1.1302
No log	7.1429	250	1.2667	0.2275	1.2667	1.1255
No log	7.2	252	1.3281	0.2664	1.3281	1.1524
No log	7.2571	254	1.3954	0.2693	1.3954	1.1813
No log	7.3143	256	1.3725	0.2664	1.3725	1.1715
No log	7.3714	258	1.3453	0.2754	1.3453	1.1599
No log	7.4286	260	1.2374	0.1951	1.2374	1.1124
No log	7.4857	262	1.1936	0.2100	1.1936	1.0925
No log	7.5429	264	1.2656	0.2090	1.2656	1.1250
No log	7.6	266	1.2154	0.1903	1.2154	1.1025
No log	7.6571	268	1.2368	0.2097	1.2368	1.1121
No log	7.7143	270	1.4361	0.1171	1.4361	1.1984
No log	7.7714	272	1.7260	0.2170	1.7260	1.3138
No log	7.8286	274	1.7619	0.2022	1.7619	1.3274
No log	7.8857	276	1.5610	0.1929	1.5610	1.2494
No log	7.9429	278	1.2755	0.1637	1.2755	1.1294
No log	8.0	280	1.0933	0.1546	1.0933	1.0456
No log	8.0571	282	1.0795	0.2939	1.0795	1.0390
No log	8.1143	284	1.0819	0.2939	1.0819	1.0401
No log	8.1714	286	1.0912	0.1379	1.0912	1.0446
No log	8.2286	288	1.1911	0.1379	1.1911	1.0914
No log	8.2857	290	1.3401	0.1991	1.3401	1.1576
No log	8.3429	292	1.3690	0.2278	1.3690	1.1700
No log	8.4	294	1.2615	0.2046	1.2615	1.1232
No log	8.4571	296	1.1531	0.1761	1.1531	1.0738
No log	8.5143	298	1.1469	0.1443	1.1469	1.0709
No log	8.5714	300	1.1789	0.1048	1.1789	1.0858
No log	8.6286	302	1.2965	0.0980	1.2965	1.1387
No log	8.6857	304	1.5022	0.2173	1.5022	1.2256
No log	8.7429	306	1.6922	0.1453	1.6922	1.3009
No log	8.8	308	1.6375	0.2009	1.6375	1.2797
No log	8.8571	310	1.3854	0.2122	1.3854	1.1770
No log	8.9143	312	1.2599	0.2097	1.2599	1.1225
No log	8.9714	314	1.2840	0.2141	1.2840	1.1332
No log	9.0286	316	1.3450	0.2080	1.3450	1.1597
No log	9.0857	318	1.2678	0.1944	1.2678	1.1260
No log	9.1429	320	1.2095	0.1755	1.2095	1.0998
No log	9.2	322	1.2183	0.2056	1.2183	1.1038
No log	9.2571	324	1.3068	0.2132	1.3068	1.1431
No log	9.3143	326	1.2937	0.2132	1.2937	1.1374
No log	9.3714	328	1.2964	0.2132	1.2964	1.1386
No log	9.4286	330	1.2402	0.1951	1.2402	1.1136
No log	9.4857	332	1.2060	0.1903	1.2060	1.0982
No log	9.5429	334	1.2146	0.1599	1.2146	1.1021
No log	9.6	336	1.3180	0.2097	1.3180	1.1481
No log	9.6571	338	1.3299	0.2097	1.3299	1.1532
No log	9.7143	340	1.2854	0.2000	1.2854	1.1338
No log	9.7714	342	1.2229	0.2000	1.2229	1.1059
No log	9.8286	344	1.1311	0.2110	1.1311	1.0636
No log	9.8857	346	1.1341	0.2110	1.1341	1.0650
No log	9.9429	348	1.2246	0.2475	1.2246	1.1066
No log	10.0	350	1.4863	0.2950	1.4863	1.2191
No log	10.0571	352	1.6537	0.3383	1.6537	1.2860
No log	10.1143	354	1.5737	0.3173	1.5737	1.2545
No log	10.1714	356	1.3885	0.3067	1.3885	1.1783
No log	10.2286	358	1.2455	0.2354	1.2455	1.1160
No log	10.2857	360	1.2040	0.1944	1.2040	1.0973
No log	10.3429	362	1.2265	0.1944	1.2265	1.1075
No log	10.4	364	1.2396	0.1944	1.2396	1.1134
No log	10.4571	366	1.2574	0.1944	1.2574	1.1213
No log	10.5143	368	1.3417	0.3093	1.3417	1.1583
No log	10.5714	370	1.3007	0.3093	1.3007	1.1405
No log	10.6286	372	1.1333	0.2291	1.1333	1.0646
No log	10.6857	374	1.0800	0.1814	1.0800	1.0392
No log	10.7429	376	1.1184	0.1807	1.1184	1.0576
No log	10.8	378	1.2232	0.2761	1.2232	1.1060
No log	10.8571	380	1.2932	0.1637	1.2932	1.1372
No log	10.9143	382	1.3003	0.1637	1.3003	1.1403
No log	10.9714	384	1.2201	0.1316	1.2201	1.1046
No log	11.0286	386	1.1945	0.1637	1.1945	1.0929
No log	11.0857	388	1.1503	0.1538	1.1503	1.0725
No log	11.1429	390	1.1646	0.1846	1.1646	1.0792
No log	11.2	392	1.1919	0.2790	1.1919	1.0917
No log	11.2571	394	1.1309	0.2000	1.1309	1.0634
No log	11.3143	396	1.1482	0.1846	1.1482	1.0715
No log	11.3714	398	1.1528	0.1637	1.1528	1.0737
No log	11.4286	400	1.1639	0.1944	1.1639	1.0789
No log	11.4857	402	1.1971	0.2484	1.1971	1.0941
No log	11.5429	404	1.1688	0.2387	1.1688	1.0811
No log	11.6	406	1.0843	0.2076	1.0843	1.0413
No log	11.6571	408	1.0912	0.2621	1.0912	1.0446
No log	11.7143	410	1.1715	0.2743	1.1715	1.0824
No log	11.7714	412	1.2644	0.3049	1.2644	1.1245
No log	11.8286	414	1.3179	0.2424	1.3179	1.1480
No log	11.8857	416	1.2167	0.2696	1.2167	1.1030
No log	11.9429	418	1.0812	0.1711	1.0812	1.0398
No log	12.0	420	1.0428	0.2782	1.0428	1.0212
No log	12.0571	422	1.0449	0.2782	1.0449	1.0222
No log	12.1143	424	1.1301	0.2439	1.1301	1.0631
No log	12.1714	426	1.3694	0.2020	1.3694	1.1702
No log	12.2286	428	1.5320	0.2685	1.5320	1.2377
No log	12.2857	430	1.4627	0.2217	1.4627	1.2094
No log	12.3429	432	1.3212	0.1944	1.3212	1.1495
No log	12.4	434	1.1616	0.1316	1.1616	1.0778
No log	12.4571	436	1.0563	0.2130	1.0563	1.0278
No log	12.5143	438	1.0552	0.2619	1.0552	1.0272
No log	12.5714	440	1.0939	0.1048	1.0939	1.0459
No log	12.6286	442	1.1683	0.1316	1.1683	1.0809
No log	12.6857	444	1.2698	0.2131	1.2698	1.1269
No log	12.7429	446	1.3146	0.2678	1.3146	1.1465
No log	12.8	448	1.3242	0.2512	1.3242	1.1507
No log	12.8571	450	1.2361	0.3299	1.2361	1.1118
No log	12.9143	452	1.1415	0.2978	1.1415	1.0684
No log	12.9714	454	1.1602	0.3231	1.1602	1.0771
No log	13.0286	456	1.1729	0.3094	1.1729	1.0830
No log	13.0857	458	1.2124	0.3049	1.2124	1.1011
No log	13.1429	460	1.2322	0.3049	1.2322	1.1100
No log	13.2	462	1.2105	0.2519	1.2105	1.1002
No log	13.2571	464	1.2062	0.1316	1.2062	1.0983
No log	13.3143	466	1.2027	0.1316	1.2027	1.0967
No log	13.3714	468	1.1630	0.1316	1.1630	1.0784
No log	13.4286	470	1.1288	0.0980	1.1288	1.0624
No log	13.4857	472	1.1205	0.0980	1.1205	1.0585
No log	13.5429	474	1.0952	0.0880	1.0952	1.0465
No log	13.6	476	1.0978	0.0880	1.0978	1.0478
No log	13.6571	478	1.1510	0.1316	1.1510	1.0729
No log	13.7143	480	1.2332	0.2195	1.2332	1.1105
No log	13.7714	482	1.3136	0.3049	1.3136	1.1461
No log	13.8286	484	1.3529	0.2676	1.3529	1.1631
No log	13.8857	486	1.3100	0.3049	1.3100	1.1446
No log	13.9429	488	1.2151	0.2195	1.2151	1.1023
No log	14.0	490	1.1637	0.1379	1.1637	1.0787
No log	14.0571	492	1.1878	0.1217	1.1878	1.0899
No log	14.1143	494	1.2783	0.1894	1.2783	1.1306
No log	14.1714	496	1.4440	0.1698	1.4440	1.2017
No log	14.2286	498	1.5212	0.2359	1.5212	1.2334
0.3588	14.2857	500	1.4885	0.2065	1.4885	1.2200
0.3588	14.3429	502	1.3821	0.2519	1.3821	1.1756
0.3588	14.4	504	1.1988	0.1894	1.1988	1.0949
0.3588	14.4571	506	1.0751	0.1761	1.0751	1.0369
0.3588	14.5143	508	1.0382	0.1711	1.0382	1.0189
0.3588	14.5714	510	1.0731	0.1602	1.0731	1.0359
0.3588	14.6286	512	1.1941	0.1944	1.1941	1.0927

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1