ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k6_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1639
• Qwk: 0.0980
• Mse: 1.1639
• Rmse: 1.0788

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	4.5909	0.0010	4.5909	2.1426
No log	0.2222	4	2.6316	0.0426	2.6316	1.6222
No log	0.3333	6	2.1548	0.0879	2.1548	1.4679
No log	0.4444	8	1.8800	0.0198	1.8800	1.3711
No log	0.5556	10	1.9055	-0.0492	1.9055	1.3804
No log	0.6667	12	1.6197	-0.0061	1.6197	1.2727
No log	0.7778	14	1.5143	0.0331	1.5143	1.2306
No log	0.8889	16	1.5349	0.0082	1.5349	1.2389
No log	1.0	18	1.4552	0.0297	1.4552	1.2063
No log	1.1111	20	1.3219	0.0918	1.3219	1.1498
No log	1.2222	22	1.2962	0.1495	1.2962	1.1385
No log	1.3333	24	1.3356	0.1845	1.3356	1.1557
No log	1.4444	26	1.4387	0.1502	1.4387	1.1995
No log	1.5556	28	1.4388	0.1279	1.4388	1.1995
No log	1.6667	30	1.4168	0.1396	1.4168	1.1903
No log	1.7778	32	1.3277	0.1387	1.3277	1.1522
No log	1.8889	34	1.3205	0.1118	1.3205	1.1491
No log	2.0	36	1.2946	0.1059	1.2946	1.1378
No log	2.1111	38	1.3113	0.3019	1.3113	1.1451
No log	2.2222	40	1.4296	0.1501	1.4296	1.1957
No log	2.3333	42	1.5130	0.1364	1.5130	1.2300
No log	2.4444	44	1.5160	0.1689	1.5160	1.2313
No log	2.5556	46	1.3871	0.0156	1.3871	1.1777
No log	2.6667	48	1.3058	0.2105	1.3058	1.1427
No log	2.7778	50	1.2884	0.1898	1.2884	1.1351
No log	2.8889	52	1.2691	0.1950	1.2691	1.1265
No log	3.0	54	1.2310	0.2410	1.2310	1.1095
No log	3.1111	56	1.2108	0.2779	1.2108	1.1004
No log	3.2222	58	1.1830	0.3081	1.1830	1.0877
No log	3.3333	60	1.2417	0.1455	1.2417	1.1143
No log	3.4444	62	1.4674	0.0588	1.4674	1.2114
No log	3.5556	64	1.4909	0.0967	1.4909	1.2210
No log	3.6667	66	1.2633	0.1363	1.2633	1.1240
No log	3.7778	68	1.1849	0.2567	1.1849	1.0885
No log	3.8889	70	1.2087	0.2970	1.2087	1.0994
No log	4.0	72	1.4393	0.1855	1.4393	1.1997
No log	4.1111	74	1.3820	0.1280	1.3820	1.1756
No log	4.2222	76	1.3226	0.1493	1.3226	1.1501
No log	4.3333	78	1.3612	0.0314	1.3612	1.1667
No log	4.4444	80	1.1886	0.2244	1.1886	1.0902
No log	4.5556	82	1.2311	0.2275	1.2311	1.1096
No log	4.6667	84	1.3720	0.3867	1.3720	1.1713
No log	4.7778	86	1.2772	0.3467	1.2772	1.1301
No log	4.8889	88	1.0877	0.3982	1.0877	1.0429
No log	5.0	90	1.1192	0.4167	1.1192	1.0579
No log	5.1111	92	1.3333	0.3699	1.3333	1.1547
No log	5.2222	94	1.2835	0.3478	1.2835	1.1329
No log	5.3333	96	1.1923	0.2418	1.1923	1.0919
No log	5.4444	98	1.2103	0.2634	1.2103	1.1002
No log	5.5556	100	1.0950	0.3046	1.0950	1.0464
No log	5.6667	102	0.9911	0.3834	0.9911	0.9955
No log	5.7778	104	1.0312	0.2976	1.0312	1.0155
No log	5.8889	106	1.1158	0.3325	1.1158	1.0563
No log	6.0	108	1.3200	0.2757	1.3200	1.1489
No log	6.1111	110	1.4388	0.3026	1.4388	1.1995
No log	6.2222	112	1.2375	0.3136	1.2375	1.1124
No log	6.3333	114	0.9966	0.1977	0.9966	0.9983
No log	6.4444	116	1.0231	0.2871	1.0231	1.0115
No log	6.5556	118	1.0294	0.3205	1.0294	1.0146
No log	6.6667	120	1.0046	0.3237	1.0046	1.0023
No log	6.7778	122	1.1582	0.3540	1.1582	1.0762
No log	6.8889	124	1.4659	0.3667	1.4659	1.2107
No log	7.0	126	1.6674	0.2691	1.6674	1.2913
No log	7.1111	128	1.5963	0.3116	1.5963	1.2634
No log	7.2222	130	1.3107	0.3824	1.3107	1.1448
No log	7.3333	132	1.0748	0.2637	1.0748	1.0367
No log	7.4444	134	1.0198	0.3729	1.0198	1.0099
No log	7.5556	136	1.0453	0.3979	1.0453	1.0224
No log	7.6667	138	1.1221	0.3758	1.1221	1.0593
No log	7.7778	140	1.3765	0.3706	1.3765	1.1733
No log	7.8889	142	1.4434	0.3620	1.4434	1.2014
No log	8.0	144	1.2476	0.3536	1.2476	1.1170
No log	8.1111	146	1.1072	0.4236	1.1072	1.0522
No log	8.2222	148	1.1204	0.3764	1.1204	1.0585
No log	8.3333	150	1.1503	0.2716	1.1503	1.0725
No log	8.4444	152	1.1524	0.2409	1.1524	1.0735
No log	8.5556	154	1.2318	0.2141	1.2318	1.1099
No log	8.6667	156	1.2683	0.2141	1.2683	1.1262
No log	8.7778	158	1.3557	0.1801	1.3557	1.1643
No log	8.8889	160	1.2905	0.1989	1.2905	1.1360
No log	9.0	162	1.1698	0.2417	1.1698	1.0816
No log	9.1111	164	1.1026	0.2528	1.1026	1.0500
No log	9.2222	166	1.1109	0.2512	1.1109	1.0540
No log	9.3333	168	1.2046	0.3528	1.2046	1.0975
No log	9.4444	170	1.5024	0.3404	1.5024	1.2257
No log	9.5556	172	1.5841	0.3667	1.5841	1.2586
No log	9.6667	174	1.4057	0.3324	1.4057	1.1856
No log	9.7778	176	1.1594	0.3237	1.1594	1.0768
No log	9.8889	178	1.0531	0.2432	1.0531	1.0262
No log	10.0	180	1.0693	0.2965	1.0693	1.0341
No log	10.1111	182	1.0539	0.2822	1.0539	1.0266
No log	10.2222	184	1.1260	0.2065	1.1260	1.0611
No log	10.3333	186	1.2724	0.1801	1.2724	1.1280
No log	10.4444	188	1.4703	0.3005	1.4703	1.2125
No log	10.5556	190	1.4864	0.3595	1.4864	1.2192
No log	10.6667	192	1.3475	0.3293	1.3475	1.1608
No log	10.7778	194	1.1755	0.3365	1.1755	1.0842
No log	10.8889	196	1.0817	0.3624	1.0817	1.0401
No log	11.0	198	1.1336	0.3294	1.1336	1.0647
No log	11.1111	200	1.2318	0.375	1.2318	1.1099
No log	11.2222	202	1.3285	0.3545	1.3285	1.1526
No log	11.3333	204	1.2536	0.2337	1.2536	1.1197
No log	11.4444	206	1.1830	0.2693	1.1830	1.0877
No log	11.5556	208	1.1563	0.2693	1.1563	1.0753
No log	11.6667	210	1.1386	0.2664	1.1386	1.0670
No log	11.7778	212	1.0487	0.3165	1.0487	1.0241
No log	11.8889	214	1.0241	0.2673	1.0241	1.0120
No log	12.0	216	1.0397	0.3165	1.0397	1.0196
No log	12.1111	218	1.0442	0.3547	1.0442	1.0218
No log	12.2222	220	1.1068	0.2844	1.1068	1.0520
No log	12.3333	222	1.2119	0.3136	1.2119	1.1009
No log	12.4444	224	1.2517	0.3047	1.2517	1.1188
No log	12.5556	226	1.2658	0.3621	1.2658	1.1251
No log	12.6667	228	1.2580	0.3429	1.2580	1.1216
No log	12.7778	230	1.2436	0.3621	1.2436	1.1152
No log	12.8889	232	1.1151	0.3491	1.1151	1.0560
No log	13.0	234	1.0642	0.3154	1.0642	1.0316
No log	13.1111	236	1.1236	0.2745	1.1236	1.0600
No log	13.2222	238	1.2899	0.2132	1.2899	1.1357
No log	13.3333	240	1.3998	0.2704	1.3998	1.1831
No log	13.4444	242	1.4100	0.2985	1.4100	1.1874
No log	13.5556	244	1.2562	0.3155	1.2562	1.1208
No log	13.6667	246	1.1059	0.2604	1.1059	1.0516
No log	13.7778	248	1.0433	0.2678	1.0433	1.0214
No log	13.8889	250	1.0441	0.2678	1.0441	1.0218
No log	14.0	252	1.0686	0.1969	1.0686	1.0337
No log	14.1111	254	1.2406	0.3461	1.2406	1.1138
No log	14.2222	256	1.3861	0.3431	1.3861	1.1773
No log	14.3333	258	1.3604	0.3418	1.3604	1.1664
No log	14.4444	260	1.2057	0.3726	1.2057	1.0980
No log	14.5556	262	1.0513	0.4031	1.0513	1.0254
No log	14.6667	264	0.9978	0.3408	0.9978	0.9989
No log	14.7778	266	1.0044	0.3117	1.0044	1.0022
No log	14.8889	268	1.0863	0.3864	1.0863	1.0423
No log	15.0	270	1.2368	0.3277	1.2368	1.1121
No log	15.1111	272	1.2501	0.2807	1.2501	1.1181
No log	15.2222	274	1.2606	0.2122	1.2606	1.1228
No log	15.3333	276	1.1610	0.1943	1.1610	1.0775
No log	15.4444	278	1.0571	0.3243	1.0571	1.0282
No log	15.5556	280	1.0469	0.3144	1.0469	1.0232
No log	15.6667	282	1.1107	0.3579	1.1107	1.0539
No log	15.7778	284	1.1205	0.3579	1.1205	1.0585
No log	15.8889	286	1.0857	0.3908	1.0857	1.0420
No log	16.0	288	1.0819	0.3816	1.0819	1.0401
No log	16.1111	290	1.1108	0.3667	1.1108	1.0540
No log	16.2222	292	1.1749	0.3978	1.1749	1.0839
No log	16.3333	294	1.1759	0.3488	1.1759	1.0844
No log	16.4444	296	1.1995	0.2037	1.1995	1.0952
No log	16.5556	298	1.2013	0.1692	1.2013	1.0960
No log	16.6667	300	1.2382	0.1991	1.2382	1.1127
No log	16.7778	302	1.2207	0.2424	1.2207	1.1049
No log	16.8889	304	1.1421	0.2570	1.1421	1.0687
No log	17.0	306	1.0664	0.2454	1.0664	1.0327
No log	17.1111	308	1.0722	0.2343	1.0722	1.0355
No log	17.2222	310	1.1484	0.3072	1.1484	1.0716
No log	17.3333	312	1.2564	0.2931	1.2564	1.1209
No log	17.4444	314	1.2311	0.2931	1.2311	1.1095
No log	17.5556	316	1.1095	0.2714	1.1095	1.0533
No log	17.6667	318	1.0496	0.3517	1.0496	1.0245
No log	17.7778	320	1.0576	0.3897	1.0576	1.0284
No log	17.8889	322	1.1291	0.3870	1.1291	1.0626
No log	18.0	324	1.2394	0.3301	1.2394	1.1133
No log	18.1111	326	1.2576	0.3301	1.2576	1.1214
No log	18.2222	328	1.1806	0.3474	1.1806	1.0865
No log	18.3333	330	1.1573	0.3292	1.1573	1.0758
No log	18.4444	332	1.2258	0.3501	1.2258	1.1072
No log	18.5556	334	1.2613	0.3243	1.2613	1.1231
No log	18.6667	336	1.2163	0.2931	1.2163	1.1029
No log	18.7778	338	1.1390	0.2291	1.1390	1.0672
No log	18.8889	340	1.0419	0.2551	1.0419	1.0208
No log	19.0	342	1.0180	0.2865	1.0180	1.0090
No log	19.1111	344	1.0599	0.3489	1.0599	1.0295
No log	19.2222	346	1.2061	0.3187	1.2061	1.0982
No log	19.3333	348	1.3410	0.3113	1.3410	1.1580
No log	19.4444	350	1.3566	0.2870	1.3566	1.1647
No log	19.5556	352	1.2729	0.2037	1.2729	1.1282
No log	19.6667	354	1.2635	0.2037	1.2635	1.1240
No log	19.7778	356	1.2491	0.1745	1.2491	1.1176
No log	19.8889	358	1.2438	0.1745	1.2438	1.1153
No log	20.0	360	1.3018	0.2037	1.3018	1.1410
No log	20.1111	362	1.3097	0.2037	1.3097	1.1444
No log	20.2222	364	1.2592	0.1944	1.2592	1.1221
No log	20.3333	366	1.1952	0.1741	1.1952	1.0933
No log	20.4444	368	1.2035	0.2348	1.2035	1.0971
No log	20.5556	370	1.3346	0.2647	1.3346	1.1552
No log	20.6667	372	1.4056	0.3113	1.4056	1.1856
No log	20.7778	374	1.4358	0.3093	1.4358	1.1983
No log	20.8889	376	1.3472	0.2586	1.3472	1.1607
No log	21.0	378	1.2391	0.2424	1.2391	1.1132
No log	21.1111	380	1.1411	0.1795	1.1411	1.0682
No log	21.2222	382	1.1377	0.1952	1.1377	1.0666
No log	21.3333	384	1.1263	0.2108	1.1263	1.0613
No log	21.4444	386	1.1283	0.2009	1.1283	1.0622
No log	21.5556	388	1.1902	0.2424	1.1902	1.0910
No log	21.6667	390	1.2832	0.2037	1.2832	1.1328
No log	21.7778	392	1.3285	0.2037	1.3285	1.1526
No log	21.8889	394	1.2971	0.2037	1.2971	1.1389
No log	22.0	396	1.2454	0.1745	1.2454	1.1160
No log	22.1111	398	1.1827	0.1379	1.1827	1.0875
No log	22.2222	400	1.1506	0.1952	1.1506	1.0727
No log	22.3333	402	1.1399	0.1853	1.1399	1.0676
No log	22.4444	404	1.1973	0.2570	1.1973	1.0942
No log	22.5556	406	1.2980	0.2844	1.2980	1.1393
No log	22.6667	408	1.4173	0.3006	1.4173	1.1905
No log	22.7778	410	1.4319	0.3006	1.4319	1.1966
No log	22.8889	412	1.3616	0.2817	1.3616	1.1669
No log	23.0	414	1.2204	0.1053	1.2204	1.1047
No log	23.1111	416	1.1694	0.1582	1.1694	1.0814
No log	23.2222	418	1.1942	0.1148	1.1942	1.0928
No log	23.3333	420	1.1838	0.1582	1.1838	1.0880
No log	23.4444	422	1.1872	0.1582	1.1872	1.0896
No log	23.5556	424	1.2208	0.1952	1.2208	1.1049
No log	23.6667	426	1.2195	0.25	1.2195	1.1043
No log	23.7778	428	1.1903	0.1853	1.1903	1.0910
No log	23.8889	430	1.1595	0.1541	1.1595	1.0768
No log	24.0	432	1.1517	0.1480	1.1517	1.0732
No log	24.1111	434	1.1788	0.1480	1.1788	1.0857
No log	24.2222	436	1.2334	0.1053	1.2334	1.1106
No log	24.3333	438	1.2255	0.1479	1.2255	1.1070
No log	24.4444	440	1.2803	0.1379	1.2803	1.1315
No log	24.5556	442	1.3194	0.1379	1.3194	1.1487
No log	24.6667	444	1.2833	0.1379	1.2833	1.1328
No log	24.7778	446	1.1947	0.1541	1.1947	1.0930
No log	24.8889	448	1.1518	0.1480	1.1518	1.0732
No log	25.0	450	1.1365	0.1645	1.1365	1.0661
No log	25.1111	452	1.1702	0.1480	1.1702	1.0818
No log	25.2222	454	1.2322	0.1538	1.2322	1.1100
No log	25.3333	456	1.2827	0.1379	1.2827	1.1326
No log	25.4444	458	1.2906	0.1379	1.2906	1.1360
No log	25.5556	460	1.2466	0.1379	1.2466	1.1165
No log	25.6667	462	1.2246	0.1441	1.2246	1.1066
No log	25.7778	464	1.1969	0.1441	1.1969	1.0940
No log	25.8889	466	1.1573	0.1853	1.1573	1.0758
No log	26.0	468	1.0954	0.2290	1.0954	1.0466
No log	26.1111	470	1.0630	0.2188	1.0630	1.0310
No log	26.2222	472	1.0494	0.2188	1.0494	1.0244
No log	26.3333	474	1.0768	0.2587	1.0768	1.0377
No log	26.4444	476	1.1617	0.1903	1.1617	1.0778
No log	26.5556	478	1.2895	0.2424	1.2895	1.1355
No log	26.6667	480	1.3490	0.2941	1.3490	1.1615
No log	26.7778	482	1.2979	0.2457	1.2979	1.1392
No log	26.8889	484	1.1856	0.2195	1.1856	1.0889
No log	27.0	486	1.0759	0.2621	1.0759	1.0372
No log	27.1111	488	1.0464	0.2605	1.0464	1.0229
No log	27.2222	490	1.0629	0.2290	1.0629	1.0310
No log	27.3333	492	1.1189	0.1961	1.1189	1.0578
No log	27.4444	494	1.2386	0.1379	1.2386	1.1129
No log	27.5556	496	1.3307	0.2278	1.3307	1.1536
No log	27.6667	498	1.3407	0.2278	1.3407	1.1579
0.3017	27.7778	500	1.2803	0.1991	1.2803	1.1315
0.3017	27.8889	502	1.2134	0.2141	1.2134	1.1015
0.3017	28.0	504	1.1330	0.1853	1.1330	1.0644
0.3017	28.1111	506	1.0979	0.2164	1.0979	1.0478
0.3017	28.2222	508	1.1210	0.2263	1.1210	1.0588
0.3017	28.3333	510	1.1745	0.2439	1.1745	1.0837
0.3017	28.4444	512	1.1997	0.2141	1.1997	1.0953
0.3017	28.5556	514	1.1894	0.1991	1.1894	1.0906
0.3017	28.6667	516	1.1816	0.1991	1.1816	1.0870
0.3017	28.7778	518	1.1871	0.1944	1.1871	1.0896
0.3017	28.8889	520	1.1899	0.1379	1.1899	1.0908
0.3017	29.0	522	1.1639	0.0980	1.1639	1.0788

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1