ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k13_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3018
• Qwk: 0.0510
• Mse: 1.3018
• Rmse: 1.1410

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0645	2	4.2210	-0.0230	4.2210	2.0545
No log	0.1290	4	2.7231	-0.0397	2.7231	1.6502
No log	0.1935	6	2.2480	-0.0189	2.2480	1.4993
No log	0.2581	8	1.6561	-0.0144	1.6561	1.2869
No log	0.3226	10	1.4944	0.0	1.4944	1.2225
No log	0.3871	12	1.3455	0.0	1.3455	1.1600
No log	0.4516	14	1.1805	0.2260	1.1805	1.0865
No log	0.5161	16	1.1394	0.2376	1.1394	1.0674
No log	0.5806	18	1.2602	0.0704	1.2602	1.1226
No log	0.6452	20	1.4082	0.0775	1.4082	1.1867
No log	0.7097	22	1.4930	0.0827	1.4930	1.2219
No log	0.7742	24	1.2513	0.1750	1.2513	1.1186
No log	0.8387	26	1.0086	0.2473	1.0086	1.0043
No log	0.9032	28	1.0869	0.2441	1.0869	1.0426
No log	0.9677	30	1.1338	0.1671	1.1338	1.0648
No log	1.0323	32	1.1088	0.2541	1.1088	1.0530
No log	1.0968	34	1.0692	0.1561	1.0692	1.0340
No log	1.1613	36	1.0331	0.1837	1.0331	1.0164
No log	1.2258	38	1.0105	0.2619	1.0105	1.0052
No log	1.2903	40	1.0009	0.2473	1.0009	1.0004
No log	1.3548	42	1.0070	0.2288	1.0070	1.0035
No log	1.4194	44	1.0316	0.1671	1.0316	1.0157
No log	1.4839	46	1.0027	0.2161	1.0027	1.0014
No log	1.5484	48	0.9805	0.3071	0.9805	0.9902
No log	1.6129	50	0.9788	0.2935	0.9788	0.9893
No log	1.6774	52	0.9671	0.2515	0.9671	0.9834
No log	1.7419	54	1.0036	0.2897	1.0036	1.0018
No log	1.8065	56	1.0507	0.2667	1.0507	1.0250
No log	1.8710	58	1.0883	0.2692	1.0883	1.0432
No log	1.9355	60	1.0889	0.2366	1.0889	1.0435
No log	2.0	62	1.0779	0.2711	1.0779	1.0382
No log	2.0645	64	1.0383	0.3396	1.0383	1.0190
No log	2.1290	66	0.9608	0.2764	0.9608	0.9802
No log	2.1935	68	1.0137	0.1418	1.0137	1.0068
No log	2.2581	70	1.0547	0.1233	1.0547	1.0270
No log	2.3226	72	1.0767	0.1233	1.0767	1.0376
No log	2.3871	74	1.0520	0.1233	1.0520	1.0257
No log	2.4516	76	0.9308	0.1011	0.9308	0.9648
No log	2.5161	78	0.9180	0.2077	0.9180	0.9581
No log	2.5806	80	1.0677	0.1233	1.0677	1.0333
No log	2.6452	82	1.1382	0.1598	1.1382	1.0669
No log	2.7097	84	1.2463	0.0841	1.2463	1.1164
No log	2.7742	86	1.2123	0.2704	1.2123	1.1010
No log	2.8387	88	0.9649	0.2651	0.9649	0.9823
No log	2.9032	90	0.8997	0.2965	0.8997	0.9485
No log	2.9677	92	0.9151	0.3214	0.9151	0.9566
No log	3.0323	94	1.1021	0.275	1.1021	1.0498
No log	3.0968	96	1.3784	0.3199	1.3784	1.1740
No log	3.1613	98	1.3169	0.2640	1.3169	1.1476
No log	3.2258	100	1.0286	0.2981	1.0286	1.0142
No log	3.2903	102	0.9191	0.2698	0.9191	0.9587
No log	3.3548	104	0.9854	0.2037	0.9854	0.9927
No log	3.4194	106	1.2865	0.3346	1.2865	1.1343
No log	3.4839	108	1.5374	0.2431	1.5374	1.2399
No log	3.5484	110	1.6258	0.1752	1.6258	1.2751
No log	3.6129	112	1.4725	0.2290	1.4724	1.2134
No log	3.6774	114	1.1945	0.3280	1.1945	1.0929
No log	3.7419	116	1.0826	0.2417	1.0826	1.0405
No log	3.8065	118	1.1099	0.2227	1.1099	1.0535
No log	3.8710	120	1.1567	0.1316	1.1567	1.0755
No log	3.9355	122	1.2579	0.1654	1.2579	1.1216
No log	4.0	124	1.3383	0.2730	1.3383	1.1568
No log	4.0645	126	1.3133	0.3261	1.3133	1.1460
No log	4.1290	128	1.3525	0.3291	1.3525	1.1630
No log	4.1935	130	1.4797	0.3037	1.4797	1.2164
No log	4.2581	132	1.5319	0.2672	1.5319	1.2377
No log	4.3226	134	1.5043	0.2730	1.5043	1.2265
No log	4.3871	136	1.3593	0.2284	1.3593	1.1659
No log	4.4516	138	1.1390	0.1203	1.1390	1.0672
No log	4.5161	140	0.9942	0.1629	0.9942	0.9971
No log	4.5806	142	0.9744	0.2035	0.9744	0.9871
No log	4.6452	144	1.0509	0.1954	1.0509	1.0251
No log	4.7097	146	1.1108	0.1998	1.1108	1.0539
No log	4.7742	148	1.1772	0.0888	1.1772	1.0850
No log	4.8387	150	1.1280	0.0888	1.1280	1.0621
No log	4.9032	152	1.1795	0.2284	1.1795	1.0861
No log	4.9677	154	1.3352	0.3107	1.3352	1.1555
No log	5.0323	156	1.4604	0.3172	1.4604	1.2085
No log	5.0968	158	1.5755	0.2809	1.5755	1.2552
No log	5.1613	160	1.5220	0.2771	1.5220	1.2337
No log	5.2258	162	1.3070	0.3231	1.3070	1.1432
No log	5.2903	164	1.1760	0.2964	1.1760	1.0844
No log	5.3548	166	1.2156	0.3231	1.2156	1.1026
No log	5.4194	168	1.3726	0.3261	1.3726	1.1716
No log	5.4839	170	1.5667	0.2474	1.5667	1.2517
No log	5.5484	172	1.4775	0.3135	1.4775	1.2155
No log	5.6129	174	1.3519	0.3199	1.3519	1.1627
No log	5.6774	176	1.3612	0.2926	1.3612	1.1667
No log	5.7419	178	1.2751	0.2341	1.2751	1.1292
No log	5.8065	180	1.2108	0.2167	1.2108	1.1003
No log	5.8710	182	1.1905	0.2341	1.1905	1.0911
No log	5.9355	184	1.3108	0.3711	1.3108	1.1449
No log	6.0	186	1.3507	0.3511	1.3507	1.1622
No log	6.0645	188	1.2771	0.3711	1.2771	1.1301
No log	6.1290	190	1.1379	0.3936	1.1379	1.0667
No log	6.1935	192	1.0550	0.3686	1.0550	1.0271
No log	6.2581	194	1.1847	0.3584	1.1847	1.0884
No log	6.3226	196	1.2205	0.3831	1.2205	1.1048
No log	6.3871	198	1.2708	0.3511	1.2708	1.1273
No log	6.4516	200	1.1286	0.3056	1.1286	1.0624
No log	6.5161	202	0.9351	0.2535	0.9351	0.9670
No log	6.5806	204	0.9492	0.2213	0.9492	0.9743
No log	6.6452	206	1.0402	0.1842	1.0402	1.0199
No log	6.7097	208	1.1824	0.2926	1.1824	1.0874
No log	6.7742	210	1.1542	0.3199	1.1542	1.0743
No log	6.8387	212	1.0809	0.3686	1.0809	1.0396
No log	6.9032	214	1.2444	0.4056	1.2444	1.1155
No log	6.9677	216	1.4306	0.2431	1.4306	1.1961
No log	7.0323	218	1.4161	0.2431	1.4161	1.1900
No log	7.0968	220	1.2018	0.4056	1.2018	1.0963
No log	7.1613	222	1.1614	0.4056	1.1614	1.0777
No log	7.2258	224	1.2474	0.2614	1.2474	1.1169
No log	7.2903	226	1.3485	0.1110	1.3485	1.1612
No log	7.3548	228	1.3508	0.1259	1.3508	1.1622
No log	7.4194	230	1.2150	0.3263	1.2150	1.1023
No log	7.4839	232	1.1657	0.3295	1.1657	1.0797
No log	7.5484	234	1.2528	0.3711	1.2528	1.1193
No log	7.6129	236	1.2359	0.3711	1.2359	1.1117
No log	7.6774	238	1.0670	0.3936	1.0670	1.0329
No log	7.7419	240	0.9422	0.3424	0.9422	0.9707
No log	7.8065	242	0.9501	0.3424	0.9501	0.9748
No log	7.8710	244	1.1091	0.3607	1.1091	1.0532
No log	7.9355	246	1.3366	0.3172	1.3366	1.1561
No log	8.0	248	1.4578	0.2566	1.4578	1.2074
No log	8.0645	250	1.3333	0.2924	1.3333	1.1547
No log	8.1290	252	1.1289	0.3607	1.1289	1.0625
No log	8.1935	254	0.9716	0.2249	0.9716	0.9857
No log	8.2581	256	0.9899	0.2105	0.9899	0.9949
No log	8.3226	258	1.1325	0.2424	1.1325	1.0642
No log	8.3871	260	1.3325	0.2506	1.3325	1.1543
No log	8.4516	262	1.3778	0.2602	1.3778	1.1738
No log	8.5161	264	1.2834	0.2506	1.2834	1.1329
No log	8.5806	266	1.1404	0.2424	1.1404	1.0679
No log	8.6452	268	1.0710	0.1417	1.0710	1.0349
No log	8.7097	270	1.0923	0.1770	1.0923	1.0451
No log	8.7742	272	1.1982	0.2284	1.1982	1.0946
No log	8.8387	274	1.2947	0.2795	1.2947	1.1379
No log	8.9032	276	1.2827	0.3165	1.2827	1.1326
No log	8.9677	278	1.2386	0.3165	1.2386	1.1129
No log	9.0323	280	1.2539	0.2506	1.2539	1.1198
No log	9.0968	282	1.2580	0.1552	1.2580	1.1216
No log	9.1613	284	1.1837	0.1265	1.1837	1.0880
No log	9.2258	286	1.1452	0.1265	1.1452	1.0701
No log	9.2903	288	1.1307	0.0888	1.1307	1.0634
No log	9.3548	290	1.1090	0.0987	1.1090	1.0531
No log	9.4194	292	1.1322	0.1697	1.1322	1.0641
No log	9.4839	294	1.1964	0.2885	1.1964	1.0938
No log	9.5484	296	1.3302	0.3711	1.3302	1.1534
No log	9.6129	298	1.4055	0.3020	1.4055	1.1855
No log	9.6774	300	1.3297	0.3291	1.3297	1.1531
No log	9.7419	302	1.1665	0.4056	1.1665	1.0800
No log	9.8065	304	1.1155	0.3534	1.1155	1.0562
No log	9.8710	306	1.1031	0.2284	1.1031	1.0503
No log	9.9355	308	1.0721	0.1265	1.0721	1.0354
No log	10.0	310	1.0629	0.0888	1.0629	1.0310
No log	10.0645	312	1.0749	0.0888	1.0749	1.0368
No log	10.1290	314	1.0707	0.0888	1.0707	1.0347
No log	10.1935	316	1.0620	0.0888	1.0620	1.0306
No log	10.2581	318	1.1077	0.1697	1.1077	1.0525
No log	10.3226	320	1.1462	0.2926	1.1462	1.0706
No log	10.3871	322	1.1970	0.3199	1.1970	1.0941
No log	10.4516	324	1.2942	0.3460	1.2942	1.1376
No log	10.5161	326	1.3005	0.3103	1.3005	1.1404
No log	10.5806	328	1.1748	0.2495	1.1748	1.0839
No log	10.6452	330	0.9816	0.2918	0.9816	0.9908
No log	10.7097	332	0.9569	0.3063	0.9569	0.9782
No log	10.7742	334	1.0288	0.2130	1.0288	1.0143
No log	10.8387	336	1.1035	0.2027	1.1035	1.0505
No log	10.9032	338	1.1071	0.2027	1.1071	1.0522
No log	10.9677	340	1.1728	0.2395	1.1728	1.0830
No log	11.0323	342	1.2705	0.2888	1.2705	1.1272
No log	11.0968	344	1.3618	0.2555	1.3618	1.1670
No log	11.1613	346	1.4592	0.2363	1.4592	1.2080
No log	11.2258	348	1.4709	0.2270	1.4709	1.2128
No log	11.2903	350	1.4782	0.2437	1.4782	1.2158
No log	11.3548	352	1.3823	0.2437	1.3823	1.1757
No log	11.4194	354	1.2097	0.2506	1.2097	1.0999
No log	11.4839	356	1.1058	0.2027	1.1058	1.0516
No log	11.5484	358	1.0945	0.1697	1.0945	1.0462
No log	11.6129	360	1.1427	0.2027	1.1427	1.0690
No log	11.6774	362	1.2450	0.2126	1.2450	1.1158
No log	11.7419	364	1.3347	0.2522	1.3347	1.1553
No log	11.8065	366	1.3973	0.2522	1.3973	1.1821
No log	11.8710	368	1.3585	0.2424	1.3585	1.1655
No log	11.9355	370	1.3563	0.2424	1.3563	1.1646
No log	12.0	372	1.2739	0.1880	1.2739	1.1287
No log	12.0645	374	1.2568	0.1880	1.2568	1.1211
No log	12.1290	376	1.3295	0.1880	1.3295	1.1530
No log	12.1935	378	1.4327	0.2752	1.4327	1.1969
No log	12.2581	380	1.4096	0.2752	1.4096	1.1873
No log	12.3226	382	1.2878	0.2555	1.2878	1.1348
No log	12.3871	384	1.2209	0.1952	1.2209	1.1049
No log	12.4516	386	1.2556	0.1952	1.2556	1.1205
No log	12.5161	388	1.3430	0.2424	1.3430	1.1589
No log	12.5806	390	1.4069	0.1892	1.4069	1.1861
No log	12.6452	392	1.3701	0.1892	1.3701	1.1705
No log	12.7097	394	1.2806	0.2240	1.2806	1.1316
No log	12.7742	396	1.2308	0.2647	1.2308	1.1094
No log	12.8387	398	1.1361	0.3056	1.1361	1.0659
No log	12.9032	400	1.1587	0.3056	1.1587	1.0764
No log	12.9677	402	1.2272	0.3001	1.2272	1.1078
No log	13.0323	404	1.2092	0.2885	1.2092	1.0996
No log	13.0968	406	1.2193	0.3263	1.2193	1.1042
No log	13.1613	408	1.2037	0.2477	1.2037	1.0971
No log	13.2258	410	1.1491	0.1770	1.1491	1.0720
No log	13.2903	412	1.1803	0.1770	1.1803	1.0864
No log	13.3548	414	1.2202	0.1770	1.2202	1.1046
No log	13.4194	416	1.3154	0.3107	1.3154	1.1469
No log	13.4839	418	1.3232	0.3107	1.3232	1.1503
No log	13.5484	420	1.2713	0.2795	1.2713	1.1275
No log	13.6129	422	1.2481	0.3199	1.2481	1.1172
No log	13.6774	424	1.1564	0.3263	1.1564	1.0754
No log	13.7419	426	1.1548	0.3813	1.1548	1.0746
No log	13.8065	428	1.2100	0.4056	1.2100	1.1000
No log	13.8710	430	1.2800	0.3511	1.2800	1.1314
No log	13.9355	432	1.3040	0.3511	1.3040	1.1419
No log	14.0	434	1.3353	0.3018	1.3353	1.1556
No log	14.0645	436	1.4217	0.2437	1.4217	1.1923
No log	14.1290	438	1.4181	0.2437	1.4181	1.1909
No log	14.1935	440	1.3874	0.2437	1.3874	1.1779
No log	14.2581	442	1.3510	0.2611	1.3510	1.1623
No log	14.3226	444	1.3048	0.2690	1.3048	1.1423
No log	14.3871	446	1.2779	0.3107	1.2779	1.1304
No log	14.4516	448	1.3008	0.2342	1.3008	1.1405
No log	14.5161	450	1.2588	0.3037	1.2588	1.1220
No log	14.5806	452	1.2048	0.3560	1.2048	1.0977
No log	14.6452	454	1.1432	0.2979	1.1432	1.0692
No log	14.7097	456	1.1550	0.2027	1.1550	1.0747
No log	14.7742	458	1.2248	0.2506	1.2248	1.1067
No log	14.8387	460	1.2358	0.2506	1.2358	1.1117
No log	14.9032	462	1.2231	0.2506	1.2231	1.1059
No log	14.9677	464	1.1718	0.2424	1.1718	1.0825
No log	15.0323	466	1.2151	0.1795	1.2151	1.1023
No log	15.0968	468	1.3202	0.2857	1.3202	1.1490
No log	15.1613	470	1.4623	0.2270	1.4623	1.2092
No log	15.2258	472	1.5456	0.2525	1.5456	1.2432
No log	15.2903	474	1.6049	0.2525	1.6049	1.2669
No log	15.3548	476	1.5689	0.2170	1.5689	1.2525
No log	15.4194	478	1.4862	0.2126	1.4862	1.2191
No log	15.4839	480	1.4195	0.1228	1.4195	1.1914
No log	15.5484	482	1.4230	0.1228	1.4230	1.1929
No log	15.6129	484	1.3971	0.0510	1.3971	1.1820
No log	15.6774	486	1.3352	0.0510	1.3352	1.1555
No log	15.7419	488	1.3094	0.0510	1.3094	1.1443
No log	15.8065	490	1.3572	0.0878	1.3572	1.1650
No log	15.8710	492	1.4295	0.1228	1.4295	1.1956
No log	15.9355	494	1.5671	0.2292	1.5671	1.2518
No log	16.0	496	1.6694	0.2292	1.6694	1.2921
No log	16.0645	498	1.6659	0.2004	1.6659	1.2907
0.2828	16.1290	500	1.5591	0.1228	1.5591	1.2486
0.2828	16.1935	502	1.4038	0.0	1.4038	1.1848
0.2828	16.2581	504	1.2525	0.0	1.2525	1.1191
0.2828	16.3226	506	1.1587	0.0604	1.1587	1.0764
0.2828	16.3871	508	1.1567	0.0710	1.1567	1.0755
0.2828	16.4516	510	1.2233	0.1370	1.2233	1.1060
0.2828	16.5161	512	1.3601	0.2292	1.3601	1.1662
0.2828	16.5806	514	1.5511	0.2170	1.5511	1.2454
0.2828	16.6452	516	1.6027	0.2170	1.6027	1.2660
0.2828	16.7097	518	1.5336	0.2342	1.5336	1.2384
0.2828	16.7742	520	1.3884	0.2424	1.3884	1.1783
0.2828	16.8387	522	1.2598	0.1228	1.2598	1.1224
0.2828	16.9032	524	1.2206	0.0122	1.2206	1.1048
0.2828	16.9677	526	1.2412	0.0122	1.2412	1.1141
0.2828	17.0323	528	1.2646	0.0122	1.2646	1.1246
0.2828	17.0968	530	1.3018	0.0510	1.3018	1.1410

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1