ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k7_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2419
• Qwk: 0.1479
• Mse: 1.2419
• Rmse: 1.1144

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0952	2	4.8742	0.0064	4.8742	2.2078
No log	0.1905	4	3.0559	-0.0434	3.0559	1.7481
No log	0.2857	6	1.9143	-0.0017	1.9143	1.3836
No log	0.3810	8	1.5955	0.0372	1.5955	1.2631
No log	0.4762	10	1.4779	0.0018	1.4779	1.2157
No log	0.5714	12	1.5939	0.0393	1.5939	1.2625
No log	0.6667	14	1.4775	-0.0284	1.4775	1.2155
No log	0.7619	16	1.4014	0.0038	1.4014	1.1838
No log	0.8571	18	1.2466	0.1952	1.2466	1.1165
No log	0.9524	20	1.2711	0.0427	1.2711	1.1274
No log	1.0476	22	1.2934	0.0454	1.2934	1.1373
No log	1.1429	24	1.2412	0.0904	1.2412	1.1141
No log	1.2381	26	1.2404	0.1294	1.2404	1.1137
No log	1.3333	28	1.2516	0.1107	1.2516	1.1188
No log	1.4286	30	1.2621	0.1696	1.2621	1.1234
No log	1.5238	32	1.2718	0.0586	1.2718	1.1278
No log	1.6190	34	1.2954	0.0918	1.2954	1.1382
No log	1.7143	36	1.2505	0.1108	1.2505	1.1183
No log	1.8095	38	1.2041	0.1927	1.2041	1.0973
No log	1.9048	40	1.1759	0.1495	1.1759	1.0844
No log	2.0	42	1.2701	0.0941	1.2701	1.1270
No log	2.0952	44	1.7496	-0.0020	1.7496	1.3227
No log	2.1905	46	2.0774	-0.0497	2.0774	1.4413
No log	2.2857	48	1.8623	-0.1374	1.8623	1.3646
No log	2.3810	50	1.6826	-0.1882	1.6826	1.2972
No log	2.4762	52	1.2431	0.1532	1.2431	1.1150
No log	2.5714	54	1.1036	0.2167	1.1036	1.0505
No log	2.6667	56	1.0878	0.1995	1.0878	1.0430
No log	2.7619	58	1.2546	0.1058	1.2546	1.1201
No log	2.8571	60	1.2889	0.0885	1.2889	1.1353
No log	2.9524	62	1.1215	0.2164	1.1215	1.0590
No log	3.0476	64	0.9872	0.3374	0.9872	0.9936
No log	3.1429	66	0.9772	0.2893	0.9772	0.9885
No log	3.2381	68	1.0894	0.2454	1.0894	1.0437
No log	3.3333	70	1.3627	0.2354	1.3627	1.1674
No log	3.4286	72	1.4397	0.1621	1.4397	1.1999
No log	3.5238	74	1.2980	0.2143	1.2980	1.1393
No log	3.6190	76	1.0423	0.3217	1.0423	1.0209
No log	3.7143	78	1.0022	0.3066	1.0022	1.0011
No log	3.8095	80	1.0109	0.3117	1.0109	1.0054
No log	3.9048	82	1.0914	0.1905	1.0914	1.0447
No log	4.0	84	1.4079	0.2489	1.4079	1.1865
No log	4.0952	86	1.5050	0.2731	1.5050	1.2268
No log	4.1905	88	1.2736	0.2833	1.2736	1.1286
No log	4.2857	90	1.0094	0.3943	1.0094	1.0047
No log	4.3810	92	1.0105	0.3159	1.0105	1.0052
No log	4.4762	94	1.0973	0.2829	1.0973	1.0475
No log	4.5714	96	1.2463	0.2074	1.2463	1.1164
No log	4.6667	98	1.2404	0.2074	1.2404	1.1137
No log	4.7619	100	1.2578	0.1801	1.2578	1.1215
No log	4.8571	102	1.1221	0.1801	1.1221	1.0593
No log	4.9524	104	1.0741	0.2069	1.0741	1.0364
No log	5.0476	106	1.0674	0.2689	1.0674	1.0331
No log	5.1429	108	1.1566	0.1850	1.1566	1.0755
No log	5.2381	110	1.3475	0.2773	1.3475	1.1608
No log	5.3333	112	1.5208	0.3160	1.5208	1.2332
No log	5.4286	114	1.4392	0.3490	1.4392	1.1997
No log	5.5238	116	1.2132	0.3516	1.2132	1.1015
No log	5.6190	118	1.2578	0.3921	1.2578	1.1215
No log	5.7143	120	1.4873	0.3331	1.4873	1.2196
No log	5.8095	122	1.4210	0.3317	1.4210	1.1921
No log	5.9048	124	1.2931	0.3778	1.2931	1.1372
No log	6.0	126	1.3242	0.3478	1.3242	1.1508
No log	6.0952	128	1.4600	0.3177	1.4600	1.2083
No log	6.1905	130	1.3774	0.3309	1.3774	1.1736
No log	6.2857	132	1.1942	0.3089	1.1942	1.0928
No log	6.3810	134	1.0232	0.4202	1.0232	1.0115
No log	6.4762	136	1.0766	0.3375	1.0766	1.0376
No log	6.5714	138	1.3576	0.3024	1.3576	1.1651
No log	6.6667	140	1.6515	0.1306	1.6515	1.2851
No log	6.7619	142	1.7860	0.1216	1.7860	1.3364
No log	6.8571	144	1.7027	0.1885	1.7027	1.3049
No log	6.9524	146	1.3643	0.3665	1.3643	1.1680
No log	7.0476	148	1.1550	0.4102	1.1550	1.0747
No log	7.1429	150	1.1498	0.3802	1.1498	1.0723
No log	7.2381	152	1.2362	0.3209	1.2362	1.1118
No log	7.3333	154	1.3256	0.3084	1.3256	1.1513
No log	7.4286	156	1.4252	0.2947	1.4252	1.1938
No log	7.5238	158	1.4118	0.2925	1.4118	1.1882
No log	7.6190	160	1.4056	0.2468	1.4056	1.1856
No log	7.7143	162	1.2959	0.2527	1.2959	1.1384
No log	7.8095	164	1.2044	0.2574	1.2044	1.0975
No log	7.9048	166	1.1648	0.2857	1.1648	1.0792
No log	8.0	168	1.1751	0.2857	1.1751	1.0840
No log	8.0952	170	1.3021	0.2650	1.3021	1.1411
No log	8.1905	172	1.5645	0.3166	1.5645	1.2508
No log	8.2857	174	1.8201	0.2453	1.8201	1.3491
No log	8.3810	176	1.7841	0.2568	1.7841	1.3357
No log	8.4762	178	1.5480	0.2878	1.5480	1.2442
No log	8.5714	180	1.3469	0.2880	1.3469	1.1606
No log	8.6667	182	1.2796	0.2259	1.2796	1.1312
No log	8.7619	184	1.2914	0.1997	1.2914	1.1364
No log	8.8571	186	1.1911	0.2019	1.1911	1.0914
No log	8.9524	188	1.1405	0.1927	1.1405	1.0680
No log	9.0476	190	1.1329	0.2028	1.1329	1.0644
No log	9.1429	192	1.1804	0.2013	1.1804	1.0865
No log	9.2381	194	1.3155	0.2207	1.3155	1.1470
No log	9.3333	196	1.3669	0.2460	1.3669	1.1691
No log	9.4286	198	1.3205	0.2743	1.3205	1.1491
No log	9.5238	200	1.3956	0.2460	1.3956	1.1813
No log	9.6190	202	1.3681	0.2424	1.3681	1.1697
No log	9.7143	204	1.3100	0.2090	1.3100	1.1445
No log	9.8095	206	1.3641	0.2494	1.3641	1.1679
No log	9.9048	208	1.3927	0.2337	1.3927	1.1801
No log	10.0	210	1.4572	0.2275	1.4572	1.2071
No log	10.0952	212	1.3793	0.2337	1.3793	1.1744
No log	10.1905	214	1.2566	0.2387	1.2566	1.1210
No log	10.2857	216	1.2653	0.2387	1.2653	1.1248
No log	10.3810	218	1.4054	0.1886	1.4054	1.1855
No log	10.4762	220	1.5547	0.2970	1.5547	1.2469
No log	10.5714	222	1.4961	0.2348	1.4961	1.2232
No log	10.6667	224	1.3353	0.3277	1.3353	1.1555
No log	10.7619	226	1.2031	0.3274	1.2031	1.0968
No log	10.8571	228	1.2675	0.2938	1.2675	1.1259
No log	10.9524	230	1.3447	0.3106	1.3447	1.1596
No log	11.0476	232	1.4615	0.3238	1.4615	1.2089
No log	11.1429	234	1.3366	0.2337	1.3366	1.1561
No log	11.2381	236	1.3190	0.2337	1.3190	1.1485
No log	11.3333	238	1.3283	0.2337	1.3283	1.1525
No log	11.4286	240	1.2221	0.2809	1.2221	1.1055
No log	11.5238	242	1.2053	0.2978	1.2053	1.0979
No log	11.6190	244	1.2677	0.2693	1.2677	1.1259
No log	11.7143	246	1.5213	0.3125	1.5213	1.2334
No log	11.8095	248	1.5879	0.1886	1.5879	1.2601
No log	11.9048	250	1.4457	0.2754	1.4457	1.2024
No log	12.0	252	1.2453	0.1521	1.2453	1.1159
No log	12.0952	254	1.0961	0.2246	1.0961	1.0470
No log	12.1905	256	1.0710	0.2142	1.0710	1.0349
No log	12.2857	258	1.1375	0.1417	1.1375	1.0665
No log	12.3810	260	1.3188	0.1479	1.3188	1.1484
No log	12.4762	262	1.5225	0.1886	1.5225	1.2339
No log	12.5714	264	1.5498	0.3125	1.5498	1.2449
No log	12.6667	266	1.3870	0.3723	1.3870	1.1777
No log	12.7619	268	1.2924	0.3402	1.2924	1.1368
No log	12.8571	270	1.3243	0.3277	1.3243	1.1508
No log	12.9524	272	1.4041	0.2807	1.4041	1.1849
No log	13.0476	274	1.3354	0.2195	1.3354	1.1556
No log	13.1429	276	1.2513	0.1479	1.2513	1.1186
No log	13.2381	278	1.1623	0.1641	1.1623	1.0781
No log	13.3333	280	1.1594	0.1701	1.1594	1.0767
No log	13.4286	282	1.2837	0.2725	1.2837	1.1330
No log	13.5238	284	1.4371	0.3745	1.4371	1.1988
No log	13.6190	286	1.5390	0.3404	1.5390	1.2406
No log	13.7143	288	1.4470	0.3177	1.4470	1.2029
No log	13.8095	290	1.3320	0.3580	1.3320	1.1541
No log	13.9048	292	1.2168	0.3296	1.2168	1.1031
No log	14.0	294	1.1227	0.3600	1.1227	1.0596
No log	14.0952	296	1.0779	0.3086	1.0779	1.0382
No log	14.1905	298	1.1110	0.3349	1.1110	1.0540
No log	14.2857	300	1.2018	0.2664	1.2018	1.0963
No log	14.3810	302	1.2954	0.1896	1.2954	1.1382
No log	14.4762	304	1.3272	0.1795	1.3272	1.1520
No log	14.5714	306	1.3060	0.1795	1.3060	1.1428
No log	14.6667	308	1.2438	0.1596	1.2438	1.1153
No log	14.7619	310	1.2444	0.2141	1.2444	1.1155
No log	14.8571	312	1.3064	0.2589	1.3064	1.1430
No log	14.9524	314	1.4342	0.2437	1.4342	1.1976
No log	15.0476	316	1.5212	0.1547	1.5212	1.2334
No log	15.1429	318	1.4497	0.2055	1.4497	1.2041
No log	15.2381	320	1.3307	0.2619	1.3307	1.1536
No log	15.3333	322	1.2622	0.2747	1.2622	1.1235
No log	15.4286	324	1.2623	0.3044	1.2623	1.1235
No log	15.5238	326	1.2478	0.3265	1.2478	1.1171
No log	15.6190	328	1.3225	0.3765	1.3225	1.1500
No log	15.7143	330	1.3216	0.3467	1.3216	1.1496
No log	15.8095	332	1.3384	0.2881	1.3384	1.1569
No log	15.9048	334	1.3042	0.1896	1.3042	1.1420
No log	16.0	336	1.3306	0.1416	1.3306	1.1535
No log	16.0952	338	1.2902	0.1416	1.2902	1.1359
No log	16.1905	340	1.2457	0.1416	1.2457	1.1161
No log	16.2857	342	1.1211	0.1582	1.1211	1.0588
No log	16.3810	344	1.0617	0.2843	1.0617	1.0304
No log	16.4762	346	1.1100	0.2972	1.1100	1.0536
No log	16.5714	348	1.2529	0.3387	1.2529	1.1193
No log	16.6667	350	1.4299	0.3006	1.4299	1.1958
No log	16.7619	352	1.4469	0.2578	1.4469	1.2029
No log	16.8571	354	1.3203	0.3261	1.3203	1.1491
No log	16.9524	356	1.2354	0.3372	1.2354	1.1115
No log	17.0476	358	1.1562	0.3488	1.1562	1.0753
No log	17.1429	360	1.1670	0.3718	1.1670	1.0803
No log	17.2381	362	1.2772	0.3621	1.2772	1.1302
No log	17.3333	364	1.2999	0.3523	1.2999	1.1401
No log	17.4286	366	1.2666	0.3500	1.2666	1.1254
No log	17.5238	368	1.3088	0.3277	1.3088	1.1440
No log	17.6190	370	1.3543	0.2550	1.3543	1.1637
No log	17.7143	372	1.2599	0.2224	1.2599	1.1224
No log	17.8095	374	1.2168	0.1896	1.2168	1.1031
No log	17.9048	376	1.2468	0.1943	1.2468	1.1166
No log	18.0	378	1.3539	0.2201	1.3539	1.1636
No log	18.0952	380	1.4391	0.2757	1.4391	1.1996
No log	18.1905	382	1.3959	0.2239	1.3959	1.1815
No log	18.2857	384	1.2688	0.2184	1.2688	1.1264
No log	18.3810	386	1.2006	0.1896	1.2006	1.0957
No log	18.4762	388	1.2056	0.1896	1.2056	1.0980
No log	18.5714	390	1.2532	0.2754	1.2532	1.1195
No log	18.6667	392	1.3088	0.3047	1.3088	1.1440
No log	18.7619	394	1.2625	0.2754	1.2625	1.1236
No log	18.8571	396	1.2487	0.2725	1.2487	1.1175
No log	18.9524	398	1.2679	0.2424	1.2679	1.1260
No log	19.0476	400	1.2722	0.2348	1.2722	1.1279
No log	19.1429	402	1.2194	0.2003	1.2194	1.1043
No log	19.2381	404	1.2546	0.2003	1.2546	1.1201
No log	19.3333	406	1.3347	0.1637	1.3347	1.1553
No log	19.4286	408	1.3890	0.2895	1.3890	1.1786
No log	19.5238	410	1.3418	0.2080	1.3418	1.1584
No log	19.6190	412	1.3284	0.2122	1.3284	1.1526
No log	19.7143	414	1.3698	0.2964	1.3698	1.1704
No log	19.8095	416	1.4487	0.2829	1.4487	1.2036
No log	19.9048	418	1.4144	0.3811	1.4144	1.1893
No log	20.0	420	1.3374	0.2941	1.3374	1.1565
No log	20.0952	422	1.2477	0.2956	1.2477	1.1170
No log	20.1905	424	1.1770	0.2343	1.1770	1.0849
No log	20.2857	426	1.1502	0.2304	1.1502	1.0725
No log	20.3810	428	1.2334	0.2424	1.2334	1.1106
No log	20.4762	430	1.3874	0.2941	1.3874	1.1779
No log	20.5714	432	1.5587	0.2950	1.5587	1.2485
No log	20.6667	434	1.5849	0.2950	1.5849	1.2589
No log	20.7619	436	1.5345	0.3317	1.5345	1.2388
No log	20.8571	438	1.4635	0.2455	1.4635	1.2098
No log	20.9524	440	1.3970	0.2359	1.3970	1.1820
No log	21.0476	442	1.2904	0.1498	1.2904	1.1359
No log	21.1429	444	1.2433	0.1498	1.2433	1.1150
No log	21.2381	446	1.2771	0.1498	1.2771	1.1301
No log	21.3333	448	1.3531	0.1796	1.3531	1.1632
No log	21.4286	450	1.4448	0.2424	1.4448	1.2020
No log	21.5238	452	1.5213	0.3086	1.5213	1.2334
No log	21.6190	454	1.5160	0.3086	1.5160	1.2313
No log	21.7143	456	1.4585	0.1929	1.4585	1.2077
No log	21.8095	458	1.3770	0.1796	1.3770	1.1735
No log	21.9048	460	1.3570	0.1283	1.3570	1.1649
No log	22.0	462	1.3509	0.2173	1.3509	1.1623
No log	22.0952	464	1.3639	0.1748	1.3639	1.1679
No log	22.1905	466	1.3943	0.3222	1.3943	1.1808
No log	22.2857	468	1.3551	0.3309	1.3551	1.1641
No log	22.3810	470	1.3816	0.3556	1.3816	1.1754
No log	22.4762	472	1.4129	0.3576	1.4129	1.1886
No log	22.5714	474	1.4610	0.2950	1.4610	1.2087
No log	22.6667	476	1.4147	0.3105	1.4147	1.1894
No log	22.7619	478	1.3092	0.2833	1.3092	1.1442
No log	22.8571	480	1.2191	0.2980	1.2191	1.1041
No log	22.9524	482	1.2308	0.3225	1.2308	1.1094
No log	23.0476	484	1.1681	0.2570	1.1681	1.0808
No log	23.1429	486	1.1258	0.2953	1.1258	1.0610
No log	23.2381	488	1.1731	0.3155	1.1731	1.0831
No log	23.3333	490	1.2120	0.3387	1.2120	1.1009
No log	23.4286	492	1.3029	0.3487	1.3029	1.1415
No log	23.5238	494	1.3627	0.2731	1.3627	1.1673
No log	23.6190	496	1.2713	0.3115	1.2713	1.1275
No log	23.7143	498	1.1459	0.2000	1.1459	1.0705
0.2782	23.8095	500	1.0846	0.2304	1.0846	1.0414
0.2782	23.9048	502	1.0958	0.2304	1.0958	1.0468
0.2782	24.0	504	1.1755	0.1951	1.1755	1.0842
0.2782	24.0952	506	1.2722	0.2725	1.2722	1.1279
0.2782	24.1905	508	1.3542	0.3152	1.3542	1.1637
0.2782	24.2857	510	1.3504	0.2354	1.3504	1.1621
0.2782	24.3810	512	1.3310	0.2080	1.3310	1.1537
0.2782	24.4762	514	1.3400	0.2037	1.3400	1.1576
0.2782	24.5714	516	1.3035	0.1440	1.3035	1.1417
0.2782	24.6667	518	1.2394	0.1479	1.2394	1.1133
0.2782	24.7619	520	1.2419	0.1479	1.2419	1.1144

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1