ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k12_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2337
• Qwk: 0.5161
• Mse: 1.2337
• Rmse: 1.1107

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0351	2	6.8942	0.0116	6.8942	2.6257
No log	0.0702	4	4.4220	0.0894	4.4220	2.1029
No log	0.1053	6	3.2594	0.0357	3.2594	1.8054
No log	0.1404	8	2.6970	0.0658	2.6970	1.6423
No log	0.1754	10	2.3389	0.1460	2.3389	1.5293
No log	0.2105	12	1.8358	0.1565	1.8358	1.3549
No log	0.2456	14	1.5858	0.1714	1.5858	1.2593
No log	0.2807	16	1.4972	0.2202	1.4972	1.2236
No log	0.3158	18	1.4868	0.2105	1.4868	1.2193
No log	0.3509	20	1.3908	0.4167	1.3908	1.1793
No log	0.3860	22	1.4142	0.3167	1.4142	1.1892
No log	0.4211	24	1.7158	0.1935	1.7158	1.3099
No log	0.4561	26	1.5753	0.3333	1.5753	1.2551
No log	0.4912	28	1.3564	0.4000	1.3564	1.1646
No log	0.5263	30	1.3360	0.3866	1.3360	1.1559
No log	0.5614	32	1.5726	0.3279	1.5726	1.2540
No log	0.5965	34	2.2301	0.2190	2.2301	1.4933
No log	0.6316	36	2.3010	0.1379	2.3010	1.5169
No log	0.6667	38	1.8259	0.3231	1.8259	1.3513
No log	0.7018	40	1.2604	0.4298	1.2604	1.1227
No log	0.7368	42	1.5373	0.4068	1.5373	1.2399
No log	0.7719	44	1.5869	0.3333	1.5869	1.2597
No log	0.8070	46	1.2941	0.3966	1.2941	1.1376
No log	0.8421	48	1.2781	0.3697	1.2781	1.1305
No log	0.8772	50	1.2737	0.3697	1.2737	1.1286
No log	0.9123	52	1.2469	0.4167	1.2469	1.1166
No log	0.9474	54	1.3488	0.2957	1.3488	1.1614
No log	0.9825	56	1.2451	0.4839	1.2451	1.1158
No log	1.0175	58	1.3274	0.5038	1.3274	1.1521
No log	1.0526	60	1.4859	0.4444	1.4859	1.2190
No log	1.0877	62	1.3775	0.4769	1.3775	1.1737
No log	1.1228	64	1.2215	0.4882	1.2215	1.1052
No log	1.1579	66	1.2108	0.4463	1.2108	1.1004
No log	1.1930	68	1.4212	0.3866	1.4212	1.1922
No log	1.2281	70	1.4293	0.3729	1.4293	1.1955
No log	1.2632	72	1.2374	0.4878	1.2374	1.1124
No log	1.2982	74	1.1875	0.4762	1.1875	1.0897
No log	1.3333	76	1.1853	0.5271	1.1853	1.0887
No log	1.3684	78	1.1953	0.48	1.1953	1.0933
No log	1.4035	80	1.2872	0.4370	1.2872	1.1345
No log	1.4386	82	1.3333	0.4715	1.3333	1.1547
No log	1.4737	84	1.1796	0.5	1.1796	1.0861
No log	1.5088	86	1.1652	0.5000	1.1652	1.0794
No log	1.5439	88	1.6497	0.3566	1.6497	1.2844
No log	1.5789	90	1.6617	0.3566	1.6617	1.2891
No log	1.6140	92	1.2303	0.3697	1.2303	1.1092
No log	1.6491	94	1.1979	0.4068	1.1979	1.0945
No log	1.6842	96	1.2605	0.4590	1.2605	1.1227
No log	1.7193	98	1.6358	0.3759	1.6358	1.2790
No log	1.7544	100	1.8067	0.2727	1.8067	1.3441
No log	1.7895	102	1.5562	0.3759	1.5562	1.2475
No log	1.8246	104	1.4254	0.4122	1.4254	1.1939
No log	1.8596	106	1.4108	0.4242	1.4108	1.1878
No log	1.8947	108	1.8575	0.2273	1.8575	1.3629
No log	1.9298	110	2.5217	-0.1270	2.5217	1.5880
No log	1.9649	112	2.5406	-0.0938	2.5406	1.5939
No log	2.0	114	2.3179	-0.0606	2.3179	1.5225
No log	2.0351	116	1.6833	0.4060	1.6833	1.2974
No log	2.0702	118	1.1141	0.4538	1.1141	1.0555
No log	2.1053	120	1.1626	0.528	1.1626	1.0782
No log	2.1404	122	1.0705	0.5323	1.0705	1.0346
No log	2.1754	124	1.1163	0.4921	1.1163	1.0565
No log	2.2105	126	1.7252	0.2615	1.7252	1.3135
No log	2.2456	128	2.2553	-0.0157	2.2553	1.5018
No log	2.2807	130	2.2364	0.0	2.2364	1.4955
No log	2.3158	132	2.1352	0.0909	2.1352	1.4612
No log	2.3509	134	2.2332	0.0462	2.2332	1.4944
No log	2.3860	136	2.2389	0.0462	2.2389	1.4963
No log	2.4211	138	2.0119	0.0896	2.0119	1.4184
No log	2.4561	140	1.6270	0.3582	1.6270	1.2755
No log	2.4912	142	1.4379	0.4733	1.4379	1.1991
No log	2.5263	144	1.5382	0.3846	1.5382	1.2402
No log	2.5614	146	1.7133	0.2857	1.7133	1.3089
No log	2.5965	148	1.6132	0.3465	1.6132	1.2701
No log	2.6316	150	1.3372	0.5041	1.3372	1.1564
No log	2.6667	152	1.0640	0.5920	1.0640	1.0315
No log	2.7018	154	0.9552	0.5938	0.9552	0.9773
No log	2.7368	156	0.8923	0.6222	0.8923	0.9446
No log	2.7719	158	1.0511	0.6241	1.0511	1.0252
No log	2.8070	160	1.2616	0.5507	1.2616	1.1232
No log	2.8421	162	1.1366	0.5522	1.1366	1.0661
No log	2.8772	164	1.1134	0.5469	1.1134	1.0552
No log	2.9123	166	1.2481	0.5312	1.2481	1.1172
No log	2.9474	168	1.3701	0.4640	1.3701	1.1705
No log	2.9825	170	1.3445	0.4628	1.3445	1.1595
No log	3.0175	172	1.3169	0.2909	1.3169	1.1476
No log	3.0526	174	1.3122	0.3063	1.3122	1.1455
No log	3.0877	176	1.4021	0.4677	1.4021	1.1841
No log	3.1228	178	1.7002	0.3538	1.7002	1.3039
No log	3.1579	180	1.8821	0.1818	1.8821	1.3719
No log	3.1930	182	1.8352	0.2074	1.8352	1.3547
No log	3.2281	184	1.5086	0.3969	1.5086	1.2283
No log	3.2632	186	1.3713	0.4733	1.3713	1.1710
No log	3.2982	188	1.4483	0.5	1.4483	1.2035
No log	3.3333	190	1.3460	0.5191	1.3460	1.1602
No log	3.3684	192	1.1701	0.56	1.1701	1.0817
No log	3.4035	194	1.1809	0.375	1.1809	1.0867
No log	3.4386	196	1.1847	0.375	1.1847	1.0884
No log	3.4737	198	1.1184	0.3894	1.1184	1.0575
No log	3.5088	200	1.1001	0.4444	1.1001	1.0489
No log	3.5439	202	1.0347	0.4667	1.0347	1.0172
No log	3.5789	204	1.0003	0.5323	1.0003	1.0002
No log	3.6140	206	0.9810	0.5323	0.9810	0.9905
No log	3.6491	208	1.0987	0.5323	1.0987	1.0482
No log	3.6842	210	1.3324	0.4463	1.3324	1.1543
No log	3.7193	212	1.3820	0.4167	1.3820	1.1756
No log	3.7544	214	1.1999	0.4463	1.1999	1.0954
No log	3.7895	216	1.0285	0.5203	1.0285	1.0142
No log	3.8246	218	0.9575	0.5645	0.9575	0.9785
No log	3.8596	220	0.9674	0.5645	0.9674	0.9836
No log	3.8947	222	0.9883	0.5289	0.9883	0.9942
No log	3.9298	224	1.1069	0.4959	1.1069	1.0521
No log	3.9649	226	1.2620	0.5	1.2620	1.1234
No log	4.0	228	1.2518	0.5039	1.2518	1.1188
No log	4.0351	230	1.1492	0.512	1.1492	1.0720
No log	4.0702	232	1.0935	0.5161	1.0935	1.0457
No log	4.1053	234	1.1149	0.5161	1.1149	1.0559
No log	4.1404	236	1.2767	0.4921	1.2767	1.1299
No log	4.1754	238	1.3641	0.4688	1.3641	1.1679
No log	4.2105	240	1.2920	0.48	1.2920	1.1366
No log	4.2456	242	1.1385	0.4833	1.1385	1.0670
No log	4.2807	244	1.0951	0.4746	1.0951	1.0465
No log	4.3158	246	1.0445	0.5042	1.0445	1.0220
No log	4.3509	248	1.0634	0.4874	1.0634	1.0312
No log	4.3860	250	1.1231	0.5	1.1231	1.0597
No log	4.4211	252	1.2396	0.4921	1.2396	1.1134
No log	4.4561	254	1.1812	0.4921	1.1812	1.0868
No log	4.4912	256	1.1565	0.5197	1.1565	1.0754
No log	4.5263	258	1.2400	0.5156	1.2400	1.1136
No log	4.5614	260	1.4150	0.4394	1.4150	1.1895
No log	4.5965	262	1.4123	0.4580	1.4123	1.1884
No log	4.6316	264	1.2947	0.4715	1.2947	1.1379
No log	4.6667	266	1.2374	0.3826	1.2374	1.1124
No log	4.7018	268	1.2979	0.2545	1.2979	1.1392
No log	4.7368	270	1.3354	0.1852	1.3354	1.1556
No log	4.7719	272	1.3389	0.4274	1.3389	1.1571
No log	4.8070	274	1.3557	0.4839	1.3557	1.1644
No log	4.8421	276	1.3127	0.5354	1.3127	1.1457
No log	4.8772	278	1.2777	0.5354	1.2777	1.1303
No log	4.9123	280	1.2577	0.5354	1.2577	1.1215
No log	4.9474	282	1.2617	0.5354	1.2617	1.1233
No log	4.9825	284	1.3407	0.5197	1.3407	1.1579
No log	5.0175	286	1.3783	0.5039	1.3783	1.1740
No log	5.0526	288	1.3627	0.5079	1.3627	1.1673
No log	5.0877	290	1.2784	0.5354	1.2784	1.1307
No log	5.1228	292	1.2632	0.5354	1.2632	1.1239
No log	5.1579	294	1.3350	0.4885	1.3350	1.1554
No log	5.1930	296	1.3477	0.4769	1.3477	1.1609
No log	5.2281	298	1.3602	0.4769	1.3602	1.1663
No log	5.2632	300	1.3386	0.5156	1.3386	1.1570
No log	5.2982	302	1.3522	0.5116	1.3522	1.1628
No log	5.3333	304	1.3817	0.4769	1.3817	1.1755
No log	5.3684	306	1.2999	0.5156	1.2999	1.1401
No log	5.4035	308	1.1790	0.5538	1.1790	1.0858
No log	5.4386	310	1.2023	0.5538	1.2023	1.0965
No log	5.4737	312	1.2867	0.5231	1.2867	1.1343
No log	5.5088	314	1.2878	0.5231	1.2878	1.1348
No log	5.5439	316	1.2033	0.5538	1.2033	1.0969
No log	5.5789	318	1.1702	0.5581	1.1702	1.0818
No log	5.6140	320	1.1728	0.5538	1.1728	1.0829
No log	5.6491	322	1.2870	0.4848	1.2870	1.1345
No log	5.6842	324	1.2903	0.4848	1.2903	1.1359
No log	5.7193	326	1.1171	0.5581	1.1171	1.0569
No log	5.7544	328	0.9919	0.5397	0.9919	0.9959
No log	5.7895	330	1.0320	0.5397	1.0320	1.0159
No log	5.8246	332	1.1541	0.5197	1.1541	1.0743
No log	5.8596	334	1.2034	0.512	1.2034	1.0970
No log	5.8947	336	1.2129	0.512	1.2129	1.1013
No log	5.9298	338	1.1729	0.512	1.1729	1.0830
No log	5.9649	340	1.1640	0.5039	1.1640	1.0789
No log	6.0	342	1.0952	0.5116	1.0952	1.0465
No log	6.0351	344	1.1129	0.5038	1.1129	1.0549
No log	6.0702	346	1.1898	0.5038	1.1898	1.0908
No log	6.1053	348	1.2770	0.5038	1.2770	1.1300
No log	6.1404	350	1.4488	0.4296	1.4488	1.2036
No log	6.1754	352	1.5407	0.4179	1.5407	1.2412
No log	6.2105	354	1.6569	0.3852	1.6569	1.2872
No log	6.2456	356	1.4739	0.4511	1.4739	1.2141
No log	6.2807	358	1.3187	0.4697	1.3187	1.1484
No log	6.3158	360	1.2059	0.5303	1.2059	1.0981
No log	6.3509	362	1.1279	0.5344	1.1279	1.0620
No log	6.3860	364	1.1241	0.5303	1.1241	1.0603
No log	6.4211	366	1.2662	0.4885	1.2662	1.1253
No log	6.4561	368	1.5291	0.4148	1.5291	1.2366
No log	6.4912	370	1.5294	0.4148	1.5294	1.2367
No log	6.5263	372	1.2888	0.5	1.2888	1.1353
No log	6.5614	374	1.0720	0.5385	1.0720	1.0354
No log	6.5965	376	1.0610	0.5271	1.0610	1.0300
No log	6.6316	378	1.1525	0.5385	1.1525	1.0735
No log	6.6667	380	1.3214	0.4923	1.3214	1.1495
No log	6.7018	382	1.3484	0.4923	1.3484	1.1612
No log	6.7368	384	1.2580	0.4878	1.2580	1.1216
No log	6.7719	386	1.1936	0.5	1.1936	1.0925
No log	6.8070	388	1.1741	0.4961	1.1741	1.0836
No log	6.8421	390	1.3179	0.4885	1.3179	1.1480
No log	6.8772	392	1.3219	0.4885	1.3219	1.1497
No log	6.9123	394	1.1773	0.5303	1.1773	1.0850
No log	6.9474	396	1.0330	0.5303	1.0330	1.0163
No log	6.9825	398	1.0303	0.5303	1.0303	1.0151
No log	7.0175	400	1.1521	0.5303	1.1521	1.0734
No log	7.0526	402	1.3026	0.5152	1.3026	1.1413
No log	7.0877	404	1.2099	0.5191	1.2099	1.1000
No log	7.1228	406	1.1032	0.5271	1.1032	1.0503
No log	7.1579	408	1.0235	0.5669	1.0235	1.0117
No log	7.1930	410	1.0233	0.56	1.0233	1.0116
No log	7.2281	412	1.0289	0.5714	1.0289	1.0144
No log	7.2632	414	1.0172	0.5645	1.0172	1.0085
No log	7.2982	416	1.0290	0.5873	1.0290	1.0144
No log	7.3333	418	1.0866	0.5385	1.0866	1.0424
No log	7.3684	420	1.0691	0.5581	1.0691	1.0340
No log	7.4035	422	1.0363	0.5714	1.0363	1.0180
No log	7.4386	424	1.1161	0.5669	1.1161	1.0565
No log	7.4737	426	1.2269	0.5426	1.2269	1.1077
No log	7.5088	428	1.2084	0.5426	1.2084	1.0993
No log	7.5439	430	1.2109	0.5469	1.2109	1.1004
No log	7.5789	432	1.2153	0.5469	1.2153	1.1024
No log	7.6140	434	1.1695	0.5354	1.1695	1.0814
No log	7.6491	436	1.1471	0.5354	1.1471	1.0710
No log	7.6842	438	1.1712	0.5538	1.1712	1.0822
No log	7.7193	440	1.2001	0.5538	1.2001	1.0955
No log	7.7544	442	1.2057	0.5426	1.2057	1.0981
No log	7.7895	444	1.1790	0.5197	1.1790	1.0858
No log	7.8246	446	1.1972	0.5238	1.1972	1.0942
No log	7.8596	448	1.3122	0.5156	1.3122	1.1455
No log	7.8947	450	1.3331	0.5156	1.3331	1.1546
No log	7.9298	452	1.2395	0.5039	1.2395	1.1133
No log	7.9649	454	1.1199	0.4878	1.1199	1.0582
No log	8.0	456	1.0655	0.4918	1.0655	1.0322
No log	8.0351	458	1.0756	0.4839	1.0756	1.0371
No log	8.0702	460	1.1572	0.5312	1.1572	1.0757
No log	8.1053	462	1.2597	0.4961	1.2597	1.1224
No log	8.1404	464	1.3954	0.4961	1.3954	1.1813
No log	8.1754	466	1.4137	0.4688	1.4137	1.1890
No log	8.2105	468	1.3111	0.4961	1.3111	1.1450
No log	8.2456	470	1.2189	0.4960	1.2189	1.1040
No log	8.2807	472	1.2180	0.5	1.2180	1.1036
No log	8.3158	474	1.2515	0.5039	1.2515	1.1187
No log	8.3509	476	1.2435	0.512	1.2435	1.1151
No log	8.3860	478	1.2206	0.512	1.2206	1.1048
No log	8.4211	480	1.1859	0.5	1.1859	1.0890
No log	8.4561	482	1.1528	0.5124	1.1528	1.0737
No log	8.4912	484	1.1430	0.5124	1.1430	1.0691
No log	8.5263	486	1.1709	0.4715	1.1709	1.0821
No log	8.5614	488	1.2572	0.4961	1.2572	1.1212
No log	8.5965	490	1.2315	0.4961	1.2315	1.1097
No log	8.6316	492	1.1732	0.5344	1.1732	1.0831
No log	8.6667	494	1.1915	0.5344	1.1915	1.0916
No log	8.7018	496	1.2150	0.5231	1.2150	1.1023
No log	8.7368	498	1.1643	0.56	1.1643	1.0790
0.3755	8.7719	500	1.1624	0.5238	1.1624	1.0781
0.3755	8.8070	502	1.2043	0.5231	1.2043	1.0974
0.3755	8.8421	504	1.2328	0.5231	1.2328	1.1103
0.3755	8.8772	506	1.1866	0.5231	1.1866	1.0893
0.3755	8.9123	508	1.1318	0.5156	1.1318	1.0638
0.3755	8.9474	510	1.0878	0.56	1.0878	1.0430
0.3755	8.9825	512	1.1137	0.5203	1.1137	1.0553
0.3755	9.0175	514	1.1841	0.5556	1.1841	1.0882
0.3755	9.0526	516	1.2676	0.5231	1.2676	1.1259
0.3755	9.0877	518	1.2651	0.5231	1.2651	1.1248
0.3755	9.1228	520	1.2699	0.5231	1.2699	1.1269
0.3755	9.1579	522	1.2172	0.5161	1.2172	1.1033
0.3755	9.1930	524	1.2337	0.5161	1.2337	1.1107

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1