ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k7_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.6064
• Qwk: 0.1138
• Mse: 1.6064
• Rmse: 1.2674

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0571	2	4.6806	0.0010	4.6806	2.1635
No log	0.1143	4	2.8079	0.0193	2.8079	1.6757
No log	0.1714	6	2.5038	-0.0291	2.5038	1.5823
No log	0.2286	8	2.1043	-0.0634	2.1043	1.4506
No log	0.2857	10	1.8675	-0.0787	1.8675	1.3666
No log	0.3429	12	1.7618	-0.0174	1.7618	1.3273
No log	0.4	14	1.3255	0.0945	1.3255	1.1513
No log	0.4571	16	1.2981	0.0032	1.2981	1.1393
No log	0.5143	18	1.2311	0.1144	1.2311	1.1096
No log	0.5714	20	1.2559	0.1351	1.2559	1.1207
No log	0.6286	22	1.3677	0.1110	1.3677	1.1695
No log	0.6857	24	1.3807	0.0909	1.3807	1.1750
No log	0.7429	26	1.3289	0.1417	1.3289	1.1528
No log	0.8	28	1.2722	0.1247	1.2722	1.1279
No log	0.8571	30	1.1862	0.1752	1.1862	1.0891
No log	0.9143	32	1.1832	0.2731	1.1832	1.0877
No log	0.9714	34	1.2183	0.2095	1.2183	1.1038
No log	1.0286	36	1.1772	0.2402	1.1772	1.0850
No log	1.0857	38	1.1559	0.3367	1.1559	1.0751
No log	1.1429	40	1.1330	0.2690	1.1330	1.0644
No log	1.2	42	1.0556	0.3250	1.0556	1.0274
No log	1.2571	44	1.1571	0.2416	1.1571	1.0757
No log	1.3143	46	1.2204	0.1952	1.2204	1.1047
No log	1.3714	48	1.2338	0.1470	1.2338	1.1108
No log	1.4286	50	1.2340	0.0872	1.2340	1.1109
No log	1.4857	52	1.2570	0.0802	1.2570	1.1211
No log	1.5429	54	1.2496	0.0904	1.2496	1.1178
No log	1.6	56	1.2328	0.1144	1.2328	1.1103
No log	1.6571	58	1.2216	0.1314	1.2216	1.1053
No log	1.7143	60	1.2195	0.0941	1.2195	1.1043
No log	1.7714	62	1.2298	0.1480	1.2298	1.1090
No log	1.8286	64	1.2590	0.1853	1.2590	1.1221
No log	1.8857	66	1.2885	0.1617	1.2885	1.1351
No log	1.9429	68	1.3621	0.1685	1.3621	1.1671
No log	2.0	70	1.4155	0.2399	1.4155	1.1898
No log	2.0571	72	1.4520	0.2430	1.4520	1.2050
No log	2.1143	74	1.4658	0.2554	1.4658	1.2107
No log	2.1714	76	1.4209	0.1644	1.4209	1.1920
No log	2.2286	78	1.4722	0.3603	1.4722	1.2134
No log	2.2857	80	1.4247	0.3745	1.4247	1.1936
No log	2.3429	82	1.4028	0.4108	1.4028	1.1844
No log	2.4	84	1.4401	0.3658	1.4401	1.2000
No log	2.4571	86	1.4861	0.3706	1.4861	1.2191
No log	2.5143	88	1.4996	0.3025	1.4996	1.2246
No log	2.5714	90	1.5418	0.2991	1.5418	1.2417
No log	2.6286	92	1.5947	0.3058	1.5947	1.2628
No log	2.6857	94	1.5451	0.3122	1.5451	1.2430
No log	2.7429	96	1.5099	0.3262	1.5099	1.2288
No log	2.8	98	1.5809	0.3077	1.5809	1.2573
No log	2.8571	100	1.4797	0.1807	1.4797	1.2164
No log	2.9143	102	1.3631	0.2060	1.3631	1.1675
No log	2.9714	104	1.2596	0.2286	1.2596	1.1223
No log	3.0286	106	1.2518	0.2837	1.2518	1.1189
No log	3.0857	108	1.2368	0.3192	1.2368	1.1121
No log	3.1429	110	1.2364	0.1991	1.2364	1.1119
No log	3.2	112	1.3476	0.2201	1.3476	1.1609
No log	3.2571	114	1.4342	0.2136	1.4342	1.1976
No log	3.3143	116	1.4207	0.2032	1.4207	1.1919
No log	3.3714	118	1.5056	0.1416	1.5056	1.2270
No log	3.4286	120	1.5409	0.2272	1.5409	1.2413
No log	3.4857	122	1.5097	0.2055	1.5097	1.2287
No log	3.5429	124	1.5671	0.2418	1.5671	1.2518
No log	3.6	126	1.6088	0.2251	1.6088	1.2684
No log	3.6571	128	1.6360	0.2339	1.6360	1.2790
No log	3.7143	130	1.5616	0.2281	1.5616	1.2496
No log	3.7714	132	1.4599	0.2790	1.4599	1.2083
No log	3.8286	134	1.4185	0.2578	1.4185	1.1910
No log	3.8857	136	1.4035	0.3574	1.4035	1.1847
No log	3.9429	138	1.4067	0.2424	1.4067	1.1860
No log	4.0	140	1.4695	0.2731	1.4695	1.2122
No log	4.0571	142	1.5689	0.3269	1.5689	1.2526
No log	4.1143	144	1.5884	0.2790	1.5884	1.2603
No log	4.1714	146	1.5763	0.1485	1.5763	1.2555
No log	4.2286	148	1.6535	0.2483	1.6535	1.2859
No log	4.2857	150	1.7882	0.2429	1.7882	1.3372
No log	4.3429	152	1.7451	0.2305	1.7451	1.3210
No log	4.4	154	1.6395	0.2667	1.6395	1.2804
No log	4.4571	156	1.5715	0.3043	1.5715	1.2536
No log	4.5143	158	1.4435	0.2947	1.4435	1.2015
No log	4.5714	160	1.3545	0.2674	1.3545	1.1638
No log	4.6286	162	1.2984	0.2191	1.2984	1.1395
No log	4.6857	164	1.2424	0.2980	1.2424	1.1146
No log	4.7429	166	1.2029	0.2837	1.2029	1.0967
No log	4.8	168	1.1699	0.1853	1.1699	1.0816
No log	4.8571	170	1.2859	0.2725	1.2859	1.1340
No log	4.9143	172	1.4928	0.2782	1.4928	1.2218
No log	4.9714	174	1.5832	0.3116	1.5832	1.2583
No log	5.0286	176	1.5881	0.3116	1.5881	1.2602
No log	5.0857	178	1.5719	0.3008	1.5719	1.2537
No log	5.1429	180	1.4802	0.2542	1.4802	1.2167
No log	5.2	182	1.3522	0.2757	1.3522	1.1628
No log	5.2571	184	1.2388	0.2390	1.2388	1.1130
No log	5.3143	186	1.1551	0.2097	1.1551	1.0747
No log	5.3714	188	1.1346	0.2408	1.1346	1.0652
No log	5.4286	190	1.1870	0.2408	1.1870	1.0895
No log	5.4857	192	1.2543	0.1281	1.2543	1.1200
No log	5.5429	194	1.4090	0.2359	1.4090	1.1870
No log	5.6	196	1.5248	0.2711	1.5248	1.2348
No log	5.6571	198	1.5968	0.2929	1.5968	1.2636
No log	5.7143	200	1.5444	0.1283	1.5444	1.2427
No log	5.7714	202	1.5065	0.1171	1.5065	1.2274
No log	5.8286	204	1.5051	0.1568	1.5051	1.2268
No log	5.8857	206	1.6561	0.2691	1.6561	1.2869
No log	5.9429	208	1.6427	0.2847	1.6427	1.2817
No log	6.0	210	1.4955	0.1929	1.4955	1.2229
No log	6.0571	212	1.4173	0.2754	1.4173	1.1905
No log	6.1143	214	1.4276	0.2390	1.4276	1.1948
No log	6.1714	216	1.4861	0.1979	1.4861	1.2191
No log	6.2286	218	1.5446	0.2239	1.5446	1.2428
No log	6.2857	220	1.5061	0.1979	1.5061	1.2272
No log	6.3429	222	1.5051	0.1583	1.5051	1.2268
No log	6.4	224	1.6881	0.2323	1.6881	1.2993
No log	6.4571	226	1.8080	0.2232	1.8080	1.3446
No log	6.5143	228	1.7133	0.2293	1.7133	1.3089
No log	6.5714	230	1.5003	0.1618	1.5003	1.2249
No log	6.6286	232	1.4982	0.2065	1.4982	1.2240
No log	6.6857	234	1.6675	0.2127	1.6675	1.2913
No log	6.7429	236	1.6944	0.1999	1.6944	1.3017
No log	6.8	238	1.6724	0.1999	1.6724	1.2932
No log	6.8571	240	1.6063	0.2090	1.6063	1.2674
No log	6.9143	242	1.5638	0.2090	1.5638	1.2505
No log	6.9714	244	1.5247	0.1580	1.5247	1.2348
No log	7.0286	246	1.4929	0.1311	1.4929	1.2218
No log	7.0857	248	1.4912	0.1311	1.4912	1.2211
No log	7.1429	250	1.5256	0.1580	1.5256	1.2352
No log	7.2	252	1.5508	0.1480	1.5508	1.2453
No log	7.2571	254	1.5815	0.2264	1.5815	1.2576
No log	7.3143	256	1.7119	0.2323	1.7119	1.3084
No log	7.3714	258	1.8589	0.2087	1.8589	1.3634
No log	7.4286	260	1.8340	0.2087	1.8340	1.3543
No log	7.4857	262	1.7155	0.2202	1.7155	1.3098
No log	7.5429	264	1.5375	0.1051	1.5375	1.2399
No log	7.6	266	1.5627	0.1498	1.5627	1.2501
No log	7.6571	268	1.7371	0.2323	1.7371	1.3180
No log	7.7143	270	1.8723	0.2011	1.8723	1.3683
No log	7.7714	272	1.8703	0.1720	1.8703	1.3676
No log	7.8286	274	1.7874	0.2564	1.7874	1.3369
No log	7.8857	276	1.6589	0.2759	1.6589	1.2880
No log	7.9429	278	1.5188	0.2343	1.5188	1.2324
No log	8.0	280	1.4254	0.1708	1.4254	1.1939
No log	8.0571	282	1.4129	0.1427	1.4129	1.1886
No log	8.1143	284	1.4223	0.1621	1.4223	1.1926
No log	8.1714	286	1.4243	0.2371	1.4243	1.1935
No log	8.2286	288	1.4091	0.2074	1.4091	1.1870
No log	8.2857	290	1.4107	0.2173	1.4107	1.1877
No log	8.3429	292	1.4547	0.2301	1.4547	1.2061
No log	8.4	294	1.4623	0.2438	1.4623	1.2092
No log	8.4571	296	1.4654	0.2438	1.4654	1.2105
No log	8.5143	298	1.5232	0.2105	1.5232	1.2342
No log	8.5714	300	1.5822	0.2285	1.5822	1.2579
No log	8.6286	302	1.5607	0.2317	1.5607	1.2493
No log	8.6857	304	1.4601	0.2201	1.4601	1.2083
No log	8.7429	306	1.4342	0.2201	1.4342	1.1976
No log	8.8	308	1.5125	0.1882	1.5125	1.2298
No log	8.8571	310	1.6927	0.2761	1.6927	1.3010
No log	8.9143	312	1.7805	0.2344	1.7805	1.3343
No log	8.9714	314	1.8550	0.2041	1.8550	1.3620
No log	9.0286	316	1.7577	0.2148	1.7577	1.3258
No log	9.0857	318	1.6053	0.3007	1.6053	1.2670
No log	9.1429	320	1.6056	0.2789	1.6056	1.2671
No log	9.2	322	1.6416	0.2618	1.6416	1.2812
No log	9.2571	324	1.7173	0.2585	1.7173	1.3105
No log	9.3143	326	1.6227	0.2424	1.6227	1.2739
No log	9.3714	328	1.4697	0.1971	1.4697	1.2123
No log	9.4286	330	1.4413	0.1935	1.4413	1.2005
No log	9.4857	332	1.5577	0.2331	1.5577	1.2481
No log	9.5429	334	1.6895	0.2170	1.6895	1.2998
No log	9.6	336	1.6195	0.2138	1.6195	1.2726
No log	9.6571	338	1.5119	0.2359	1.5119	1.2296
No log	9.7143	340	1.4692	0.2544	1.4692	1.2121
No log	9.7714	342	1.4402	0.1283	1.4402	1.2001
No log	9.8286	344	1.5354	0.2264	1.5354	1.2391
No log	9.8857	346	1.6926	0.2323	1.6926	1.3010
No log	9.9429	348	1.8281	0.2148	1.8281	1.3521
No log	10.0	350	1.8260	0.2461	1.8260	1.3513
No log	10.0571	352	1.6366	0.2618	1.6366	1.2793
No log	10.1143	354	1.4608	0.1554	1.4608	1.2086
No log	10.1714	356	1.4288	0.1943	1.4288	1.1953
No log	10.2286	358	1.5240	0.1395	1.5240	1.2345
No log	10.2857	360	1.7164	0.2323	1.7164	1.3101
No log	10.3429	362	1.7669	0.2353	1.7669	1.3293
No log	10.4	364	1.6566	0.1841	1.6566	1.2871
No log	10.4571	366	1.5623	0.1977	1.5623	1.2499
No log	10.5143	368	1.5286	0.1842	1.5286	1.2363
No log	10.5714	370	1.4578	0.1592	1.4578	1.2074
No log	10.6286	372	1.3897	0.1026	1.3897	1.1789
No log	10.6857	374	1.3972	0.0702	1.3972	1.1820
No log	10.7429	376	1.4672	0.0872	1.4672	1.2113
No log	10.8	378	1.5390	0.1531	1.5390	1.2406
No log	10.8571	380	1.5505	0.1751	1.5505	1.2452
No log	10.9143	382	1.4808	0.1371	1.4808	1.2169
No log	10.9714	384	1.4509	0.1951	1.4509	1.2045
No log	11.0286	386	1.4667	0.1313	1.4667	1.2111
No log	11.0857	388	1.5476	0.1840	1.5476	1.2440
No log	11.1429	390	1.5732	0.1628	1.5732	1.2543
No log	11.2	392	1.4967	0.0969	1.4967	1.2234
No log	11.2571	394	1.3910	0.0280	1.3910	1.1794
No log	11.3143	396	1.2940	0.0359	1.2940	1.1375
No log	11.3714	398	1.2409	0.0980	1.2409	1.1140
No log	11.4286	400	1.2510	0.0541	1.2510	1.1185
No log	11.4857	402	1.2991	0.0702	1.2991	1.1398
No log	11.5429	404	1.4081	0.0447	1.4081	1.1866
No log	11.6	406	1.5910	0.1718	1.5910	1.2613
No log	11.6571	408	1.7232	0.2481	1.7232	1.3127
No log	11.7143	410	1.6883	0.2424	1.6883	1.2993
No log	11.7714	412	1.6200	0.2197	1.6200	1.2728
No log	11.8286	414	1.5895	0.1718	1.5895	1.2608
No log	11.8857	416	1.6005	0.2394	1.6005	1.2651
No log	11.9429	418	1.6514	0.2424	1.6514	1.2851
No log	12.0	420	1.6615	0.2592	1.6615	1.2890
No log	12.0571	422	1.6411	0.2127	1.6411	1.2811
No log	12.1143	424	1.5492	0.1198	1.5492	1.2447
No log	12.1714	426	1.4900	0.0768	1.4900	1.2206
No log	12.2286	428	1.4638	0.0768	1.4638	1.2099
No log	12.2857	430	1.4383	0.0943	1.4383	1.1993
No log	12.3429	432	1.4824	0.0362	1.4824	1.2175
No log	12.4	434	1.5526	0.0905	1.5526	1.2460
No log	12.4571	436	1.5537	0.1138	1.5537	1.2465
No log	12.5143	438	1.5006	0.1011	1.5006	1.2250
No log	12.5714	440	1.5125	0.1314	1.5125	1.2298
No log	12.6286	442	1.4876	0.0768	1.4876	1.2197
No log	12.6857	444	1.3835	0.0280	1.3835	1.1762
No log	12.7429	446	1.3284	0.1441	1.3284	1.1526
No log	12.8	448	1.3682	0.0444	1.3682	1.1697
No log	12.8571	450	1.4942	0.1371	1.4942	1.2224
No log	12.9143	452	1.6095	0.1704	1.6095	1.2687
No log	12.9714	454	1.6371	0.1309	1.6371	1.2795
No log	13.0286	456	1.6028	0.1674	1.6028	1.2660
No log	13.0857	458	1.5411	0.2012	1.5411	1.2414
No log	13.1429	460	1.5354	0.2197	1.5354	1.2391
No log	13.2	462	1.5446	0.2197	1.5446	1.2428
No log	13.2571	464	1.5343	0.2564	1.5343	1.2387
No log	13.3143	466	1.5311	0.2839	1.5311	1.2374
No log	13.3714	468	1.5393	0.1311	1.5393	1.2407
No log	13.4286	470	1.5424	0.1256	1.5424	1.2419
No log	13.4857	472	1.4900	0.0695	1.4900	1.2207
No log	13.5429	474	1.4690	0.1098	1.4690	1.2120
No log	13.6	476	1.4986	0.0695	1.4986	1.2242
No log	13.6571	478	1.5830	0.1256	1.5830	1.2582
No log	13.7143	480	1.6933	0.1760	1.6933	1.3013
No log	13.7714	482	1.6721	0.0900	1.6721	1.2931
No log	13.8286	484	1.6019	0.1842	1.6019	1.2657
No log	13.8857	486	1.5921	0.1568	1.5921	1.2618
No log	13.9429	488	1.6041	0.1568	1.6041	1.2665
No log	14.0	490	1.5395	0.0778	1.5395	1.2408
No log	14.0571	492	1.4692	0.0702	1.4692	1.2121
No log	14.1143	494	1.4190	0.0702	1.4190	1.1912
No log	14.1714	496	1.4632	0.0702	1.4632	1.2096
No log	14.2286	498	1.5778	0.1283	1.5778	1.2561
0.3306	14.2857	500	1.6593	0.2424	1.6593	1.2881
0.3306	14.3429	502	1.6175	0.1929	1.6175	1.2718
0.3306	14.4	504	1.5574	0.0920	1.5574	1.2479
0.3306	14.4571	506	1.5707	0.0920	1.5707	1.2533
0.3306	14.5143	508	1.5671	0.0525	1.5671	1.2519
0.3306	14.5714	510	1.6064	0.1138	1.6064	1.2674

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1