ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k7_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3805
• Qwk: 0.2020
• Mse: 1.3805
• Rmse: 1.1749

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0571	2	4.6950	-0.0132	4.6950	2.1668
No log	0.1143	4	2.7747	0.0193	2.7747	1.6657
No log	0.1714	6	2.3346	-0.0361	2.3346	1.5280
No log	0.2286	8	1.9314	-0.0303	1.9314	1.3897
No log	0.2857	10	1.5747	-0.0206	1.5747	1.2549
No log	0.3429	12	1.4501	0.0205	1.4501	1.2042
No log	0.4	14	1.2306	0.1654	1.2306	1.1093
No log	0.4571	16	1.2091	0.1444	1.2091	1.0996
No log	0.5143	18	1.2828	0.0671	1.2828	1.1326
No log	0.5714	20	1.5294	-0.2195	1.5294	1.2367
No log	0.6286	22	1.5861	-0.2356	1.5861	1.2594
No log	0.6857	24	1.4488	0.0527	1.4488	1.2037
No log	0.7429	26	1.3844	0.0904	1.3844	1.1766
No log	0.8	28	1.2357	0.1076	1.2357	1.1116
No log	0.8571	30	1.1359	0.1918	1.1359	1.0658
No log	0.9143	32	1.2012	0.1785	1.2012	1.0960
No log	0.9714	34	1.4148	0.0792	1.4148	1.1895
No log	1.0286	36	1.6714	0.0227	1.6714	1.2928
No log	1.0857	38	1.6390	0.0227	1.6390	1.2802
No log	1.1429	40	1.3750	0.0312	1.3750	1.1726
No log	1.2	42	1.2753	0.0600	1.2753	1.1293
No log	1.2571	44	1.2195	0.0711	1.2195	1.1043
No log	1.3143	46	1.1296	0.1482	1.1296	1.0628
No log	1.3714	48	1.1425	0.1144	1.1425	1.0689
No log	1.4286	50	1.2122	0.0599	1.2122	1.1010
No log	1.4857	52	1.2094	0.0374	1.2094	1.0997
No log	1.5429	54	1.4568	-0.0644	1.4568	1.2070
No log	1.6	56	1.5407	-0.1040	1.5407	1.2413
No log	1.6571	58	1.3716	0.0	1.3716	1.1712
No log	1.7143	60	1.2201	0.1354	1.2201	1.1046
No log	1.7714	62	1.2169	0.1300	1.2169	1.1031
No log	1.8286	64	1.2348	0.1632	1.2348	1.1112
No log	1.8857	66	1.2813	0.1632	1.2813	1.1319
No log	1.9429	68	1.3712	-0.0160	1.3712	1.1710
No log	2.0	70	1.2553	0.0053	1.2553	1.1204
No log	2.0571	72	1.2922	-0.0117	1.2922	1.1368
No log	2.1143	74	1.4067	0.0685	1.4067	1.1860
No log	2.1714	76	1.4763	0.0168	1.4763	1.2150
No log	2.2286	78	1.4876	0.0526	1.4876	1.2197
No log	2.2857	80	1.6282	-0.0571	1.6282	1.2760
No log	2.3429	82	1.5885	-0.0646	1.5885	1.2603
No log	2.4	84	1.6067	-0.0227	1.6067	1.2676
No log	2.4571	86	1.4957	0.2122	1.4957	1.2230
No log	2.5143	88	1.3122	0.1345	1.3122	1.1455
No log	2.5714	90	1.5074	0.0433	1.5074	1.2278
No log	2.6286	92	1.6679	-0.0488	1.6679	1.2915
No log	2.6857	94	1.5845	-0.0528	1.5845	1.2588
No log	2.7429	96	1.3449	0.0427	1.3449	1.1597
No log	2.8	98	1.0866	0.2076	1.0866	1.0424
No log	2.8571	100	1.0741	0.2470	1.0741	1.0364
No log	2.9143	102	1.2973	0.1554	1.2973	1.1390
No log	2.9714	104	1.6192	-0.0291	1.6192	1.2725
No log	3.0286	106	1.7435	-0.0488	1.7435	1.3204
No log	3.0857	108	1.7110	-0.0157	1.7110	1.3080
No log	3.1429	110	1.4961	0.1568	1.4961	1.2231
No log	3.2	112	1.3309	0.1708	1.3309	1.1536
No log	3.2571	114	1.2133	0.2141	1.2133	1.1015
No log	3.3143	116	1.3368	0.1554	1.3368	1.1562
No log	3.3714	118	1.5253	0.1135	1.5253	1.2350
No log	3.4286	120	1.5819	0.0572	1.5819	1.2578
No log	3.4857	122	1.6430	0.0724	1.6430	1.2818
No log	3.5429	124	1.6355	0.1283	1.6355	1.2788
No log	3.6	126	1.5135	0.0830	1.5135	1.2302
No log	3.6571	128	1.4573	0.0822	1.4573	1.2072
No log	3.7143	130	1.5546	0.0	1.5546	1.2468
No log	3.7714	132	1.6769	-0.0221	1.6769	1.2949
No log	3.8286	134	1.8084	-0.0643	1.8084	1.3448
No log	3.8857	136	1.9048	-0.0804	1.9048	1.3802
No log	3.9429	138	1.9535	0.0741	1.9535	1.3977
No log	4.0	140	1.9312	0.1453	1.9312	1.3897
No log	4.0571	142	2.0128	0.1790	2.0128	1.4187
No log	4.1143	144	2.0142	0.1999	2.0142	1.4192
No log	4.1714	146	1.8442	0.1914	1.8442	1.3580
No log	4.2286	148	1.5303	0.1395	1.5303	1.2371
No log	4.2857	150	1.3842	0.1219	1.3842	1.1765
No log	4.3429	152	1.4529	0.1219	1.4529	1.2053
No log	4.4	154	1.5543	0.0884	1.5543	1.2467
No log	4.4571	156	1.4897	0.2964	1.4897	1.2205
No log	4.5143	158	1.3582	0.2731	1.3582	1.1654
No log	4.5714	160	1.2618	0.3003	1.2618	1.1233
No log	4.6286	162	1.3298	0.1703	1.3298	1.1532
No log	4.6857	164	1.4418	0.0750	1.4418	1.2007
No log	4.7429	166	1.6252	0.0501	1.6252	1.2748
No log	4.8	168	1.8259	0.0212	1.8259	1.3513
No log	4.8571	170	1.9441	0.0632	1.9441	1.3943
No log	4.9143	172	1.7338	0.2691	1.7338	1.3168
No log	4.9714	174	1.3642	0.1980	1.3642	1.1680
No log	5.0286	176	1.1763	0.1345	1.1763	1.0846
No log	5.0857	178	1.1281	0.1662	1.1281	1.0621
No log	5.1429	180	1.1207	0.1504	1.1207	1.0586
No log	5.2	182	1.1578	0.1159	1.1578	1.0760
No log	5.2571	184	1.3252	0.2676	1.3252	1.1512
No log	5.3143	186	1.5036	0.2713	1.5036	1.2262
No log	5.3714	188	1.6332	0.2540	1.6332	1.2780
No log	5.4286	190	1.6430	0.1918	1.6430	1.2818
No log	5.4857	192	1.4928	0.1224	1.4928	1.2218
No log	5.5429	194	1.4245	0.1098	1.4244	1.1935
No log	5.6	196	1.3466	0.1283	1.3466	1.1604
No log	5.6571	198	1.2767	0.1188	1.2767	1.1299
No log	5.7143	200	1.3477	0.1461	1.3477	1.1609
No log	5.7714	202	1.5230	0.0884	1.5230	1.2341
No log	5.8286	204	1.5579	0.0512	1.5579	1.2482
No log	5.8857	206	1.4394	0.0920	1.4394	1.1998
No log	5.9429	208	1.2683	0.1608	1.2683	1.1262
No log	6.0	210	1.1259	0.25	1.1259	1.0611
No log	6.0571	212	1.2481	0.1692	1.2481	1.1172
No log	6.1143	214	1.4083	0.1224	1.4083	1.1867
No log	6.1714	216	1.5404	0.1124	1.5404	1.2411
No log	6.2286	218	1.5146	0.1639	1.5146	1.2307
No log	6.2857	220	1.3468	0.2604	1.3468	1.1605
No log	6.3429	222	1.2163	0.1554	1.2163	1.1029
No log	6.4	224	1.2507	0.1404	1.2507	1.1184
No log	6.4571	226	1.2359	0.1122	1.2359	1.1117
No log	6.5143	228	1.2216	0.1122	1.2216	1.1053
No log	6.5714	230	1.1308	0.1282	1.1308	1.0634
No log	6.6286	232	1.2506	0.1404	1.2506	1.1183
No log	6.6857	234	1.6407	0.2132	1.6407	1.2809
No log	6.7429	236	1.9032	0.2197	1.9032	1.3796
No log	6.8	238	1.8301	0.1672	1.8301	1.3528
No log	6.8571	240	1.6147	0.1232	1.6147	1.2707
No log	6.9143	242	1.2123	0.2000	1.2123	1.1010
No log	6.9714	244	0.9853	0.3270	0.9853	0.9926
No log	7.0286	246	0.9583	0.2995	0.9583	0.9789
No log	7.0857	248	1.1546	0.2617	1.1546	1.0745
No log	7.1429	250	1.3681	0.1440	1.3681	1.1697
No log	7.2	252	1.4914	0.0987	1.4914	1.2212
No log	7.2571	254	1.6923	0.2120	1.6923	1.3009
No log	7.3143	256	1.7566	0.2481	1.7566	1.3253
No log	7.3714	258	1.6772	0.2293	1.6772	1.2951
No log	7.4286	260	1.4941	0.0851	1.4941	1.2223
No log	7.4857	262	1.3503	0.0541	1.3503	1.1620
No log	7.5429	264	1.2727	0.0454	1.2727	1.1281
No log	7.6	266	1.2893	0.0454	1.2893	1.1355
No log	7.6571	268	1.3990	0.0526	1.3990	1.1828
No log	7.7143	270	1.5934	0.1395	1.5934	1.2623
No log	7.7714	272	1.7369	0.2595	1.7369	1.3179
No log	7.8286	274	1.7918	0.2469	1.7918	1.3386
No log	7.8857	276	1.6981	0.2588	1.6981	1.3031
No log	7.9429	278	1.5143	0.2826	1.5143	1.2306
No log	8.0	280	1.4965	0.2378	1.4965	1.2233
No log	8.0571	282	1.5303	0.2424	1.5303	1.2370
No log	8.1143	284	1.6422	0.2542	1.6422	1.2815
No log	8.1714	286	1.7889	0.1745	1.7889	1.3375
No log	8.2286	288	1.9721	0.2150	1.9721	1.4043
No log	8.2857	290	2.0066	0.2150	2.0066	1.4165
No log	8.3429	292	1.8017	0.2493	1.8017	1.3423
No log	8.4	294	1.5589	0.1068	1.5589	1.2486
No log	8.4571	296	1.4256	0.0273	1.4256	1.1940
No log	8.5143	298	1.4263	-0.0169	1.4263	1.1943
No log	8.5714	300	1.4853	0.0273	1.4853	1.2187
No log	8.6286	302	1.6187	0.0501	1.6187	1.2723
No log	8.6857	304	1.7863	0.0959	1.7863	1.3365
No log	8.7429	306	1.8692	0.1672	1.8692	1.3672
No log	8.8	308	1.7728	0.1634	1.7728	1.3315
No log	8.8571	310	1.6921	0.1960	1.6921	1.3008
No log	8.9143	312	1.5725	0.1395	1.5725	1.2540
No log	8.9714	314	1.4428	0.1051	1.4428	1.2011
No log	9.0286	316	1.2991	0.0454	1.2991	1.1398
No log	9.0857	318	1.2697	0.0811	1.2697	1.1268
No log	9.1429	320	1.3744	0.0678	1.3744	1.1724
No log	9.2	322	1.5665	0.1447	1.5665	1.2516
No log	9.2571	324	1.8341	0.1416	1.8341	1.3543
No log	9.3143	326	2.1319	0.1729	2.1319	1.4601
No log	9.3714	328	2.2272	0.1282	2.2272	1.4924
No log	9.4286	330	2.1415	0.1790	2.1415	1.4634
No log	9.4857	332	1.8234	0.2834	1.8234	1.3503
No log	9.5429	334	1.4334	0.1960	1.4334	1.1972
No log	9.6	336	1.1565	0.2475	1.1565	1.0754
No log	9.6571	338	1.0916	0.2721	1.0916	1.0448
No log	9.7143	340	1.1918	0.1344	1.1918	1.0917
No log	9.7714	342	1.3175	0.0584	1.3175	1.1478
No log	9.8286	344	1.3892	0.0334	1.3892	1.1786
No log	9.8857	346	1.5302	0.1310	1.5302	1.2370
No log	9.9429	348	1.7154	0.2435	1.7154	1.3097
No log	10.0	350	1.6923	0.1953	1.6923	1.3009
No log	10.0571	352	1.5692	0.1736	1.5692	1.2527
No log	10.1143	354	1.5435	0.1997	1.5435	1.2424
No log	10.1714	356	1.3884	0.1461	1.3884	1.1783
No log	10.2286	358	1.3657	0.1646	1.3657	1.1686
No log	10.2857	360	1.3894	0.1646	1.3894	1.1787
No log	10.3429	362	1.4541	0.1196	1.4541	1.2059
No log	10.4	364	1.4761	0.1135	1.4761	1.2150
No log	10.4571	366	1.4929	0.1481	1.4929	1.2218
No log	10.5143	368	1.5402	0.1498	1.5402	1.2411
No log	10.5714	370	1.5080	0.1547	1.5080	1.2280
No log	10.6286	372	1.3325	0.1891	1.3325	1.1543
No log	10.6857	374	1.2169	0.2090	1.2169	1.1032
No log	10.7429	376	1.3158	0.2163	1.3158	1.1471
No log	10.8	378	1.4932	0.1683	1.4932	1.2220
No log	10.8571	380	1.5600	0.1843	1.5600	1.2490
No log	10.9143	382	1.5378	0.1283	1.5378	1.2401
No log	10.9714	384	1.4852	0.1621	1.4852	1.2187
No log	11.0286	386	1.4779	0.1621	1.4779	1.2157
No log	11.0857	388	1.5552	0.1547	1.5552	1.2471
No log	11.1429	390	1.7057	0.2032	1.7057	1.3060
No log	11.2	392	1.8334	0.2540	1.8334	1.3540
No log	11.2571	394	1.8260	0.2019	1.8260	1.3513
No log	11.3143	396	1.6583	0.1843	1.6583	1.2878
No log	11.3714	398	1.4554	0.1283	1.4554	1.2064
No log	11.4286	400	1.3715	0.1991	1.3715	1.1711
No log	11.4857	402	1.3611	0.1840	1.3611	1.1667
No log	11.5429	404	1.3567	0.1840	1.3567	1.1648
No log	11.6	406	1.4054	0.2252	1.4054	1.1855
No log	11.6571	408	1.4409	0.1667	1.4409	1.2004
No log	11.7143	410	1.4481	0.1667	1.4481	1.2034
No log	11.7714	412	1.5404	0.1929	1.5404	1.2411
No log	11.8286	414	1.5794	0.1970	1.5794	1.2567
No log	11.8857	416	1.5856	0.1970	1.5856	1.2592
No log	11.9429	418	1.5567	0.1970	1.5567	1.2477
No log	12.0	420	1.5866	0.2217	1.5866	1.2596
No log	12.0571	422	1.6270	0.2455	1.6270	1.2756
No log	12.1143	424	1.6748	0.2285	1.6748	1.2941
No log	12.1714	426	1.6650	0.1594	1.6650	1.2903
No log	12.2286	428	1.6645	0.1594	1.6645	1.2901
No log	12.2857	430	1.6804	0.1639	1.6804	1.2963
No log	12.3429	432	1.6595	0.1767	1.6595	1.2882
No log	12.4	434	1.6140	0.2514	1.6140	1.2704
No log	12.4571	436	1.6612	0.2408	1.6612	1.2889
No log	12.5143	438	1.7176	0.2585	1.7176	1.3106
No log	12.5714	440	1.7460	0.2408	1.7460	1.3213
No log	12.6286	442	1.7136	0.2381	1.7136	1.3091
No log	12.6857	444	1.5861	0.1882	1.5861	1.2594
No log	12.7429	446	1.4499	0.1646	1.4499	1.2041
No log	12.8	448	1.3130	0.1219	1.3130	1.1459
No log	12.8571	450	1.2694	0.1219	1.2694	1.1267
No log	12.9143	452	1.2784	0.1219	1.2784	1.1307
No log	12.9714	454	1.3066	0.1219	1.3066	1.1430
No log	13.0286	456	1.2517	0.1219	1.2517	1.1188
No log	13.0857	458	1.2991	0.1345	1.2991	1.1398
No log	13.1429	460	1.3698	0.0750	1.3698	1.1704
No log	13.2	462	1.3691	0.0750	1.3691	1.1701
No log	13.2571	464	1.3115	0.1219	1.3115	1.1452
No log	13.3143	466	1.2731	0.1219	1.2731	1.1283
No log	13.3714	468	1.2361	0.0887	1.2361	1.1118
No log	13.4286	470	1.2888	0.0887	1.2888	1.1353
No log	13.4857	472	1.3652	0.1345	1.3652	1.1684
No log	13.5429	474	1.3640	0.1162	1.3640	1.1679
No log	13.6	476	1.2768	0.1162	1.2768	1.1299
No log	13.6571	478	1.2038	0.1692	1.2038	1.0972
No log	13.7143	480	1.1856	0.1846	1.1856	1.0889
No log	13.7714	482	1.2320	0.1991	1.2320	1.1099
No log	13.8286	484	1.3223	0.1340	1.3223	1.1499
No log	13.8857	486	1.4468	0.2217	1.4468	1.2028
No log	13.9429	488	1.5462	0.2514	1.5462	1.2435
No log	14.0	490	1.6076	0.3173	1.6076	1.2679
No log	14.0571	492	1.5913	0.3189	1.5913	1.2615
No log	14.1143	494	1.4887	0.2685	1.4887	1.2201
No log	14.1714	496	1.4433	0.2181	1.4433	1.2014
No log	14.2286	498	1.4504	0.2285	1.4504	1.2043
0.3681	14.2857	500	1.4852	0.2514	1.4852	1.2187
0.3681	14.3429	502	1.5057	0.3140	1.5057	1.2271
0.3681	14.4	504	1.5917	0.2857	1.5917	1.2616
0.3681	14.4571	506	1.5832	0.2857	1.5832	1.2583
0.3681	14.5143	508	1.5151	0.2047	1.5151	1.2309
0.3681	14.5714	510	1.3823	0.1886	1.3823	1.1757
0.3681	14.6286	512	1.3346	0.1568	1.3346	1.1552
0.3681	14.6857	514	1.3326	0.1796	1.3326	1.1544
0.3681	14.7429	516	1.3805	0.2020	1.3805	1.1749

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1