ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4003
• Qwk: 0.4882
• Mse: 1.4003
• Rmse: 1.1834

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0417	2	6.9691	0.0118	6.9691	2.6399
No log	0.0833	4	4.7166	0.0887	4.7166	2.1718
No log	0.125	6	4.2660	-0.0597	4.2660	2.0654
No log	0.1667	8	3.3424	-0.0538	3.3424	1.8282
No log	0.2083	10	2.1979	0.1765	2.1979	1.4825
No log	0.25	12	2.1162	0.3239	2.1162	1.4547
No log	0.2917	14	2.5619	0.0843	2.5619	1.6006
No log	0.3333	16	2.3594	0.2000	2.3594	1.5360
No log	0.375	18	1.7652	0.3465	1.7652	1.3286
No log	0.4167	20	1.5131	0.1964	1.5131	1.2301
No log	0.4583	22	1.5268	0.1869	1.5268	1.2357
No log	0.5	24	1.4518	0.1714	1.4518	1.2049
No log	0.5417	26	1.4525	0.2342	1.4525	1.2052
No log	0.5833	28	1.6752	0.3306	1.6752	1.2943
No log	0.625	30	2.1671	0.1408	2.1671	1.4721
No log	0.6667	32	2.4334	0.1169	2.4334	1.5599
No log	0.7083	34	2.2710	0.0699	2.2710	1.5070
No log	0.75	36	2.0185	0.2667	2.0185	1.4207
No log	0.7917	38	1.6041	0.3548	1.6041	1.2665
No log	0.8333	40	1.3925	0.1651	1.3925	1.1800
No log	0.875	42	1.6218	0.1770	1.6218	1.2735
No log	0.9167	44	1.6845	0.1622	1.6845	1.2979
No log	0.9583	46	1.5062	0.1651	1.5062	1.2273
No log	1.0	48	1.5744	0.2564	1.5744	1.2548
No log	1.0417	50	1.8271	0.2969	1.8271	1.3517
No log	1.0833	52	1.8929	0.2424	1.8929	1.3758
No log	1.125	54	1.7985	0.3281	1.7985	1.3411
No log	1.1667	56	1.4376	0.3934	1.4376	1.1990
No log	1.2083	58	1.4336	0.3906	1.4336	1.1973
No log	1.25	60	1.5509	0.4062	1.5509	1.2454
No log	1.2917	62	1.2760	0.4741	1.2760	1.1296
No log	1.3333	64	1.1897	0.5882	1.1897	1.0907
No log	1.375	66	1.1405	0.5693	1.1405	1.0679
No log	1.4167	68	1.1483	0.5693	1.1483	1.0716
No log	1.4583	70	1.2973	0.4853	1.2973	1.1390
No log	1.5	72	1.5987	0.4	1.5987	1.2644
No log	1.5417	74	1.6588	0.2880	1.6588	1.2879
No log	1.5833	76	1.3063	0.5191	1.3063	1.1429
No log	1.625	78	1.2473	0.5303	1.2473	1.1168
No log	1.6667	80	1.6860	0.2295	1.6860	1.2985
No log	1.7083	82	1.8137	0.2353	1.8137	1.3467
No log	1.75	84	1.8581	0.1565	1.8581	1.3631
No log	1.7917	86	1.8760	0.1197	1.8760	1.3697
No log	1.8333	88	1.4133	0.3902	1.4133	1.1888
No log	1.875	90	1.1489	0.5455	1.1489	1.0719
No log	1.9167	92	1.1717	0.5271	1.1717	1.0824
No log	1.9583	94	1.4351	0.4308	1.4351	1.1979
No log	2.0	96	1.5421	0.4211	1.5421	1.2418
No log	2.0417	98	1.4281	0.4662	1.4281	1.1950
No log	2.0833	100	1.1822	0.5865	1.1822	1.0873
No log	2.125	102	1.0755	0.5496	1.0755	1.0371
No log	2.1667	104	1.0437	0.5714	1.0437	1.0216
No log	2.2083	106	1.2306	0.5152	1.2306	1.1093
No log	2.25	108	1.3848	0.4559	1.3848	1.1768
No log	2.2917	110	1.2874	0.5263	1.2874	1.1346
No log	2.3333	112	1.1478	0.5758	1.1478	1.0714
No log	2.375	114	1.1359	0.5758	1.1359	1.0658
No log	2.4167	116	1.2230	0.5802	1.2230	1.1059
No log	2.4583	118	1.3219	0.5414	1.3219	1.1497
No log	2.5	120	1.4452	0.4444	1.4452	1.2022
No log	2.5417	122	1.4621	0.4706	1.4621	1.2092
No log	2.5833	124	1.4749	0.4818	1.4749	1.2145
No log	2.625	126	1.3696	0.5588	1.3696	1.1703
No log	2.6667	128	1.3340	0.5714	1.3340	1.1550
No log	2.7083	130	1.5716	0.4308	1.5716	1.2536
No log	2.75	132	1.7743	0.2308	1.7743	1.3320
No log	2.7917	134	1.5307	0.5156	1.5307	1.2372
No log	2.8333	136	1.2289	0.5714	1.2289	1.1085
No log	2.875	138	1.2198	0.5669	1.2198	1.1045
No log	2.9167	140	1.4440	0.4462	1.4440	1.2017
No log	2.9583	142	2.0176	0.1667	2.0176	1.4204
No log	3.0	144	2.4031	0.0444	2.4031	1.5502
No log	3.0417	146	2.0562	0.1912	2.0562	1.4339
No log	3.0833	148	1.5655	0.4812	1.5655	1.2512
No log	3.125	150	1.1911	0.5669	1.1911	1.0914
No log	3.1667	152	1.1390	0.56	1.1390	1.0672
No log	3.2083	154	1.2698	0.4603	1.2698	1.1268
No log	3.25	156	1.5627	0.3333	1.5627	1.2501
No log	3.2917	158	1.9499	0.1692	1.9499	1.3964
No log	3.3333	160	1.8884	0.2154	1.8884	1.3742
No log	3.375	162	1.5101	0.4361	1.5101	1.2289
No log	3.4167	164	1.3224	0.5758	1.3224	1.1499
No log	3.4583	166	1.3327	0.5496	1.3327	1.1544
No log	3.5	168	1.5558	0.3852	1.5558	1.2473
No log	3.5417	170	1.7371	0.2985	1.7371	1.3180
No log	3.5833	172	1.6971	0.2901	1.6971	1.3027
No log	3.625	174	1.7847	0.1705	1.7847	1.3359
No log	3.6667	176	1.5217	0.3333	1.5217	1.2336
No log	3.7083	178	1.6875	0.3016	1.6875	1.2991
No log	3.75	180	1.6114	0.3040	1.6114	1.2694
No log	3.7917	182	1.5417	0.3040	1.5417	1.2416
No log	3.8333	184	1.4407	0.4603	1.4407	1.2003
No log	3.875	186	1.3216	0.4882	1.3216	1.1496
No log	3.9167	188	1.2912	0.5156	1.2912	1.1363
No log	3.9583	190	1.2848	0.5426	1.2848	1.1335
No log	4.0	192	1.2092	0.544	1.2092	1.0996
No log	4.0417	194	1.2387	0.5397	1.2387	1.1130
No log	4.0833	196	1.2444	0.5512	1.2444	1.1155
No log	4.125	198	1.2298	0.4237	1.2298	1.1090
No log	4.1667	200	1.2879	0.4138	1.2879	1.1349
No log	4.2083	202	1.4377	0.4531	1.4377	1.1991
No log	4.25	204	1.6129	0.3969	1.6129	1.2700
No log	4.2917	206	1.4395	0.4806	1.4395	1.1998
No log	4.3333	208	1.2473	0.5041	1.2473	1.1168
No log	4.375	210	1.2504	0.4628	1.2504	1.1182
No log	4.4167	212	1.3608	0.4426	1.3608	1.1665
No log	4.4583	214	1.4803	0.4651	1.4803	1.2167
No log	4.5	216	1.4111	0.4724	1.4111	1.1879
No log	4.5417	218	1.3177	0.4839	1.3177	1.1479
No log	4.5833	220	1.3113	0.4715	1.3113	1.1451
No log	4.625	222	1.4070	0.4194	1.4070	1.1862
No log	4.6667	224	1.5921	0.3817	1.5921	1.2618
No log	4.7083	226	1.7919	0.3259	1.7919	1.3386
No log	4.75	228	1.7405	0.3433	1.7405	1.3193
No log	4.7917	230	1.5280	0.4341	1.5280	1.2361
No log	4.8333	232	1.2723	0.4754	1.2723	1.1279
No log	4.875	234	1.1032	0.4538	1.1032	1.0503
No log	4.9167	236	1.0767	0.5484	1.0767	1.0376
No log	4.9583	238	1.2417	0.5156	1.2417	1.1143
No log	5.0	240	1.7112	0.3459	1.7112	1.3081
No log	5.0417	242	1.9030	0.2556	1.9030	1.3795
No log	5.0833	244	1.5739	0.4122	1.5739	1.2545
No log	5.125	246	1.2706	0.4878	1.2706	1.1272
No log	5.1667	248	1.2571	0.4237	1.2571	1.1212
No log	5.2083	250	1.2708	0.4237	1.2708	1.1273
No log	5.25	252	1.3485	0.4444	1.3485	1.1612
No log	5.2917	254	1.7179	0.3284	1.7179	1.3107
No log	5.3333	256	1.9231	0.2302	1.9231	1.3867
No log	5.375	258	1.7024	0.3650	1.7024	1.3047
No log	5.4167	260	1.3026	0.4567	1.3026	1.1413
No log	5.4583	262	1.2445	0.4640	1.2445	1.1156
No log	5.5	264	1.3558	0.4444	1.3558	1.1644
No log	5.5417	266	1.5903	0.4308	1.5903	1.2611
No log	5.5833	268	1.7558	0.3609	1.7558	1.3251
No log	5.625	270	1.6782	0.3788	1.6782	1.2954
No log	5.6667	272	1.4166	0.4286	1.4166	1.1902
No log	5.7083	274	1.3219	0.4444	1.3219	1.1497
No log	5.75	276	1.3980	0.4567	1.3980	1.1824
No log	5.7917	278	1.5453	0.4242	1.5453	1.2431
No log	5.8333	280	1.7129	0.3459	1.7129	1.3088
No log	5.875	282	1.7531	0.3407	1.7531	1.3241
No log	5.9167	284	1.5902	0.3485	1.5902	1.2610
No log	5.9583	286	1.3561	0.4590	1.3561	1.1645
No log	6.0	288	1.2316	0.4706	1.2316	1.1098
No log	6.0417	290	1.1886	0.5246	1.1886	1.0902
No log	6.0833	292	1.1952	0.4706	1.1952	1.0932
No log	6.125	294	1.2824	0.4715	1.2824	1.1324
No log	6.1667	296	1.4705	0.4724	1.4705	1.2126
No log	6.2083	298	1.5713	0.3788	1.5713	1.2535
No log	6.25	300	1.5463	0.4308	1.5463	1.2435
No log	6.2917	302	1.4086	0.4590	1.4086	1.1868
No log	6.3333	304	1.3580	0.3966	1.3580	1.1653
No log	6.375	306	1.3846	0.2407	1.3846	1.1767
No log	6.4167	308	1.3360	0.2883	1.3360	1.1559
No log	6.4583	310	1.2904	0.5082	1.2904	1.1359
No log	6.5	312	1.5587	0.3594	1.5587	1.2485
No log	6.5417	314	1.8340	0.2595	1.8340	1.3542
No log	6.5833	316	2.0447	0.1212	2.0447	1.4299
No log	6.625	318	1.6431	0.4060	1.6431	1.2819
No log	6.6667	320	1.4331	0.4662	1.4331	1.1971
No log	6.7083	322	1.2737	0.5426	1.2737	1.1286
No log	6.75	324	1.2463	0.5	1.2463	1.1164
No log	6.7917	326	1.2579	0.4878	1.2579	1.1216
No log	6.8333	328	1.3323	0.5079	1.3323	1.1543
No log	6.875	330	1.5491	0.4122	1.5491	1.2446
No log	6.9167	332	1.6463	0.3759	1.6463	1.2831
No log	6.9583	334	1.5967	0.3759	1.5967	1.2636
No log	7.0	336	1.4841	0.4688	1.4841	1.2182
No log	7.0417	338	1.5082	0.4688	1.5082	1.2281
No log	7.0833	340	1.5438	0.4031	1.5438	1.2425
No log	7.125	342	1.4447	0.4839	1.4447	1.2019
No log	7.1667	344	1.3256	0.4202	1.3256	1.1514
No log	7.2083	346	1.3075	0.3214	1.3075	1.1434
No log	7.25	348	1.2689	0.4538	1.2689	1.1264
No log	7.2917	350	1.2657	0.4793	1.2657	1.1250
No log	7.3333	352	1.3712	0.5039	1.3712	1.1710
No log	7.375	354	1.4504	0.4651	1.4504	1.2043
No log	7.4167	356	1.3520	0.4844	1.3520	1.1627
No log	7.4583	358	1.2397	0.5	1.2397	1.1134
No log	7.5	360	1.2252	0.4035	1.2252	1.1069
No log	7.5417	362	1.1708	0.4035	1.1708	1.0820
No log	7.5833	364	1.0961	0.5528	1.0961	1.0470
No log	7.625	366	1.1747	0.5397	1.1747	1.0838
No log	7.6667	368	1.3846	0.5116	1.3846	1.1767
No log	7.7083	370	1.5669	0.4580	1.5669	1.2517
No log	7.75	372	1.3935	0.4806	1.3935	1.1805
No log	7.7917	374	1.2194	0.4762	1.2194	1.1043
No log	7.8333	376	1.1674	0.5039	1.1674	1.0805
No log	7.875	378	1.2319	0.4762	1.2319	1.1099
No log	7.9167	380	1.2561	0.4762	1.2561	1.1208
No log	7.9583	382	1.2415	0.4762	1.2415	1.1142
No log	8.0	384	1.2945	0.4724	1.2945	1.1378
No log	8.0417	386	1.2764	0.4724	1.2764	1.1298
No log	8.0833	388	1.2281	0.4724	1.2281	1.1082
No log	8.125	390	1.3321	0.4923	1.3321	1.1542
No log	8.1667	392	1.6137	0.3731	1.6137	1.2703
No log	8.2083	394	1.9858	0.2222	1.9858	1.4092
No log	8.25	396	1.9204	0.2222	1.9204	1.3858
No log	8.2917	398	1.5276	0.4545	1.5276	1.2360
No log	8.3333	400	1.2088	0.4762	1.2088	1.0995
No log	8.375	402	1.0850	0.5760	1.0850	1.0416
No log	8.4167	404	1.0809	0.5082	1.0809	1.0397
No log	8.4583	406	1.1037	0.5760	1.1037	1.0506
No log	8.5	408	1.2448	0.4882	1.2448	1.1157
No log	8.5417	410	1.4878	0.4545	1.4878	1.2198
No log	8.5833	412	1.5341	0.4545	1.5341	1.2386
No log	8.625	414	1.3674	0.4923	1.3674	1.1694
No log	8.6667	416	1.0722	0.6	1.0722	1.0355
No log	8.7083	418	0.9886	0.6142	0.9886	0.9943
No log	8.75	420	1.0269	0.5891	1.0269	1.0134
No log	8.7917	422	1.1611	0.5802	1.1611	1.0776
No log	8.8333	424	1.3420	0.5116	1.3420	1.1584
No log	8.875	426	1.4116	0.4806	1.4116	1.1881
No log	8.9167	428	1.4672	0.4697	1.4672	1.2113
No log	8.9583	430	1.3659	0.4923	1.3659	1.1687
No log	9.0	432	1.2210	0.5156	1.2210	1.1050
No log	9.0417	434	1.1429	0.5271	1.1429	1.0691
No log	9.0833	436	1.1822	0.5156	1.1822	1.0873
No log	9.125	438	1.2648	0.5231	1.2648	1.1246
No log	9.1667	440	1.3042	0.4961	1.3042	1.1420
No log	9.2083	442	1.3247	0.4882	1.3247	1.1509
No log	9.25	444	1.3111	0.4762	1.3111	1.1451
No log	9.2917	446	1.3433	0.4882	1.3433	1.1590
No log	9.3333	448	1.3928	0.4844	1.3928	1.1802
No log	9.375	450	1.3705	0.4882	1.3705	1.1707
No log	9.4167	452	1.2863	0.4762	1.2863	1.1341
No log	9.4583	454	1.1770	0.512	1.1770	1.0849
No log	9.5	456	1.1342	0.5366	1.1342	1.0650
No log	9.5417	458	1.1880	0.496	1.1880	1.0899
No log	9.5833	460	1.3675	0.4844	1.3675	1.1694
No log	9.625	462	1.6796	0.3582	1.6796	1.2960
No log	9.6667	464	1.8367	0.3066	1.8367	1.3552
No log	9.7083	466	1.7589	0.3382	1.7589	1.3262
No log	9.75	468	1.5319	0.4308	1.5319	1.2377
No log	9.7917	470	1.2482	0.5079	1.2482	1.1172
No log	9.8333	472	1.1411	0.5323	1.1411	1.0682
No log	9.875	474	1.1567	0.4833	1.1567	1.0755
No log	9.9167	476	1.1774	0.5323	1.1774	1.0851
No log	9.9583	478	1.2343	0.5323	1.2343	1.1110
No log	10.0	480	1.2612	0.5079	1.2612	1.1230
No log	10.0417	482	1.2634	0.5354	1.2634	1.1240
No log	10.0833	484	1.2009	0.5354	1.2009	1.0958
No log	10.125	486	1.2541	0.5079	1.2541	1.1199
No log	10.1667	488	1.2695	0.5079	1.2695	1.1267
No log	10.2083	490	1.2342	0.512	1.2342	1.1110
No log	10.25	492	1.1706	0.56	1.1706	1.0819
No log	10.2917	494	1.1717	0.5354	1.1717	1.0824
No log	10.3333	496	1.2252	0.5271	1.2252	1.1069
No log	10.375	498	1.1536	0.5846	1.1536	1.0740
0.3916	10.4167	500	1.1699	0.5846	1.1699	1.0816
0.3916	10.4583	502	1.1233	0.6047	1.1233	1.0599
0.3916	10.5	504	1.1236	0.5827	1.1236	1.0600
0.3916	10.5417	506	1.2401	0.5846	1.2401	1.1136
0.3916	10.5833	508	1.4027	0.5156	1.4027	1.1843
0.3916	10.625	510	1.4736	0.4219	1.4736	1.2139
0.3916	10.6667	512	1.4003	0.4882	1.4003	1.1834

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1