ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k13_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3189
• Qwk: 0.5191
• Mse: 1.3189
• Rmse: 1.1485

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0351	2	7.0890	-0.0056	7.0890	2.6625
No log	0.0702	4	4.7640	0.0813	4.7640	2.1826
No log	0.1053	6	4.9295	-0.0889	4.9295	2.2202
No log	0.1404	8	4.1475	-0.0874	4.1475	2.0365
No log	0.1754	10	2.1597	0.1719	2.1597	1.4696
No log	0.2105	12	2.1562	0.1148	2.1562	1.4684
No log	0.2456	14	2.9088	-0.0265	2.9088	1.7055
No log	0.2807	16	2.6935	-0.0267	2.6935	1.6412
No log	0.3158	18	2.2916	-0.0301	2.2916	1.5138
No log	0.3509	20	2.1608	0.0508	2.1608	1.4700
No log	0.3860	22	2.1471	0.0508	2.1471	1.4653
No log	0.4211	24	1.9872	0.1495	1.9872	1.4097
No log	0.4561	26	1.8303	0.1346	1.8303	1.3529
No log	0.4912	28	1.7117	0.0396	1.7117	1.3083
No log	0.5263	30	1.6253	0.1346	1.6253	1.2749
No log	0.5614	32	1.4922	0.2056	1.4922	1.2216
No log	0.5965	34	1.4199	0.3214	1.4199	1.1916
No log	0.6316	36	1.3566	0.3158	1.3566	1.1647
No log	0.6667	38	1.3449	0.2609	1.3449	1.1597
No log	0.7018	40	1.3587	0.2655	1.3587	1.1656
No log	0.7368	42	1.3553	0.2857	1.3553	1.1642
No log	0.7719	44	1.2530	0.3934	1.2530	1.1194
No log	0.8070	46	1.2032	0.4480	1.2032	1.0969
No log	0.8421	48	1.2378	0.3448	1.2378	1.1126
No log	0.8772	50	1.2118	0.3898	1.2118	1.1008
No log	0.9123	52	1.2714	0.3304	1.2714	1.1276
No log	0.9474	54	1.1765	0.4068	1.1765	1.0847
No log	0.9825	56	1.2742	0.4138	1.2742	1.1288
No log	1.0175	58	1.2500	0.5203	1.2500	1.1180
No log	1.0526	60	1.1480	0.5649	1.1480	1.0714
No log	1.0877	62	1.2368	0.5077	1.2368	1.1121
No log	1.1228	64	1.6388	0.3438	1.6388	1.2801
No log	1.1579	66	2.1526	0.0763	2.1526	1.4672
No log	1.1930	68	1.6667	0.3704	1.6667	1.2910
No log	1.2281	70	1.0912	0.5441	1.0912	1.0446
No log	1.2632	72	1.2609	0.5109	1.2609	1.1229
No log	1.2982	74	1.8650	0.3286	1.8650	1.3657
No log	1.3333	76	2.3656	0.125	2.3656	1.5381
No log	1.3684	78	2.4325	0.125	2.4325	1.5597
No log	1.4035	80	2.0840	0.2517	2.0840	1.4436
No log	1.4386	82	1.4459	0.4030	1.4459	1.2025
No log	1.4737	84	1.2800	0.5191	1.2800	1.1314
No log	1.5088	86	1.3988	0.4496	1.3988	1.1827
No log	1.5439	88	1.7591	0.3676	1.7591	1.3263
No log	1.5789	90	1.9653	0.2553	1.9653	1.4019
No log	1.6140	92	1.7355	0.3676	1.7355	1.3174
No log	1.6491	94	1.2334	0.5538	1.2334	1.1106
No log	1.6842	96	1.0083	0.6165	1.0083	1.0041
No log	1.7193	98	1.1392	0.5649	1.1392	1.0673
No log	1.7544	100	1.5489	0.4058	1.5489	1.2446
No log	1.7895	102	1.5240	0.4088	1.5240	1.2345
No log	1.8246	104	1.1488	0.5692	1.1488	1.0718
No log	1.8596	106	0.9292	0.6202	0.9292	0.9640
No log	1.8947	108	0.9404	0.544	0.9404	0.9698
No log	1.9298	110	1.0430	0.5891	1.0430	1.0213
No log	1.9649	112	1.4623	0.4662	1.4623	1.2093
No log	2.0	114	1.7948	0.3235	1.7948	1.3397
No log	2.0351	116	1.7297	0.3676	1.7297	1.3152
No log	2.0702	118	1.3630	0.5077	1.3630	1.1675
No log	2.1053	120	1.0164	0.6412	1.0164	1.0082
No log	2.1404	122	0.9005	0.6519	0.9005	0.9489
No log	2.1754	124	0.9460	0.5778	0.9460	0.9726
No log	2.2105	126	1.4516	0.4460	1.4516	1.2048
No log	2.2456	128	1.6068	0.3913	1.6068	1.2676
No log	2.2807	130	1.2794	0.5109	1.2794	1.1311
No log	2.3158	132	0.8859	0.5970	0.8859	0.9412
No log	2.3509	134	0.8329	0.6618	0.8329	0.9126
No log	2.3860	136	1.0172	0.5714	1.0172	1.0086
No log	2.4211	138	1.5141	0.3913	1.5141	1.2305
No log	2.4561	140	1.5982	0.3571	1.5982	1.2642
No log	2.4912	142	1.2624	0.4812	1.2624	1.1236
No log	2.5263	144	1.1848	0.5630	1.1848	1.0885
No log	2.5614	146	1.1097	0.5821	1.1097	1.0534
No log	2.5965	148	1.1443	0.5821	1.1443	1.0697
No log	2.6316	150	1.0954	0.6074	1.0954	1.0466
No log	2.6667	152	1.2147	0.5735	1.2147	1.1021
No log	2.7018	154	1.2397	0.5401	1.2397	1.1134
No log	2.7368	156	1.4053	0.4317	1.4053	1.1854
No log	2.7719	158	1.2907	0.5072	1.2907	1.1361
No log	2.8070	160	1.0262	0.6029	1.0262	1.0130
No log	2.8421	162	0.8790	0.6857	0.8790	0.9375
No log	2.8772	164	0.9280	0.6471	0.9280	0.9633
No log	2.9123	166	1.1564	0.5564	1.1564	1.0754
No log	2.9474	168	1.4783	0.4234	1.4783	1.2158
No log	2.9825	170	1.7066	0.3714	1.7066	1.3064
No log	3.0175	172	1.6682	0.3714	1.6682	1.2916
No log	3.0526	174	1.5401	0.4088	1.5401	1.2410
No log	3.0877	176	1.1897	0.5781	1.1897	1.0908
No log	3.1228	178	1.0068	0.6522	1.0068	1.0034
No log	3.1579	180	1.0185	0.6667	1.0185	1.0092
No log	3.1930	182	1.1907	0.5496	1.1907	1.0912
No log	3.2281	184	1.3530	0.4526	1.3530	1.1632
No log	3.2632	186	1.2040	0.5217	1.2040	1.0973
No log	3.2982	188	0.9361	0.6286	0.9361	0.9675
No log	3.3333	190	0.8476	0.6569	0.8476	0.9207
No log	3.3684	192	0.9507	0.5649	0.9507	0.9751
No log	3.4035	194	1.2357	0.5231	1.2357	1.1116
No log	3.4386	196	1.3580	0.5	1.3580	1.1653
No log	3.4737	198	1.2724	0.5231	1.2724	1.1280
No log	3.5088	200	1.2347	0.5231	1.2347	1.1112
No log	3.5439	202	1.2509	0.5231	1.2509	1.1184
No log	3.5789	204	1.1497	0.5231	1.1497	1.0722
No log	3.6140	206	1.1353	0.5496	1.1353	1.0655
No log	3.6491	208	1.2600	0.5191	1.2600	1.1225
No log	3.6842	210	1.2755	0.5191	1.2755	1.1294
No log	3.7193	212	1.1953	0.5344	1.1953	1.0933
No log	3.7544	214	1.1515	0.5385	1.1515	1.0731
No log	3.7895	216	1.2174	0.5077	1.2174	1.1033
No log	3.8246	218	1.0833	0.5954	1.0833	1.0408
No log	3.8596	220	0.9333	0.6519	0.9333	0.9661
No log	3.8947	222	0.9132	0.6519	0.9132	0.9556
No log	3.9298	224	1.0304	0.5846	1.0304	1.0151
No log	3.9649	226	1.1059	0.5385	1.1059	1.0516
No log	4.0	228	0.9664	0.6047	0.9664	0.9831
No log	4.0351	230	0.8741	0.6406	0.8741	0.9349
No log	4.0702	232	0.8341	0.6202	0.8341	0.9133
No log	4.1053	234	0.9415	0.6047	0.9415	0.9703
No log	4.1404	236	1.2061	0.4812	1.2061	1.0982
No log	4.1754	238	1.1762	0.4812	1.1762	1.0845
No log	4.2105	240	0.9153	0.6466	0.9153	0.9567
No log	4.2456	242	0.9131	0.6567	0.9131	0.9555
No log	4.2807	244	0.9644	0.6015	0.9644	0.9820
No log	4.3158	246	0.9930	0.5926	0.9930	0.9965
No log	4.3509	248	1.1115	0.5758	1.1115	1.0543
No log	4.3860	250	1.1390	0.5496	1.1390	1.0672
No log	4.4211	252	1.0773	0.5758	1.0773	1.0379
No log	4.4561	254	1.0022	0.5758	1.0022	1.0011
No log	4.4912	256	1.1308	0.5385	1.1308	1.0634
No log	4.5263	258	1.1032	0.5385	1.1032	1.0503
No log	4.5614	260	0.9739	0.5938	0.9739	0.9869
No log	4.5965	262	0.9708	0.6107	0.9708	0.9853
No log	4.6316	264	1.1347	0.5496	1.1347	1.0652
No log	4.6667	266	1.2290	0.4706	1.2290	1.1086
No log	4.7018	268	1.3228	0.4706	1.3228	1.1501
No log	4.7368	270	1.5627	0.3913	1.5627	1.2501
No log	4.7719	272	1.5275	0.4088	1.5275	1.2359
No log	4.8070	274	1.3259	0.4706	1.3259	1.1515
No log	4.8421	276	1.4167	0.4444	1.4167	1.1902
No log	4.8772	278	1.3584	0.4478	1.3584	1.1655
No log	4.9123	280	1.1457	0.5469	1.1457	1.0704
No log	4.9474	282	1.0738	0.5760	1.0738	1.0362
No log	4.9825	284	1.1663	0.5079	1.1663	1.0799
No log	5.0175	286	1.4391	0.4308	1.4391	1.1996
No log	5.0526	288	1.9358	0.2857	1.9358	1.3913
No log	5.0877	290	1.9909	0.2817	1.9909	1.4110
No log	5.1228	292	1.7702	0.3650	1.7702	1.3305
No log	5.1579	294	1.6300	0.3824	1.6300	1.2767
No log	5.1930	296	1.3762	0.4478	1.3762	1.1731
No log	5.2281	298	1.3510	0.4741	1.3510	1.1623
No log	5.2632	300	1.5248	0.4412	1.5248	1.2348
No log	5.2982	302	1.7052	0.3478	1.7052	1.3058
No log	5.3333	304	1.7566	0.3478	1.7566	1.3254
No log	5.3684	306	1.5688	0.3971	1.5688	1.2525
No log	5.4035	308	1.3046	0.5156	1.3046	1.1422
No log	5.4386	310	1.2038	0.5512	1.2038	1.0972
No log	5.4737	312	1.2005	0.5079	1.2005	1.0957
No log	5.5088	314	1.2124	0.5079	1.2124	1.1011
No log	5.5439	316	1.1615	0.5156	1.1615	1.0777
No log	5.5789	318	1.0225	0.5891	1.0225	1.0112
No log	5.6140	320	0.9913	0.6107	0.9913	0.9956
No log	5.6491	322	0.9510	0.6107	0.9510	0.9752
No log	5.6842	324	0.8395	0.6364	0.8395	0.9163
No log	5.7193	326	0.9347	0.6107	0.9347	0.9668
No log	5.7544	328	0.9764	0.6107	0.9764	0.9881
No log	5.7895	330	0.9121	0.6316	0.9121	0.9550
No log	5.8246	332	0.9515	0.6316	0.9515	0.9755
No log	5.8596	334	1.0262	0.5970	1.0262	1.0130
No log	5.8947	336	1.2361	0.4848	1.2361	1.1118
No log	5.9298	338	1.4300	0.4662	1.4300	1.1958
No log	5.9649	340	1.2936	0.4848	1.2936	1.1374
No log	6.0	342	1.0487	0.5197	1.0487	1.0241
No log	6.0351	344	0.8930	0.6462	0.8930	0.9450
No log	6.0702	346	0.8426	0.6512	0.8426	0.9179
No log	6.1053	348	0.9431	0.5938	0.9431	0.9711
No log	6.1404	350	1.2510	0.4885	1.2510	1.1185
No log	6.1754	352	1.4710	0.4394	1.4710	1.2129
No log	6.2105	354	1.3306	0.4427	1.3306	1.1535
No log	6.2456	356	1.2262	0.4615	1.2262	1.1073
No log	6.2807	358	1.0590	0.5271	1.0590	1.0291
No log	6.3158	360	1.0433	0.5271	1.0433	1.0214
No log	6.3509	362	1.0392	0.5538	1.0392	1.0194
No log	6.3860	364	1.1051	0.5496	1.1051	1.0512
No log	6.4211	366	1.0539	0.5538	1.0539	1.0266
No log	6.4561	368	1.0871	0.5496	1.0871	1.0427
No log	6.4912	370	1.0405	0.5538	1.0405	1.0201
No log	6.5263	372	0.9278	0.6	0.9278	0.9632
No log	6.5614	374	0.8332	0.625	0.8332	0.9128
No log	6.5965	376	0.8146	0.625	0.8146	0.9025
No log	6.6316	378	0.8241	0.625	0.8241	0.9078
No log	6.6667	380	0.8833	0.6202	0.8833	0.9398
No log	6.7018	382	0.9547	0.5938	0.9547	0.9771
No log	6.7368	384	0.9315	0.6202	0.9315	0.9652
No log	6.7719	386	0.9293	0.6406	0.9293	0.9640
No log	6.8070	388	0.9189	0.6299	0.9189	0.9586
No log	6.8421	390	0.9502	0.625	0.9502	0.9748
No log	6.8772	392	0.9768	0.6308	0.9768	0.9883
No log	6.9123	394	1.0212	0.6107	1.0212	1.0105
No log	6.9474	396	1.0299	0.6107	1.0299	1.0148
No log	6.9825	398	1.0870	0.5385	1.0870	1.0426
No log	7.0175	400	1.1547	0.4769	1.1547	1.0746
No log	7.0526	402	1.2640	0.4697	1.2640	1.1243
No log	7.0877	404	1.1516	0.5714	1.1516	1.0731
No log	7.1228	406	0.9756	0.6212	0.9756	0.9877
No log	7.1579	408	0.9944	0.6212	0.9944	0.9972
No log	7.1930	410	1.0961	0.5846	1.0961	1.0469
No log	7.2281	412	1.0862	0.5846	1.0862	1.0422
No log	7.2632	414	0.9552	0.6107	0.9552	0.9774
No log	7.2982	416	0.8246	0.6565	0.8246	0.9081
No log	7.3333	418	0.8338	0.6565	0.8338	0.9131
No log	7.3684	420	0.9924	0.5354	0.9924	0.9962
No log	7.4035	422	1.0882	0.5263	1.0882	1.0432
No log	7.4386	424	1.1246	0.5231	1.1246	1.0605
No log	7.4737	426	1.0147	0.5556	1.0147	1.0073
No log	7.5088	428	0.9035	0.6142	0.9035	0.9505
No log	7.5439	430	0.8139	0.6457	0.8139	0.9022
No log	7.5789	432	0.8465	0.6142	0.8465	0.9201
No log	7.6140	434	0.9813	0.5827	0.9813	0.9906
No log	7.6491	436	1.1246	0.5736	1.1246	1.0605
No log	7.6842	438	1.1731	0.5469	1.1731	1.0831
No log	7.7193	440	1.1088	0.5625	1.1088	1.0530
No log	7.7544	442	0.9496	0.5873	0.9496	0.9745
No log	7.7895	444	0.8353	0.6457	0.8353	0.9139
No log	7.8246	446	0.7711	0.6508	0.7711	0.8781
No log	7.8596	448	0.7558	0.6512	0.7558	0.8694
No log	7.8947	450	0.8109	0.6765	0.8109	0.9005
No log	7.9298	452	0.8379	0.6567	0.8379	0.9154
No log	7.9649	454	0.8305	0.6299	0.8305	0.9113
No log	8.0	456	0.8487	0.6349	0.8487	0.9212
No log	8.0351	458	0.9465	0.6032	0.9465	0.9729
No log	8.0702	460	1.0031	0.6032	1.0031	1.0015
No log	8.1053	462	1.0231	0.5846	1.0231	1.0115
No log	8.1404	464	1.0139	0.5649	1.0139	1.0069
No log	8.1754	466	1.0159	0.5909	1.0159	1.0079
No log	8.2105	468	1.0784	0.5303	1.0784	1.0385
No log	8.2456	470	1.0436	0.5649	1.0436	1.0215
No log	8.2807	472	1.0398	0.5385	1.0398	1.0197
No log	8.3158	474	1.0219	0.5469	1.0219	1.0109
No log	8.3509	476	0.9998	0.5984	0.9998	0.9999
No log	8.3860	478	1.0663	0.5714	1.0663	1.0326
No log	8.4211	480	1.1816	0.5271	1.1816	1.0870
No log	8.4561	482	1.2273	0.5038	1.2273	1.1078
No log	8.4912	484	1.2360	0.5	1.2360	1.1117
No log	8.5263	486	1.2165	0.5	1.2165	1.1029
No log	8.5614	488	1.3053	0.5075	1.3053	1.1425
No log	8.5965	490	1.3816	0.4672	1.3816	1.1754
No log	8.6316	492	1.3927	0.4493	1.3927	1.1801
No log	8.6667	494	1.2062	0.5455	1.2062	1.0983
No log	8.7018	496	1.0947	0.5271	1.0947	1.0463
No log	8.7368	498	1.0399	0.5271	1.0399	1.0198
0.3683	8.7719	500	1.0863	0.5496	1.0863	1.0423
0.3683	8.8070	502	1.2379	0.5224	1.2379	1.1126
0.3683	8.8421	504	1.3092	0.5224	1.3092	1.1442
0.3683	8.8772	506	1.3085	0.5224	1.3085	1.1439
0.3683	8.9123	508	1.2956	0.5263	1.2956	1.1383
0.3683	8.9474	510	1.3189	0.5191	1.3189	1.1485

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1