ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k17_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4561
• Qwk: 0.0612
• Mse: 1.4561
• Rmse: 1.2067

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0230	2	4.7386	0.0010	4.7386	2.1768
No log	0.0460	4	2.8791	0.0088	2.8791	1.6968
No log	0.0690	6	2.3029	-0.0608	2.3029	1.5175
No log	0.0920	8	1.9818	-0.0501	1.9818	1.4078
No log	0.1149	10	1.6606	-0.1848	1.6606	1.2886
No log	0.1379	12	1.4298	-0.0085	1.4298	1.1957
No log	0.1609	14	1.3639	-0.0141	1.3639	1.1678
No log	0.1839	16	1.5374	-0.0535	1.5374	1.2399
No log	0.2069	18	1.5998	-0.1778	1.5998	1.2648
No log	0.2299	20	1.5496	-0.1939	1.5496	1.2448
No log	0.2529	22	1.4123	0.0918	1.4123	1.1884
No log	0.2759	24	1.3774	0.0180	1.3774	1.1736
No log	0.2989	26	1.3915	-0.0163	1.3915	1.1796
No log	0.3218	28	1.5664	-0.0757	1.5664	1.2516
No log	0.3448	30	1.5900	-0.0757	1.5900	1.2610
No log	0.3678	32	1.3824	0.0639	1.3824	1.1757
No log	0.3908	34	1.2981	0.0454	1.2981	1.1393
No log	0.4138	36	1.3125	0.0454	1.3125	1.1457
No log	0.4368	38	1.2534	0.0153	1.2534	1.1196
No log	0.4598	40	1.3304	0.0677	1.3304	1.1534
No log	0.4828	42	1.5847	-0.0216	1.5847	1.2588
No log	0.5057	44	1.6903	-0.0216	1.6903	1.3001
No log	0.5287	46	1.4118	0.0186	1.4118	1.1882
No log	0.5517	48	1.3585	0.0796	1.3585	1.1656
No log	0.5747	50	1.3279	0.1423	1.3279	1.1523
No log	0.5977	52	1.2744	0.1237	1.2744	1.1289
No log	0.6207	54	1.2613	0.1009	1.2613	1.1231
No log	0.6437	56	1.2500	0.0810	1.2500	1.1180
No log	0.6667	58	1.2443	0.1043	1.2443	1.1155
No log	0.6897	60	1.2938	0.1266	1.2938	1.1375
No log	0.7126	62	1.3152	0.1266	1.3152	1.1468
No log	0.7356	64	1.3168	0.1495	1.3168	1.1475
No log	0.7586	66	1.3994	0.1045	1.3994	1.1830
No log	0.7816	68	1.4938	0.1507	1.4938	1.2222
No log	0.8046	70	1.4166	0.0791	1.4166	1.1902
No log	0.8276	72	1.6003	0.1899	1.6003	1.2650
No log	0.8506	74	1.5682	0.2147	1.5682	1.2523
No log	0.8736	76	1.4794	0.0781	1.4794	1.2163
No log	0.8966	78	1.6731	0.1488	1.6731	1.2935
No log	0.9195	80	1.6355	0.1590	1.6355	1.2789
No log	0.9425	82	1.5234	0.1459	1.5234	1.2343
No log	0.9655	84	1.5890	0.0793	1.5890	1.2606
No log	0.9885	86	2.0385	0.0826	2.0385	1.4278
No log	1.0115	88	2.1450	0.1204	2.1450	1.4646
No log	1.0345	90	1.7760	0.0366	1.7760	1.3327
No log	1.0575	92	1.8617	0.1213	1.8617	1.3644
No log	1.0805	94	1.7898	0.0373	1.7898	1.3378
No log	1.1034	96	2.2586	0.0786	2.2586	1.5029
No log	1.1264	98	2.3380	0.0895	2.3380	1.5291
No log	1.1494	100	1.8711	0.0618	1.8711	1.3679
No log	1.1724	102	1.7550	0.0086	1.7550	1.3248
No log	1.1954	104	1.7473	-0.0297	1.7473	1.3219
No log	1.2184	106	2.1343	0.0640	2.1343	1.4609
No log	1.2414	108	2.2572	0.0624	2.2572	1.5024
No log	1.2644	110	1.9156	0.1033	1.9156	1.3841
No log	1.2874	112	1.7550	0.0143	1.7550	1.3248
No log	1.3103	114	1.8731	0.0173	1.8731	1.3686
No log	1.3333	116	1.6224	-0.0554	1.6224	1.2737
No log	1.3563	118	1.6175	0.0393	1.6175	1.2718
No log	1.3793	120	1.9098	0.0677	1.9098	1.3820
No log	1.4023	122	1.8864	0.0504	1.8864	1.3735
No log	1.4253	124	1.6324	0.0385	1.6324	1.2777
No log	1.4483	126	1.6027	-0.0732	1.6027	1.2660
No log	1.4713	128	1.6400	-0.0265	1.6400	1.2806
No log	1.4943	130	1.8314	0.0807	1.8314	1.3533
No log	1.5172	132	2.1527	0.1374	2.1527	1.4672
No log	1.5402	134	2.0754	0.0976	2.0754	1.4406
No log	1.5632	136	1.7177	0.0142	1.7177	1.3106
No log	1.5862	138	1.7132	-0.0714	1.7132	1.3089
No log	1.6092	140	1.6989	-0.0338	1.6989	1.3034
No log	1.6322	142	1.7790	0.1306	1.7790	1.3338
No log	1.6552	144	2.0224	0.0559	2.0224	1.4221
No log	1.6782	146	1.8962	0.0984	1.8962	1.3770
No log	1.7011	148	1.8146	0.1547	1.8146	1.3471
No log	1.7241	150	1.8936	0.0807	1.8936	1.3761
No log	1.7471	152	2.0841	0.1020	2.0841	1.4437
No log	1.7701	154	1.9072	0.0859	1.9072	1.3810
No log	1.7931	156	1.6054	-0.0018	1.6054	1.2670
No log	1.8161	158	1.5789	-0.0118	1.5789	1.2566
No log	1.8391	160	1.5437	-0.0585	1.5437	1.2425
No log	1.8621	162	1.7125	0.0260	1.7125	1.3086
No log	1.8851	164	2.0283	0.1140	2.0283	1.4242
No log	1.9080	166	1.9756	0.0388	1.9756	1.4056
No log	1.9310	168	1.7830	0.0392	1.7830	1.3353
No log	1.9540	170	1.6770	0.0157	1.6770	1.2950
No log	1.9770	172	1.7227	0.0091	1.7227	1.3125
No log	2.0	174	1.8446	0.0504	1.8446	1.3582
No log	2.0230	176	2.0699	0.0864	2.0699	1.4387
No log	2.0460	178	2.1224	0.0816	2.1224	1.4568
No log	2.0690	180	2.1037	0.0595	2.1037	1.4504
No log	2.0920	182	1.9484	-0.0008	1.9484	1.3958
No log	2.1149	184	1.7112	0.0315	1.7112	1.3081
No log	2.1379	186	1.6736	-0.0059	1.6736	1.2937
No log	2.1609	188	1.6631	0.1135	1.6631	1.2896
No log	2.1839	190	1.9442	0.0377	1.9442	1.3943
No log	2.2069	192	2.3165	0.0588	2.3165	1.5220
No log	2.2299	194	2.2487	0.0588	2.2487	1.4996
No log	2.2529	196	1.8829	0.0377	1.8829	1.3722
No log	2.2759	198	1.7791	0.0698	1.7791	1.3338
No log	2.2989	200	1.8900	0.0447	1.8900	1.3748
No log	2.3218	202	1.8674	0.0504	1.8674	1.3665
No log	2.3448	204	1.8658	0.0571	1.8658	1.3659
No log	2.3678	206	1.7003	0.0108	1.7003	1.3039
No log	2.3908	208	1.7236	0.0108	1.7236	1.3129
No log	2.4138	210	1.8649	0.0705	1.8649	1.3656
No log	2.4368	212	1.8868	0.0573	1.8868	1.3736
No log	2.4598	214	1.7025	0.0080	1.7025	1.3048
No log	2.4828	216	1.7399	-0.0121	1.7399	1.3191
No log	2.5057	218	1.8382	0.0393	1.8382	1.3558
No log	2.5287	220	2.0531	0.0273	2.0531	1.4329
No log	2.5517	222	1.9129	0.0754	1.9129	1.3831
No log	2.5747	224	1.6398	0.0018	1.6398	1.2805
No log	2.5977	226	1.5716	-0.0146	1.5716	1.2536
No log	2.6207	228	1.6821	0.0336	1.6821	1.2970
No log	2.6437	230	1.9210	0.1240	1.9210	1.3860
No log	2.6667	232	1.8576	0.1260	1.8576	1.3629
No log	2.6897	234	1.6585	0.0679	1.6585	1.2878
No log	2.7126	236	1.5924	0.0458	1.5924	1.2619
No log	2.7356	238	1.7438	0.1037	1.7438	1.3205
No log	2.7586	240	2.0959	0.0864	2.0959	1.4477
No log	2.7816	242	2.0794	0.0818	2.0794	1.4420
No log	2.8046	244	1.7754	0.1089	1.7754	1.3324
No log	2.8276	246	1.6927	0.0785	1.6927	1.3011
No log	2.8506	248	1.7535	0.0643	1.7535	1.3242
No log	2.8736	250	1.8685	0.1473	1.8685	1.3669
No log	2.8966	252	1.6966	0.0902	1.6966	1.3025
No log	2.9195	254	1.5573	0.0691	1.5573	1.2479
No log	2.9425	256	1.4871	0.0464	1.4871	1.2195
No log	2.9655	258	1.5470	0.0691	1.5470	1.2438
No log	2.9885	260	1.6952	0.0461	1.6952	1.3020
No log	3.0115	262	1.7053	0.0534	1.7053	1.3059
No log	3.0345	264	1.7337	0.0792	1.7337	1.3167
No log	3.0575	266	1.6908	0.0794	1.6908	1.3003
No log	3.0805	268	1.6655	0.0592	1.6655	1.2905
No log	3.1034	270	1.7201	0.0922	1.7201	1.3115
No log	3.1264	272	1.8489	0.0495	1.8489	1.3597
No log	3.1494	274	2.0201	0.1619	2.0201	1.4213
No log	3.1724	276	1.9658	0.1409	1.9658	1.4021
No log	3.1954	278	1.6546	0.0525	1.6546	1.2863
No log	3.2184	280	1.5313	0.0608	1.5313	1.2375
No log	3.2414	282	1.4830	0.0795	1.4830	1.2178
No log	3.2644	284	1.4926	0.1429	1.4926	1.2217
No log	3.2874	286	1.4620	0.0795	1.4620	1.2092
No log	3.3103	288	1.4811	0.0705	1.4811	1.2170
No log	3.3333	290	1.5276	0.0682	1.5276	1.2360
No log	3.3563	292	1.6269	0.0439	1.6269	1.2755
No log	3.3793	294	1.8069	0.1100	1.8069	1.3442
No log	3.4023	296	2.2030	0.0482	2.2030	1.4842
No log	3.4253	298	2.3547	0.0336	2.3547	1.5345
No log	3.4483	300	2.2157	0.0385	2.2157	1.4885
No log	3.4713	302	1.8938	0.1261	1.8938	1.3762
No log	3.4943	304	1.6092	0.1037	1.6092	1.2685
No log	3.5172	306	1.5127	0.0698	1.5127	1.2299
No log	3.5402	308	1.5408	0.1252	1.5408	1.2413
No log	3.5632	310	1.5684	0.1310	1.5684	1.2524
No log	3.5862	312	1.5308	0.1252	1.5308	1.2372
No log	3.6092	314	1.4490	-0.0174	1.4490	1.2037
No log	3.6322	316	1.4822	0.0152	1.4822	1.2175
No log	3.6552	318	1.6320	0.0927	1.6320	1.2775
No log	3.6782	320	1.9716	0.1448	1.9716	1.4041
No log	3.7011	322	2.0446	0.1201	2.0446	1.4299
No log	3.7241	324	1.8575	0.1191	1.8575	1.3629
No log	3.7471	326	1.5607	0.1252	1.5607	1.2493
No log	3.7701	328	1.4237	-0.0324	1.4237	1.1932
No log	3.7931	330	1.4269	-0.0324	1.4269	1.1945
No log	3.8161	332	1.4582	-0.0848	1.4582	1.2076
No log	3.8391	334	1.6365	0.1152	1.6365	1.2793
No log	3.8621	336	1.9493	0.1152	1.9493	1.3962
No log	3.8851	338	2.0086	0.0735	2.0086	1.4172
No log	3.9080	340	1.8222	0.1328	1.8222	1.3499
No log	3.9310	342	1.5623	0.1417	1.5623	1.2499
No log	3.9540	344	1.4596	-0.0465	1.4596	1.2081
No log	3.9770	346	1.4549	-0.0042	1.4549	1.2062
No log	4.0	348	1.5306	0.0784	1.5306	1.2372
No log	4.0230	350	1.6458	0.1599	1.6458	1.2829
No log	4.0460	352	1.7698	0.1543	1.7698	1.3303
No log	4.0690	354	1.8689	0.0828	1.8689	1.3671
No log	4.0920	356	1.8421	0.1282	1.8421	1.3572
No log	4.1149	358	1.7093	0.1358	1.7093	1.3074
No log	4.1379	360	1.6425	0.1387	1.6425	1.2816
No log	4.1609	362	1.6019	0.1334	1.6019	1.2656
No log	4.1839	364	1.7277	0.1233	1.7277	1.3144
No log	4.2069	366	1.7485	0.1186	1.7485	1.3223
No log	4.2299	368	1.7302	0.1386	1.7302	1.3154
No log	4.2529	370	1.5606	0.1404	1.5606	1.2492
No log	4.2759	372	1.4022	0.0700	1.4022	1.1842
No log	4.2989	374	1.3718	0.0107	1.3718	1.1713
No log	4.3218	376	1.3774	0.0107	1.3774	1.1736
No log	4.3448	378	1.3932	0.0400	1.3932	1.1803
No log	4.3678	380	1.3942	0.0771	1.3942	1.1808
No log	4.3908	382	1.4475	0.1020	1.4475	1.2031
No log	4.4138	384	1.5678	0.0818	1.5678	1.2521
No log	4.4368	386	1.7641	0.0681	1.7641	1.3282
No log	4.4598	388	1.8701	0.1237	1.8701	1.3675
No log	4.4828	390	1.8673	0.1059	1.8673	1.3665
No log	4.5057	392	1.8469	0.1627	1.8469	1.3590
No log	4.5287	394	1.8695	0.1216	1.8695	1.3673
No log	4.5517	396	1.9119	0.0805	1.9119	1.3827
No log	4.5747	398	1.9267	0.0111	1.9267	1.3881
No log	4.5977	400	1.7929	0.1483	1.7929	1.3390
No log	4.6207	402	1.6965	0.1336	1.6965	1.3025
No log	4.6437	404	1.5875	0.0724	1.5875	1.2599
No log	4.6667	406	1.4863	0.1067	1.4863	1.2191
No log	4.6897	408	1.4712	0.0333	1.4712	1.2129
No log	4.7126	410	1.5359	0.1254	1.5359	1.2393
No log	4.7356	412	1.6907	0.1639	1.6907	1.3003
No log	4.7586	414	1.8176	0.1513	1.8176	1.3482
No log	4.7816	416	1.8124	0.1513	1.8124	1.3463
No log	4.8046	418	1.7359	0.1470	1.7359	1.3176
No log	4.8276	420	1.7403	0.1470	1.7403	1.3192
No log	4.8506	422	1.7811	0.1191	1.7811	1.3346
No log	4.8736	424	1.7050	0.1332	1.7050	1.3058
No log	4.8966	426	1.6224	0.1336	1.6224	1.2737
No log	4.9195	428	1.5730	0.1146	1.5730	1.2542
No log	4.9425	430	1.5715	0.0987	1.5715	1.2536
No log	4.9655	432	1.7347	0.0938	1.7347	1.3171
No log	4.9885	434	1.9453	0.0618	1.9453	1.3947
No log	5.0115	436	2.0895	0.0918	2.0895	1.4455
No log	5.0345	438	2.0510	0.1093	2.0510	1.4321
No log	5.0575	440	1.7786	0.1349	1.7786	1.3336
No log	5.0805	442	1.5474	0.1174	1.5474	1.2439
No log	5.1034	444	1.4741	0.0714	1.4741	1.2141
No log	5.1264	446	1.4592	-0.0274	1.4592	1.2080
No log	5.1494	448	1.4418	-0.0274	1.4418	1.2008
No log	5.1724	450	1.4568	-0.0092	1.4568	1.2070
No log	5.1954	452	1.5573	0.0020	1.5573	1.2479
No log	5.2184	454	1.7412	0.1639	1.7412	1.3196
No log	5.2414	456	1.8062	0.0992	1.8062	1.3440
No log	5.2644	458	1.7086	0.1336	1.7086	1.3071
No log	5.2874	460	1.5514	-0.0161	1.5514	1.2455
No log	5.3103	462	1.4593	-0.0364	1.4593	1.2080
No log	5.3333	464	1.4558	-0.0197	1.4558	1.2065
No log	5.3563	466	1.4909	-0.0020	1.4909	1.2210
No log	5.3793	468	1.5959	0.0693	1.5959	1.2633
No log	5.4023	470	1.6351	0.0952	1.6351	1.2787
No log	5.4253	472	1.6118	0.0834	1.6118	1.2696
No log	5.4483	474	1.5366	-0.0132	1.5366	1.2396
No log	5.4713	476	1.4377	0.0334	1.4377	1.1990
No log	5.4943	478	1.3713	0.0302	1.3713	1.1710
No log	5.5172	480	1.3782	0.0302	1.3782	1.1740
No log	5.5402	482	1.4437	0.0675	1.4437	1.2015
No log	5.5632	484	1.5702	0.0339	1.5702	1.2531
No log	5.5862	486	1.6790	0.0952	1.6790	1.2958
No log	5.6092	488	1.6812	0.0952	1.6812	1.2966
No log	5.6322	490	1.6168	0.0732	1.6168	1.2715
No log	5.6552	492	1.5178	0.1282	1.5178	1.2320
No log	5.6782	494	1.4474	0.0246	1.4474	1.2031
No log	5.7011	496	1.4814	0.0692	1.4814	1.2171
No log	5.7241	498	1.5241	0.0692	1.5241	1.2346
0.3947	5.7471	500	1.6509	0.0987	1.6509	1.2849
0.3947	5.7701	502	1.8488	0.1123	1.8488	1.3597
0.3947	5.7931	504	1.8080	0.0891	1.8080	1.3446
0.3947	5.8161	506	1.5834	0.0878	1.5834	1.2583
0.3947	5.8391	508	1.4604	0.0334	1.4604	1.2085
0.3947	5.8621	510	1.4473	0.0246	1.4473	1.2030
0.3947	5.8851	512	1.4561	0.0612	1.4561	1.2067

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1