ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k18_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8829
• Qwk: 0.2887
• Mse: 0.8829
• Rmse: 0.9396

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0222	2	3.8175	-0.0387	3.8175	1.9538
No log	0.0444	4	2.1813	0.0054	2.1813	1.4769
No log	0.0667	6	1.8925	-0.0623	1.8925	1.3757
No log	0.0889	8	1.3147	0.0731	1.3147	1.1466
No log	0.1111	10	1.0633	0.2088	1.0633	1.0311
No log	0.1333	12	1.0369	0.1573	1.0369	1.0183
No log	0.1556	14	1.1284	0.1740	1.1284	1.0623
No log	0.1778	16	1.5292	0.0281	1.5292	1.2366
No log	0.2	18	1.2230	0.1361	1.2230	1.1059
No log	0.2222	20	1.1076	0.1685	1.1076	1.0524
No log	0.2444	22	1.0712	0.2958	1.0712	1.0350
No log	0.2667	24	1.0387	0.3207	1.0387	1.0192
No log	0.2889	26	1.0467	0.3082	1.0467	1.0231
No log	0.3111	28	1.0864	0.2100	1.0864	1.0423
No log	0.3333	30	1.0856	0.2489	1.0856	1.0419
No log	0.3556	32	1.1133	0.1858	1.1133	1.0551
No log	0.3778	34	1.1259	0.1858	1.1259	1.0611
No log	0.4	36	1.2021	0.1352	1.2021	1.0964
No log	0.4222	38	1.1204	0.2100	1.1204	1.0585
No log	0.4444	40	1.1199	0.2489	1.1199	1.0582
No log	0.4667	42	1.0488	0.2981	1.0488	1.0241
No log	0.4889	44	1.0535	0.2318	1.0535	1.0264
No log	0.5111	46	1.1765	0.0790	1.1765	1.0847
No log	0.5333	48	1.1233	0.0790	1.1233	1.0599
No log	0.5556	50	1.0100	0.2466	1.0100	1.0050
No log	0.5778	52	0.9733	0.1613	0.9733	0.9866
No log	0.6	54	1.0028	0.1944	1.0028	1.0014
No log	0.6222	56	1.1252	0.1591	1.1252	1.0608
No log	0.6444	58	1.0463	0.2711	1.0463	1.0229
No log	0.6667	60	0.9803	0.2316	0.9803	0.9901
No log	0.6889	62	0.9736	0.2441	0.9736	0.9867
No log	0.7111	64	0.9916	0.2811	0.9916	0.9958
No log	0.7333	66	1.0368	0.2367	1.0368	1.0182
No log	0.7556	68	0.9805	0.3251	0.9805	0.9902
No log	0.7778	70	0.9639	0.2967	0.9639	0.9818
No log	0.8	72	1.0363	0.2517	1.0363	1.0180
No log	0.8222	74	1.1663	0.1971	1.1663	1.0800
No log	0.8444	76	1.1420	0.1971	1.1420	1.0687
No log	0.8667	78	1.0520	0.2564	1.0520	1.0257
No log	0.8889	80	0.9999	0.2145	0.9999	1.0000
No log	0.9111	82	0.9261	0.2740	0.9261	0.9624
No log	0.9333	84	0.8855	0.3048	0.8855	0.9410
No log	0.9556	86	0.8740	0.3780	0.8740	0.9349
No log	0.9778	88	0.8565	0.3506	0.8565	0.9255
No log	1.0	90	0.8578	0.3963	0.8578	0.9262
No log	1.0222	92	0.8818	0.2746	0.8818	0.9390
No log	1.0444	94	0.9760	0.2697	0.9760	0.9879
No log	1.0667	96	1.0099	0.2140	1.0099	1.0049
No log	1.0889	98	1.3008	0.2023	1.3008	1.1405
No log	1.1111	100	1.6008	0.0295	1.6008	1.2652
No log	1.1333	102	1.4634	0.0135	1.4634	1.2097
No log	1.1556	104	1.0879	0.3243	1.0879	1.0430
No log	1.1778	106	0.9611	0.2517	0.9611	0.9803
No log	1.2	108	0.9316	0.2517	0.9316	0.9652
No log	1.2222	110	0.9779	0.3503	0.9779	0.9889
No log	1.2444	112	1.1130	0.1986	1.1130	1.0550
No log	1.2667	114	1.0636	0.2263	1.0636	1.0313
No log	1.2889	116	0.9835	0.3112	0.9835	0.9917
No log	1.3111	118	0.9737	0.2765	0.9737	0.9868
No log	1.3333	120	0.9337	0.3454	0.9337	0.9663
No log	1.3556	122	1.0348	0.3374	1.0348	1.0172
No log	1.3778	124	0.9323	0.3511	0.9323	0.9656
No log	1.4	126	0.8572	0.4398	0.8572	0.9258
No log	1.4222	128	0.8952	0.4416	0.8952	0.9462
No log	1.4444	130	0.9058	0.3998	0.9058	0.9517
No log	1.4667	132	0.9607	0.3202	0.9607	0.9802
No log	1.4889	134	1.1825	0.3021	1.1825	1.0874
No log	1.5111	136	1.1111	0.3584	1.1111	1.0541
No log	1.5333	138	1.0539	0.2147	1.0539	1.0266
No log	1.5556	140	1.1536	0.2478	1.1535	1.0740
No log	1.5778	142	1.0654	0.2424	1.0654	1.0322
No log	1.6	144	1.0689	0.2102	1.0689	1.0339
No log	1.6222	146	1.0759	0.1775	1.0759	1.0373
No log	1.6444	148	0.9776	0.3033	0.9776	0.9887
No log	1.6667	150	0.9750	0.2667	0.9750	0.9874
No log	1.6889	152	0.9835	0.3129	0.9835	0.9917
No log	1.7111	154	0.9753	0.2842	0.9753	0.9876
No log	1.7333	156	0.9906	0.3175	0.9906	0.9953
No log	1.7556	158	0.9650	0.3314	0.9650	0.9823
No log	1.7778	160	0.9754	0.3779	0.9754	0.9876
No log	1.8	162	0.9900	0.3706	0.9900	0.9950
No log	1.8222	164	1.3007	0.2674	1.3007	1.1405
No log	1.8444	166	1.4796	0.2314	1.4796	1.2164
No log	1.8667	168	1.2389	0.3111	1.2389	1.1131
No log	1.8889	170	1.0397	0.3285	1.0397	1.0197
No log	1.9111	172	1.0662	0.2716	1.0662	1.0326
No log	1.9333	174	1.1370	0.2385	1.1370	1.0663
No log	1.9556	176	1.0822	0.2456	1.0822	1.0403
No log	1.9778	178	1.1248	0.2142	1.1248	1.0606
No log	2.0	180	1.1906	0.1343	1.1906	1.0911
No log	2.0222	182	1.1329	0.1658	1.1329	1.0644
No log	2.0444	184	1.0487	0.2696	1.0487	1.0241
No log	2.0667	186	1.0709	0.2879	1.0709	1.0349
No log	2.0889	188	1.1482	0.1732	1.1482	1.0715
No log	2.1111	190	1.0873	0.2761	1.0873	1.0427
No log	2.1333	192	0.9970	0.3129	0.9970	0.9985
No log	2.1556	194	1.1099	0.2215	1.1099	1.0535
No log	2.1778	196	1.1919	0.2227	1.1919	1.0917
No log	2.2	198	1.1091	0.2331	1.1091	1.0531
No log	2.2222	200	0.9935	0.1849	0.9935	0.9967
No log	2.2444	202	0.9676	0.3139	0.9676	0.9837
No log	2.2667	204	1.0011	0.2764	1.0011	1.0005
No log	2.2889	206	0.9920	0.3139	0.9920	0.9960
No log	2.3111	208	0.9912	0.2214	0.9912	0.9956
No log	2.3333	210	0.9845	0.1629	0.9845	0.9922
No log	2.3556	212	0.9498	0.2818	0.9498	0.9746
No log	2.3778	214	0.9396	0.3693	0.9396	0.9693
No log	2.4	216	0.9074	0.3548	0.9074	0.9526
No log	2.4222	218	0.9122	0.3687	0.9122	0.9551
No log	2.4444	220	1.0407	0.2906	1.0407	1.0201
No log	2.4667	222	1.0104	0.2906	1.0104	1.0052
No log	2.4889	224	0.8649	0.3682	0.8649	0.9300
No log	2.5111	226	0.8629	0.3753	0.8629	0.9289
No log	2.5333	228	0.9002	0.4057	0.9002	0.9488
No log	2.5556	230	0.8231	0.4035	0.8231	0.9072
No log	2.5778	232	0.8677	0.3663	0.8677	0.9315
No log	2.6	234	0.9349	0.3257	0.9349	0.9669
No log	2.6222	236	0.8975	0.3129	0.8975	0.9474
No log	2.6444	238	0.9484	0.3080	0.9484	0.9738
No log	2.6667	240	0.9683	0.3080	0.9683	0.9840
No log	2.6889	242	0.9411	0.3151	0.9411	0.9701
No log	2.7111	244	1.0825	0.3039	1.0825	1.0404
No log	2.7333	246	1.1091	0.3039	1.1091	1.0531
No log	2.7556	248	0.9854	0.3236	0.9854	0.9927
No log	2.7778	250	0.8770	0.3306	0.8770	0.9365
No log	2.8	252	0.8800	0.4259	0.8800	0.9381
No log	2.8222	254	0.8888	0.3757	0.8888	0.9428
No log	2.8444	256	0.8807	0.3859	0.8807	0.9384
No log	2.8667	258	0.9046	0.3840	0.9046	0.9511
No log	2.8889	260	0.9460	0.3243	0.9460	0.9726
No log	2.9111	262	0.9715	0.3103	0.9715	0.9856
No log	2.9333	264	0.9647	0.3124	0.9647	0.9822
No log	2.9556	266	0.9517	0.3124	0.9517	0.9755
No log	2.9778	268	0.9406	0.2456	0.9406	0.9699
No log	3.0	270	0.9420	0.3310	0.9420	0.9705
No log	3.0222	272	0.9374	0.3457	0.9374	0.9682
No log	3.0444	274	0.9290	0.2597	0.9290	0.9639
No log	3.0667	276	0.9640	0.2456	0.9640	0.9818
No log	3.0889	278	1.0241	0.2416	1.0241	1.0120
No log	3.1111	280	1.0206	0.1970	1.0206	1.0102
No log	3.1333	282	0.9586	0.2251	0.9586	0.9791
No log	3.1556	284	0.9614	0.2416	0.9614	0.9805
No log	3.1778	286	0.9634	0.2179	0.9634	0.9815
No log	3.2	288	0.9731	0.2523	0.9731	0.9864
No log	3.2222	290	0.9947	0.2408	0.9947	0.9973
No log	3.2444	292	0.9226	0.3536	0.9226	0.9605
No log	3.2667	294	0.8845	0.3151	0.8845	0.9405
No log	3.2889	296	0.8825	0.3658	0.8825	0.9394
No log	3.3111	298	0.9012	0.3658	0.9012	0.9493
No log	3.3333	300	0.8665	0.3556	0.8665	0.9308
No log	3.3556	302	0.8473	0.3836	0.8473	0.9205
No log	3.3778	304	0.8660	0.4148	0.8660	0.9306
No log	3.4	306	0.8427	0.3713	0.8427	0.9180
No log	3.4222	308	0.8650	0.3556	0.8650	0.9301
No log	3.4444	310	0.8839	0.4075	0.8839	0.9402
No log	3.4667	312	0.8394	0.3859	0.8394	0.9162
No log	3.4889	314	0.8682	0.4976	0.8682	0.9318
No log	3.5111	316	0.8803	0.4984	0.8803	0.9382
No log	3.5333	318	0.8749	0.5089	0.8749	0.9353
No log	3.5556	320	0.8811	0.4853	0.8811	0.9387
No log	3.5778	322	0.8589	0.5089	0.8589	0.9268
No log	3.6	324	0.8471	0.3704	0.8471	0.9204
No log	3.6222	326	0.8517	0.4489	0.8517	0.9229
No log	3.6444	328	0.8777	0.4656	0.8777	0.9369
No log	3.6667	330	0.8371	0.4853	0.8371	0.9149
No log	3.6889	332	0.8189	0.4706	0.8189	0.9049
No log	3.7111	334	0.8380	0.4738	0.8380	0.9154
No log	3.7333	336	1.0008	0.4026	1.0008	1.0004
No log	3.7556	338	1.0953	0.3400	1.0953	1.0466
No log	3.7778	340	0.9800	0.3720	0.9800	0.9899
No log	3.8	342	0.8973	0.3872	0.8973	0.9473
No log	3.8222	344	0.8658	0.3011	0.8658	0.9305
No log	3.8444	346	0.9028	0.2744	0.9028	0.9501
No log	3.8667	348	0.8837	0.2301	0.8837	0.9400
No log	3.8889	350	0.8820	0.4321	0.8820	0.9391
No log	3.9111	352	0.9482	0.4024	0.9482	0.9737
No log	3.9333	354	0.9854	0.4024	0.9854	0.9927
No log	3.9556	356	0.8929	0.4135	0.8929	0.9449
No log	3.9778	358	0.8672	0.3465	0.8672	0.9312
No log	4.0	360	1.0618	0.3810	1.0618	1.0305
No log	4.0222	362	1.2030	0.3152	1.2030	1.0968
No log	4.0444	364	1.1007	0.3663	1.1007	1.0491
No log	4.0667	366	0.8886	0.4174	0.8886	0.9427
No log	4.0889	368	0.8615	0.3793	0.8615	0.9282
No log	4.1111	370	0.9014	0.3641	0.9014	0.9494
No log	4.1333	372	0.8676	0.4109	0.8676	0.9315
No log	4.1556	374	0.8296	0.3564	0.8296	0.9108
No log	4.1778	376	0.8384	0.4321	0.8384	0.9156
No log	4.2	378	0.8581	0.4151	0.8581	0.9264
No log	4.2222	380	0.8685	0.3117	0.8685	0.9319
No log	4.2444	382	0.9113	0.3101	0.9113	0.9546
No log	4.2667	384	0.9284	0.3101	0.9284	0.9635
No log	4.2889	386	0.9043	0.3428	0.9043	0.9510
No log	4.3111	388	0.9236	0.3129	0.9236	0.9610
No log	4.3333	390	1.0195	0.3810	1.0195	1.0097
No log	4.3556	392	1.0323	0.3829	1.0323	1.0160
No log	4.3778	394	0.9432	0.3629	0.9432	0.9712
No log	4.4	396	0.8868	0.3797	0.8868	0.9417
No log	4.4222	398	0.8924	0.2984	0.8924	0.9446
No log	4.4444	400	0.8871	0.3797	0.8871	0.9419
No log	4.4667	402	0.9001	0.4065	0.9001	0.9487
No log	4.4889	404	0.9152	0.2974	0.9152	0.9567
No log	4.5111	406	0.9359	0.3087	0.9359	0.9674
No log	4.5333	408	0.9270	0.3622	0.9270	0.9628
No log	4.5556	410	0.9261	0.2813	0.9261	0.9624
No log	4.5778	412	0.9106	0.3525	0.9106	0.9542
No log	4.6	414	0.8951	0.3496	0.8951	0.9461
No log	4.6222	416	0.8797	0.3078	0.8797	0.9379
No log	4.6444	418	0.8831	0.3793	0.8831	0.9397
No log	4.6667	420	0.8499	0.4180	0.8499	0.9219
No log	4.6889	422	0.8448	0.4180	0.8448	0.9191
No log	4.7111	424	0.8300	0.4180	0.8300	0.9110
No log	4.7333	426	0.8304	0.4180	0.8304	0.9113
No log	4.7556	428	0.8592	0.4198	0.8592	0.9269
No log	4.7778	430	0.9067	0.3428	0.9067	0.9522
No log	4.8	432	0.9466	0.3361	0.9466	0.9729
No log	4.8222	434	0.9393	0.4363	0.9393	0.9692
No log	4.8444	436	0.9433	0.3854	0.9433	0.9712
No log	4.8667	438	0.9653	0.2695	0.9653	0.9825
No log	4.8889	440	0.9986	0.2763	0.9986	0.9993
No log	4.9111	442	1.0321	0.3495	1.0321	1.0159
No log	4.9333	444	1.1120	0.2755	1.1120	1.0545
No log	4.9556	446	1.0784	0.2049	1.0784	1.0384
No log	4.9778	448	1.0274	0.2370	1.0274	1.0136
No log	5.0	450	1.0266	0.2624	1.0266	1.0132
No log	5.0222	452	1.0605	0.3341	1.0605	1.0298
No log	5.0444	454	1.0077	0.3483	1.0077	1.0039
No log	5.0667	456	0.9745	0.2807	0.9745	0.9872
No log	5.0889	458	1.0627	0.2711	1.0627	1.0309
No log	5.1111	460	1.0370	0.3086	1.0370	1.0183
No log	5.1333	462	0.9326	0.3656	0.9326	0.9657
No log	5.1556	464	0.9199	0.3285	0.9199	0.9591
No log	5.1778	466	1.0026	0.3021	1.0026	1.0013
No log	5.2	468	0.9957	0.3021	0.9957	0.9978
No log	5.2222	470	0.9154	0.2432	0.9154	0.9568
No log	5.2444	472	0.8710	0.3569	0.8710	0.9333
No log	5.2667	474	0.8558	0.4303	0.8558	0.9251
No log	5.2889	476	0.8190	0.4381	0.8190	0.9050
No log	5.3111	478	0.7926	0.4381	0.7926	0.8903
No log	5.3333	480	0.7631	0.4626	0.7631	0.8735
No log	5.3556	482	0.7439	0.4626	0.7439	0.8625
No log	5.3778	484	0.7316	0.4810	0.7316	0.8553
No log	5.4	486	0.7321	0.4588	0.7321	0.8556
No log	5.4222	488	0.7208	0.4778	0.7208	0.8490
No log	5.4444	490	0.7503	0.4958	0.7503	0.8662
No log	5.4667	492	0.7938	0.4932	0.7938	0.8910
No log	5.4889	494	0.7644	0.5416	0.7644	0.8743
No log	5.5111	496	0.7220	0.5871	0.7220	0.8497
No log	5.5333	498	0.7942	0.4545	0.7942	0.8912
0.3702	5.5556	500	0.8146	0.4087	0.8146	0.9026
0.3702	5.5778	502	0.7557	0.4498	0.7557	0.8693
0.3702	5.6	504	0.7508	0.5810	0.7508	0.8665
0.3702	5.6222	506	0.8726	0.5014	0.8726	0.9342
0.3702	5.6444	508	0.8873	0.4789	0.8873	0.9419
0.3702	5.6667	510	0.8388	0.4361	0.8388	0.9158
0.3702	5.6889	512	0.8262	0.4216	0.8262	0.9089
0.3702	5.7111	514	0.7859	0.5025	0.7859	0.8865
0.3702	5.7333	516	0.7571	0.5614	0.7571	0.8701
0.3702	5.7556	518	0.7512	0.5614	0.7512	0.8667
0.3702	5.7778	520	0.7749	0.5331	0.7749	0.8803
0.3702	5.8	522	0.8071	0.4466	0.8071	0.8984
0.3702	5.8222	524	0.8017	0.4198	0.8017	0.8954
0.3702	5.8444	526	0.7815	0.3323	0.7815	0.8840
0.3702	5.8667	528	0.7910	0.3733	0.7910	0.8894
0.3702	5.8889	530	0.8088	0.4724	0.8088	0.8993
0.3702	5.9111	532	0.7930	0.4590	0.7930	0.8905
0.3702	5.9333	534	0.7810	0.4398	0.7810	0.8837
0.3702	5.9556	536	0.7749	0.4251	0.7749	0.8803
0.3702	5.9778	538	0.7759	0.4216	0.7759	0.8808
0.3702	6.0	540	0.8001	0.4712	0.8001	0.8945
0.3702	6.0222	542	0.8043	0.5157	0.8043	0.8968
0.3702	6.0444	544	0.7637	0.4847	0.7637	0.8739
0.3702	6.0667	546	0.7658	0.4461	0.7658	0.8751
0.3702	6.0889	548	0.8131	0.4039	0.8131	0.9017
0.3702	6.1111	550	0.8218	0.4555	0.8218	0.9065
0.3702	6.1333	552	0.7665	0.4444	0.7665	0.8755
0.3702	6.1556	554	0.7368	0.5363	0.7368	0.8584
0.3702	6.1778	556	0.7287	0.5127	0.7287	0.8536
0.3702	6.2	558	0.7417	0.4960	0.7417	0.8612
0.3702	6.2222	560	0.7800	0.4639	0.7800	0.8832
0.3702	6.2444	562	0.7386	0.5446	0.7386	0.8594
0.3702	6.2667	564	0.7417	0.5040	0.7417	0.8612
0.3702	6.2889	566	0.8131	0.3940	0.8131	0.9017
0.3702	6.3111	568	0.8683	0.3161	0.8683	0.9318
0.3702	6.3333	570	0.8630	0.2887	0.8630	0.9290
0.3702	6.3556	572	0.8458	0.3194	0.8458	0.9197
0.3702	6.3778	574	0.8666	0.4489	0.8666	0.9309
0.3702	6.4	576	0.8885	0.4396	0.8885	0.9426
0.3702	6.4222	578	0.9031	0.4039	0.9031	0.9503
0.3702	6.4444	580	0.8624	0.4087	0.8624	0.9287
0.3702	6.4667	582	0.8507	0.3760	0.8507	0.9223
0.3702	6.4889	584	0.8798	0.3551	0.8798	0.9380
0.3702	6.5111	586	0.8829	0.2887	0.8829	0.9396

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1