ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k13_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0419
• Qwk: 0.3287
• Mse: 1.0419
• Rmse: 1.0208

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0312	2	4.7954	0.0010	4.7954	2.1898
No log	0.0625	4	2.7076	-0.0474	2.7076	1.6455
No log	0.0938	6	2.1467	-0.0575	2.1467	1.4652
No log	0.125	8	1.6383	0.0363	1.6383	1.2800
No log	0.1562	10	1.3236	0.1144	1.3236	1.1505
No log	0.1875	12	1.5660	-0.0753	1.5660	1.2514
No log	0.2188	14	1.5903	-0.1031	1.5903	1.2611
No log	0.25	16	1.9430	0.0381	1.9430	1.3939
No log	0.2812	18	1.8423	0.0851	1.8423	1.3573
No log	0.3125	20	1.4560	0.1199	1.4560	1.2066
No log	0.3438	22	1.5732	0.0876	1.5732	1.2543
No log	0.375	24	1.4203	0.1549	1.4203	1.1918
No log	0.4062	26	1.4462	0.1460	1.4462	1.2026
No log	0.4375	28	1.4679	0.1756	1.4679	1.2116
No log	0.4688	30	1.5300	0.1707	1.5300	1.2369
No log	0.5	32	1.3466	0.1379	1.3466	1.1604
No log	0.5312	34	1.1866	0.1785	1.1866	1.0893
No log	0.5625	36	1.3628	0.2099	1.3628	1.1674
No log	0.5938	38	1.9370	0.2023	1.9370	1.3918
No log	0.625	40	1.8243	0.2727	1.8243	1.3507
No log	0.6562	42	1.3274	0.1686	1.3274	1.1521
No log	0.6875	44	1.1578	0.2234	1.1578	1.0760
No log	0.7188	46	1.1722	0.1943	1.1722	1.0827
No log	0.75	48	1.3239	0.1679	1.3239	1.1506
No log	0.7812	50	1.3341	0.1772	1.3341	1.1550
No log	0.8125	52	1.3835	0.1972	1.3835	1.1762
No log	0.8438	54	1.3376	0.1636	1.3376	1.1565
No log	0.875	56	1.2385	0.2624	1.2385	1.1129
No log	0.9062	58	1.2108	0.3266	1.2108	1.1004
No log	0.9375	60	1.2113	0.2750	1.2113	1.1006
No log	0.9688	62	1.3259	0.2581	1.3259	1.1515
No log	1.0	64	1.4547	0.2447	1.4547	1.2061
No log	1.0312	66	1.4008	0.3458	1.4008	1.1835
No log	1.0625	68	1.2355	0.2920	1.2355	1.1115
No log	1.0938	70	1.1230	0.3953	1.1230	1.0597
No log	1.125	72	1.1228	0.3712	1.1228	1.0596
No log	1.1562	74	1.0780	0.3885	1.0780	1.0383
No log	1.1875	76	1.1487	0.2593	1.1487	1.0718
No log	1.2188	78	1.2713	0.1426	1.2713	1.1275
No log	1.25	80	1.3551	0.1599	1.3551	1.1641
No log	1.2812	82	1.3185	0.1547	1.3185	1.1483
No log	1.3125	84	1.3470	0.1547	1.3470	1.1606
No log	1.3438	86	1.5261	0.1600	1.5261	1.2353
No log	1.375	88	1.5293	0.1600	1.5293	1.2367
No log	1.4062	90	1.2634	0.1671	1.2634	1.1240
No log	1.4375	92	1.2043	0.2403	1.2043	1.0974
No log	1.4688	94	1.2005	0.1766	1.2005	1.0957
No log	1.5	96	1.1926	0.1972	1.1926	1.0921
No log	1.5312	98	1.0932	0.2936	1.0932	1.0456
No log	1.5625	100	1.0981	0.2915	1.0981	1.0479
No log	1.5938	102	1.0830	0.3478	1.0830	1.0407
No log	1.625	104	1.0457	0.3421	1.0457	1.0226
No log	1.6562	106	1.0370	0.2939	1.0370	1.0183
No log	1.6875	108	1.0879	0.2824	1.0879	1.0430
No log	1.7188	110	1.0863	0.3276	1.0863	1.0423
No log	1.75	112	1.1424	0.2803	1.1424	1.0688
No log	1.7812	114	1.1335	0.2634	1.1335	1.0647
No log	1.8125	116	1.1872	0.3768	1.1872	1.0896
No log	1.8438	118	1.4530	0.2948	1.4530	1.2054
No log	1.875	120	1.6564	0.3562	1.6564	1.2870
No log	1.9062	122	1.3317	0.3612	1.3317	1.1540
No log	1.9375	124	1.1567	0.3243	1.1567	1.0755
No log	1.9688	126	1.1088	0.3169	1.1088	1.0530
No log	2.0	128	1.0845	0.3104	1.0845	1.0414
No log	2.0312	130	1.2048	0.2191	1.2048	1.0976
No log	2.0625	132	1.4312	0.3521	1.4312	1.1963
No log	2.0938	134	1.3030	0.2906	1.3030	1.1415
No log	2.125	136	1.1292	0.1852	1.1292	1.0626
No log	2.1562	138	1.1399	0.2478	1.1399	1.0676
No log	2.1875	140	1.1718	0.2363	1.1718	1.0825
No log	2.2188	142	1.0997	0.2742	1.0997	1.0487
No log	2.25	144	1.0248	0.3629	1.0248	1.0123
No log	2.2812	146	0.9707	0.4933	0.9707	0.9852
No log	2.3125	148	0.9123	0.5492	0.9123	0.9552
No log	2.3438	150	0.8910	0.5791	0.8910	0.9439
No log	2.375	152	0.9227	0.5059	0.9227	0.9606
No log	2.4062	154	0.9242	0.5315	0.9242	0.9614
No log	2.4375	156	0.9574	0.5012	0.9574	0.9785
No log	2.4688	158	0.9653	0.5321	0.9653	0.9825
No log	2.5	160	1.3471	0.3726	1.3471	1.1606
No log	2.5312	162	1.6017	0.3097	1.6017	1.2656
No log	2.5625	164	1.2664	0.3201	1.2664	1.1253
No log	2.5938	166	1.0599	0.3682	1.0599	1.0295
No log	2.625	168	1.0945	0.3354	1.0945	1.0462
No log	2.6562	170	1.0397	0.3142	1.0397	1.0197
No log	2.6875	172	0.9828	0.3788	0.9828	0.9914
No log	2.7188	174	1.0330	0.3734	1.0330	1.0163
No log	2.75	176	1.0045	0.5014	1.0045	1.0022
No log	2.7812	178	0.9530	0.4415	0.9530	0.9762
No log	2.8125	180	0.9729	0.3952	0.9729	0.9864
No log	2.8438	182	0.9992	0.3557	0.9992	0.9996
No log	2.875	184	0.9732	0.4449	0.9732	0.9865
No log	2.9062	186	0.9923	0.4449	0.9923	0.9962
No log	2.9375	188	0.9655	0.5607	0.9655	0.9826
No log	2.9688	190	1.0000	0.3772	1.0000	1.0000
No log	3.0	192	1.0264	0.3286	1.0264	1.0131
No log	3.0312	194	1.0819	0.3213	1.0819	1.0401
No log	3.0625	196	1.3505	0.2572	1.3505	1.1621
No log	3.0938	198	1.4916	0.3109	1.4916	1.2213
No log	3.125	200	1.3429	0.3002	1.3429	1.1588
No log	3.1562	202	1.0903	0.3213	1.0903	1.0442
No log	3.1875	204	1.0065	0.3965	1.0065	1.0033
No log	3.2188	206	0.9899	0.4591	0.9899	0.9949
No log	3.25	208	0.9989	0.3913	0.9989	0.9994
No log	3.2812	210	1.0928	0.3029	1.0928	1.0454
No log	3.3125	212	1.1162	0.2943	1.1162	1.0565
No log	3.3438	214	1.0464	0.3595	1.0464	1.0229
No log	3.375	216	1.0019	0.4801	1.0019	1.0009
No log	3.4062	218	1.0598	0.4216	1.0598	1.0294
No log	3.4375	220	1.0592	0.4125	1.0592	1.0292
No log	3.4688	222	1.0912	0.4362	1.0912	1.0446
No log	3.5	224	1.5755	0.3216	1.5755	1.2552
No log	3.5312	226	2.2394	0.1957	2.2394	1.4965
No log	3.5625	228	2.2230	0.1957	2.2230	1.4910
No log	3.5938	230	1.7703	0.2308	1.7703	1.3305
No log	3.625	232	1.3193	0.2650	1.3193	1.1486
No log	3.6562	234	1.1307	0.3556	1.1307	1.0633
No log	3.6875	236	1.0990	0.3280	1.0990	1.0483
No log	3.7188	238	1.0879	0.2560	1.0879	1.0430
No log	3.75	240	1.0743	0.2870	1.0743	1.0365
No log	3.7812	242	1.0540	0.3584	1.0540	1.0267
No log	3.8125	244	1.1190	0.3967	1.1190	1.0578
No log	3.8438	246	1.1519	0.4265	1.1519	1.0733
No log	3.875	248	1.1388	0.4599	1.1388	1.0671
No log	3.9062	250	1.0890	0.5294	1.0890	1.0436
No log	3.9375	252	1.0232	0.4609	1.0232	1.0115
No log	3.9688	254	1.0488	0.4554	1.0488	1.0241
No log	4.0	256	1.0585	0.4792	1.0585	1.0288
No log	4.0312	258	1.1355	0.5246	1.1355	1.0656
No log	4.0625	260	1.1033	0.4849	1.1033	1.0504
No log	4.0938	262	1.0854	0.4584	1.0854	1.0418
No log	4.125	264	1.0636	0.4493	1.0636	1.0313
No log	4.1562	266	1.0737	0.4616	1.0737	1.0362
No log	4.1875	268	1.1332	0.3557	1.1332	1.0645
No log	4.2188	270	1.0814	0.3412	1.0814	1.0399
No log	4.25	272	1.0318	0.4323	1.0318	1.0158
No log	4.2812	274	1.0345	0.4281	1.0345	1.0171
No log	4.3125	276	1.0240	0.3897	1.0240	1.0119
No log	4.3438	278	1.0504	0.3646	1.0504	1.0249
No log	4.375	280	1.1596	0.3497	1.1596	1.0768
No log	4.4062	282	1.1861	0.3410	1.1861	1.0891
No log	4.4375	284	1.1721	0.3197	1.1721	1.0827
No log	4.4688	286	1.1308	0.3672	1.1308	1.0634
No log	4.5	288	1.0792	0.3877	1.0792	1.0389
No log	4.5312	290	1.0691	0.3638	1.0691	1.0340
No log	4.5625	292	1.0883	0.2901	1.0883	1.0432
No log	4.5938	294	1.1633	0.2961	1.1633	1.0786
No log	4.625	296	1.1443	0.3096	1.1443	1.0697
No log	4.6562	298	1.0850	0.3189	1.0850	1.0417
No log	4.6875	300	1.0462	0.4141	1.0462	1.0228
No log	4.7188	302	1.0450	0.4141	1.0450	1.0223
No log	4.75	304	1.0796	0.3768	1.0796	1.0391
No log	4.7812	306	1.0503	0.4244	1.0503	1.0248
No log	4.8125	308	1.0590	0.4157	1.0590	1.0291
No log	4.8438	310	1.0681	0.3644	1.0681	1.0335
No log	4.875	312	1.0764	0.3672	1.0764	1.0375
No log	4.9062	314	1.0674	0.3165	1.0674	1.0332
No log	4.9375	316	1.0460	0.3193	1.0460	1.0228
No log	4.9688	318	1.0467	0.2870	1.0467	1.0231
No log	5.0	320	1.0373	0.3490	1.0373	1.0185
No log	5.0312	322	1.0348	0.3666	1.0348	1.0172
No log	5.0625	324	1.0476	0.4020	1.0476	1.0235
No log	5.0938	326	1.0693	0.4440	1.0693	1.0341
No log	5.125	328	1.0902	0.3691	1.0902	1.0441
No log	5.1562	330	1.1209	0.3370	1.1209	1.0587
No log	5.1875	332	1.0958	0.3584	1.0958	1.0468
No log	5.2188	334	1.0151	0.3321	1.0151	1.0075
No log	5.25	336	0.9855	0.4088	0.9855	0.9927
No log	5.2812	338	0.9426	0.4979	0.9426	0.9709
No log	5.3125	340	0.9197	0.4906	0.9197	0.9590
No log	5.3438	342	1.0048	0.4882	1.0048	1.0024
No log	5.375	344	1.0516	0.5524	1.0516	1.0255
No log	5.4062	346	0.8691	0.5340	0.8691	0.9322
No log	5.4375	348	0.9406	0.4774	0.9406	0.9698
No log	5.4688	350	1.0524	0.4781	1.0524	1.0259
No log	5.5	352	0.9800	0.4681	0.9800	0.9899
No log	5.5312	354	0.8846	0.4822	0.8846	0.9405
No log	5.5625	356	0.9053	0.3871	0.9053	0.9515
No log	5.5938	358	0.9185	0.4211	0.9185	0.9584
No log	5.625	360	0.9179	0.3745	0.9179	0.9580
No log	5.6562	362	0.9337	0.3745	0.9337	0.9663
No log	5.6875	364	0.9731	0.3826	0.9731	0.9865
No log	5.7188	366	0.9628	0.3556	0.9628	0.9812
No log	5.75	368	0.9402	0.3745	0.9402	0.9696
No log	5.7812	370	0.9259	0.5042	0.9259	0.9623
No log	5.8125	372	0.9733	0.4979	0.9733	0.9866
No log	5.8438	374	0.9936	0.4340	0.9936	0.9968
No log	5.875	376	0.9514	0.4519	0.9514	0.9754
No log	5.9062	378	0.9047	0.4292	0.9047	0.9511
No log	5.9375	380	0.8996	0.3218	0.8996	0.9485
No log	5.9688	382	0.9133	0.4232	0.9133	0.9557
No log	6.0	384	0.9531	0.5223	0.9531	0.9763
No log	6.0312	386	1.0348	0.4920	1.0348	1.0172
No log	6.0625	388	1.0104	0.4884	1.0104	1.0052
No log	6.0938	390	0.9754	0.3555	0.9754	0.9876
No log	6.125	392	1.0521	0.3521	1.0521	1.0257
No log	6.1562	394	1.2764	0.3311	1.2764	1.1298
No log	6.1875	396	1.2809	0.3223	1.2809	1.1318
No log	6.2188	398	1.0815	0.4086	1.0815	1.0400
No log	6.25	400	0.9848	0.4369	0.9848	0.9924
No log	6.2812	402	0.9578	0.4374	0.9578	0.9787
No log	6.3125	404	0.9599	0.4286	0.9599	0.9797
No log	6.3438	406	0.9804	0.4030	0.9804	0.9901
No log	6.375	408	0.9992	0.3837	0.9992	0.9996
No log	6.4062	410	0.9560	0.3875	0.9560	0.9778
No log	6.4375	412	0.9523	0.4292	0.9523	0.9758
No log	6.4688	414	0.9541	0.4292	0.9541	0.9768
No log	6.5	416	0.9576	0.3692	0.9576	0.9786
No log	6.5312	418	0.9707	0.3397	0.9707	0.9852
No log	6.5625	420	1.0429	0.3249	1.0429	1.0212
No log	6.5938	422	1.0590	0.3523	1.0590	1.0291
No log	6.625	424	1.0079	0.3330	1.0079	1.0039
No log	6.6562	426	0.9916	0.3500	0.9916	0.9958
No log	6.6875	428	1.0097	0.3948	1.0097	1.0048
No log	6.7188	430	1.0426	0.4145	1.0426	1.0211
No log	6.75	432	1.0186	0.3468	1.0186	1.0093
No log	6.7812	434	0.9777	0.3780	0.9777	0.9888
No log	6.8125	436	0.9842	0.3149	0.9842	0.9921
No log	6.8438	438	1.0472	0.3314	1.0472	1.0233
No log	6.875	440	1.0643	0.3370	1.0643	1.0316
No log	6.9062	442	0.9798	0.4086	0.9798	0.9899
No log	6.9375	444	0.9463	0.4902	0.9463	0.9728
No log	6.9688	446	0.9463	0.4676	0.9463	0.9728
No log	7.0	448	0.9215	0.4930	0.9215	0.9600
No log	7.0312	450	0.9227	0.4643	0.9227	0.9606
No log	7.0625	452	0.9235	0.4930	0.9235	0.9610
No log	7.0938	454	0.9341	0.4930	0.9341	0.9665
No log	7.125	456	0.9515	0.4102	0.9515	0.9755
No log	7.1562	458	0.9455	0.5131	0.9455	0.9724
No log	7.1875	460	0.9503	0.4859	0.9503	0.9749
No log	7.2188	462	0.9530	0.4859	0.9530	0.9762
No log	7.25	464	0.9610	0.5131	0.9610	0.9803
No log	7.2812	466	0.9691	0.5025	0.9691	0.9844
No log	7.3125	468	0.9825	0.3666	0.9825	0.9912
No log	7.3438	470	0.9930	0.3009	0.9930	0.9965
No log	7.375	472	0.9756	0.3099	0.9756	0.9877
No log	7.4062	474	0.9771	0.4123	0.9771	0.9885
No log	7.4375	476	0.9859	0.4343	0.9859	0.9929
No log	7.4688	478	0.9878	0.3811	0.9878	0.9939
No log	7.5	480	0.9906	0.3711	0.9906	0.9953
No log	7.5312	482	0.9987	0.3243	0.9987	0.9994
No log	7.5625	484	1.0023	0.2714	1.0023	1.0011
No log	7.5938	486	1.0301	0.3887	1.0301	1.0149
No log	7.625	488	1.0095	0.3723	1.0095	1.0047
No log	7.6562	490	0.9738	0.3280	0.9738	0.9868
No log	7.6875	492	0.9745	0.4159	0.9745	0.9871
No log	7.7188	494	0.9791	0.3692	0.9791	0.9895
No log	7.75	496	1.0095	0.3511	1.0095	1.0047
No log	7.7812	498	1.0341	0.3608	1.0341	1.0169
0.3887	7.8125	500	1.0005	0.3301	1.0005	1.0003
0.3887	7.8438	502	0.9846	0.2942	0.9846	0.9923
0.3887	7.875	504	0.9845	0.3189	0.9845	0.9922
0.3887	7.9062	506	0.9947	0.3205	0.9947	0.9974
0.3887	7.9375	508	0.9937	0.3788	0.9937	0.9968
0.3887	7.9688	510	1.0124	0.4218	1.0124	1.0062
0.3887	8.0	512	0.9966	0.4122	0.9966	0.9983
0.3887	8.0312	514	0.9787	0.4026	0.9787	0.9893
0.3887	8.0625	516	0.9531	0.3930	0.9531	0.9763
0.3887	8.0938	518	0.9496	0.4045	0.9496	0.9745
0.3887	8.125	520	0.9458	0.4232	0.9458	0.9725
0.3887	8.1562	522	0.9500	0.4822	0.9500	0.9747
0.3887	8.1875	524	1.0001	0.5043	1.0001	1.0000
0.3887	8.2188	526	1.0353	0.4774	1.0353	1.0175
0.3887	8.25	528	1.0185	0.4808	1.0185	1.0092
0.3887	8.2812	530	0.9888	0.5107	0.9888	0.9944
0.3887	8.3125	532	0.9614	0.4023	0.9614	0.9805
0.3887	8.3438	534	0.9614	0.4023	0.9614	0.9805
0.3887	8.375	536	0.9637	0.4290	0.9637	0.9817
0.3887	8.4062	538	0.9727	0.4323	0.9727	0.9862
0.3887	8.4375	540	0.9904	0.3329	0.9904	0.9952
0.3887	8.4688	542	1.0033	0.3329	1.0033	1.0016
0.3887	8.5	544	1.0172	0.2918	1.0172	1.0086
0.3887	8.5312	546	1.0158	0.3108	1.0158	1.0079
0.3887	8.5625	548	1.0130	0.3108	1.0130	1.0065
0.3887	8.5938	550	1.0116	0.4120	1.0116	1.0058
0.3887	8.625	552	1.0258	0.3619	1.0258	1.0128
0.3887	8.6562	554	0.9997	0.4120	0.9997	0.9998
0.3887	8.6875	556	1.0220	0.2871	1.0220	1.0109
0.3887	8.7188	558	1.1455	0.3071	1.1455	1.0703
0.3887	8.75	560	1.1570	0.3133	1.1570	1.0756
0.3887	8.7812	562	1.0371	0.3561	1.0371	1.0184
0.3887	8.8125	564	0.9426	0.4601	0.9426	0.9709
0.3887	8.8438	566	0.9483	0.5233	0.9483	0.9738
0.3887	8.875	568	0.9532	0.5526	0.9532	0.9763
0.3887	8.9062	570	0.9320	0.5233	0.9320	0.9654
0.3887	8.9375	572	0.9234	0.4916	0.9234	0.9609
0.3887	8.9688	574	0.9249	0.3829	0.9249	0.9617
0.3887	9.0	576	0.9347	0.3541	0.9347	0.9668
0.3887	9.0312	578	0.9392	0.3879	0.9392	0.9691
0.3887	9.0625	580	0.9402	0.3738	0.9402	0.9697
0.3887	9.0938	582	0.9375	0.5107	0.9375	0.9683
0.3887	9.125	584	0.9557	0.4998	0.9557	0.9776
0.3887	9.1562	586	0.9221	0.4463	0.9221	0.9603
0.3887	9.1875	588	0.9342	0.4349	0.9342	0.9665
0.3887	9.2188	590	0.9544	0.4499	0.9544	0.9769
0.3887	9.25	592	0.9739	0.3892	0.9739	0.9869
0.3887	9.2812	594	0.9912	0.3892	0.9912	0.9956
0.3887	9.3125	596	1.0183	0.3646	1.0183	1.0091
0.3887	9.3438	598	1.0461	0.2685	1.0461	1.0228
0.3887	9.375	600	1.0590	0.3056	1.0590	1.0291
0.3887	9.4062	602	1.0834	0.2870	1.0834	1.0409
0.3887	9.4375	604	1.0744	0.2702	1.0744	1.0365
0.3887	9.4688	606	1.0419	0.3287	1.0419	1.0208

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1