ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run1_AugV5_k20_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2468
• Qwk: 0.1700
• Mse: 1.2468
• Rmse: 1.1166

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0198	2	4.6665	-0.0132	4.6665	2.1602
No log	0.0396	4	2.5909	-0.0076	2.5909	1.6096
No log	0.0594	6	2.0074	-0.0164	2.0074	1.4168
No log	0.0792	8	1.6367	0.0283	1.6367	1.2794
No log	0.0990	10	1.4544	-0.0997	1.4544	1.2060
No log	0.1188	12	1.2228	0.1308	1.2228	1.1058
No log	0.1386	14	1.2246	0.1732	1.2246	1.1066
No log	0.1584	16	1.3740	0.0714	1.3740	1.1722
No log	0.1782	18	1.5386	0.0124	1.5386	1.2404
No log	0.1980	20	1.5160	0.0297	1.5160	1.2313
No log	0.2178	22	1.3743	0.1413	1.3743	1.1723
No log	0.2376	24	1.3880	0.1753	1.3880	1.1781
No log	0.2574	26	1.5956	0.1076	1.5956	1.2632
No log	0.2772	28	1.8057	0.0789	1.8057	1.3438
No log	0.2970	30	1.8735	0.0789	1.8735	1.3687
No log	0.3168	32	1.7222	0.0310	1.7222	1.3123
No log	0.3366	34	1.4512	0.0838	1.4512	1.2047
No log	0.3564	36	1.3646	0.1753	1.3646	1.1682
No log	0.3762	38	1.4893	0.1472	1.4893	1.2204
No log	0.3960	40	1.7413	0.1054	1.7413	1.3196
No log	0.4158	42	2.0946	0.0875	2.0946	1.4473
No log	0.4356	44	2.4132	0.0	2.4132	1.5534
No log	0.4554	46	1.9925	0.0603	1.9925	1.4116
No log	0.4752	48	1.4462	0.1530	1.4462	1.2026
No log	0.4950	50	1.1785	0.1505	1.1785	1.0856
No log	0.5149	52	1.1482	0.1202	1.1482	1.0715
No log	0.5347	54	1.1472	0.1791	1.1472	1.0711
No log	0.5545	56	1.1560	0.1696	1.1560	1.0752
No log	0.5743	58	1.2499	0.1679	1.2499	1.1180
No log	0.5941	60	1.4893	0.0575	1.4893	1.2204
No log	0.6139	62	1.8643	0.0619	1.8643	1.3654
No log	0.6337	64	2.3413	0.0634	2.3413	1.5301
No log	0.6535	66	2.1521	0.0465	2.1521	1.4670
No log	0.6733	68	1.6884	0.0526	1.6884	1.2994
No log	0.6931	70	1.4974	0.0575	1.4974	1.2237
No log	0.7129	72	1.2919	0.1165	1.2919	1.1366
No log	0.7327	74	1.1437	0.2191	1.1437	1.0695
No log	0.7525	76	1.0752	0.3557	1.0752	1.0369
No log	0.7723	78	1.0668	0.3210	1.0668	1.0328
No log	0.7921	80	1.0788	0.3062	1.0788	1.0386
No log	0.8119	82	1.2974	0.1530	1.2974	1.1390
No log	0.8317	84	1.8575	0.2190	1.8575	1.3629
No log	0.8515	86	2.1138	0.1723	2.1138	1.4539
No log	0.8713	88	1.8986	0.1831	1.8986	1.3779
No log	0.8911	90	1.8272	0.1831	1.8272	1.3517
No log	0.9109	92	1.4930	0.1827	1.4930	1.2219
No log	0.9307	94	1.2890	0.1427	1.2890	1.1354
No log	0.9505	96	1.2005	0.1912	1.2005	1.0957
No log	0.9703	98	1.0065	0.4299	1.0065	1.0032
No log	0.9901	100	0.9550	0.4324	0.9550	0.9772
No log	1.0099	102	0.9478	0.4036	0.9478	0.9736
No log	1.0297	104	0.9563	0.4282	0.9563	0.9779
No log	1.0495	106	0.9579	0.4461	0.9579	0.9787
No log	1.0693	108	1.0140	0.3571	1.0140	1.0070
No log	1.0891	110	1.0160	0.3427	1.0160	1.0080
No log	1.1089	112	1.0304	0.3427	1.0304	1.0151
No log	1.1287	114	1.0669	0.3433	1.0669	1.0329
No log	1.1485	116	0.9850	0.3527	0.9850	0.9925
No log	1.1683	118	0.9740	0.3627	0.9740	0.9869
No log	1.1881	120	0.9772	0.3685	0.9772	0.9885
No log	1.2079	122	1.0131	0.3256	1.0131	1.0065
No log	1.2277	124	1.1458	0.3009	1.1458	1.0704
No log	1.2475	126	1.3628	0.3004	1.3628	1.1674
No log	1.2673	128	1.2958	0.2782	1.2958	1.1383
No log	1.2871	130	1.2003	0.2806	1.2003	1.0956
No log	1.3069	132	1.3412	0.2275	1.3412	1.1581
No log	1.3267	134	1.2876	0.1964	1.2876	1.1347
No log	1.3465	136	1.1191	0.2579	1.1191	1.0579
No log	1.3663	138	1.1214	0.3019	1.1214	1.0590
No log	1.3861	140	1.1601	0.2676	1.1601	1.0771
No log	1.4059	142	1.3455	0.1543	1.3455	1.1600
No log	1.4257	144	1.4763	0.1802	1.4763	1.2150
No log	1.4455	146	1.3397	0.1347	1.3397	1.1574
No log	1.4653	148	1.3685	0.1510	1.3685	1.1698
No log	1.4851	150	1.3308	0.1490	1.3308	1.1536
No log	1.5050	152	1.2240	0.2302	1.2240	1.1064
No log	1.5248	154	1.1918	0.2431	1.1918	1.0917
No log	1.5446	156	1.1451	0.3684	1.1451	1.0701
No log	1.5644	158	1.1946	0.2514	1.1946	1.0930
No log	1.5842	160	1.1988	0.2550	1.1988	1.0949
No log	1.6040	162	1.3058	0.2250	1.3058	1.1427
No log	1.6238	164	1.2771	0.2250	1.2771	1.1301
No log	1.6436	166	1.1164	0.3345	1.1164	1.0566
No log	1.6634	168	1.1170	0.2989	1.1170	1.0569
No log	1.6832	170	1.2326	0.2611	1.2326	1.1102
No log	1.7030	172	1.1816	0.2545	1.1816	1.0870
No log	1.7228	174	1.1007	0.3126	1.1007	1.0491
No log	1.7426	176	1.0300	0.3948	1.0300	1.0149
No log	1.7624	178	1.0302	0.3695	1.0302	1.0150
No log	1.7822	180	1.0679	0.3354	1.0679	1.0334
No log	1.8020	182	1.2087	0.2839	1.2087	1.0994
No log	1.8218	184	1.1471	0.2247	1.1471	1.0710
No log	1.8416	186	1.0828	0.2995	1.0828	1.0406
No log	1.8614	188	1.2103	0.3000	1.2103	1.1002
No log	1.8812	190	1.2011	0.2766	1.2011	1.0959
No log	1.9010	192	1.1064	0.3779	1.1064	1.0519
No log	1.9208	194	1.3430	0.2055	1.3430	1.1589
No log	1.9406	196	1.6747	0.1970	1.6747	1.2941
No log	1.9604	198	1.5986	0.2402	1.5986	1.2644
No log	1.9802	200	1.2811	0.2014	1.2811	1.1319
No log	2.0	202	1.0746	0.3399	1.0746	1.0366
No log	2.0198	204	1.0341	0.3042	1.0341	1.0169
No log	2.0396	206	1.0483	0.3216	1.0483	1.0239
No log	2.0594	208	1.1066	0.2748	1.1066	1.0520
No log	2.0792	210	1.1494	0.2229	1.1494	1.0721
No log	2.0990	212	1.1492	0.2268	1.1492	1.0720
No log	2.1188	214	1.1621	0.2438	1.1621	1.0780
No log	2.1386	216	1.2922	0.2172	1.2922	1.1367
No log	2.1584	218	1.2872	0.2136	1.2872	1.1345
No log	2.1782	220	1.1182	0.2742	1.1182	1.0575
No log	2.1980	222	1.0905	0.3286	1.0905	1.0442
No log	2.2178	224	1.1309	0.2742	1.1309	1.0634
No log	2.2376	226	1.0952	0.2967	1.0952	1.0465
No log	2.2574	228	1.0741	0.3200	1.0741	1.0364
No log	2.2772	230	1.0911	0.3741	1.0911	1.0446
No log	2.2970	232	1.0854	0.3205	1.0854	1.0418
No log	2.3168	234	1.1468	0.3074	1.1468	1.0709
No log	2.3366	236	1.1689	0.3117	1.1689	1.0812
No log	2.3564	238	1.1260	0.2806	1.1260	1.0611
No log	2.3762	240	1.0830	0.2747	1.0830	1.0407
No log	2.3960	242	1.0550	0.2898	1.0550	1.0271
No log	2.4158	244	1.0626	0.2318	1.0626	1.0308
No log	2.4356	246	1.1106	0.2417	1.1106	1.0539
No log	2.4554	248	1.1639	0.2486	1.1639	1.0788
No log	2.4752	250	1.1516	0.2805	1.1516	1.0731
No log	2.4950	252	1.0617	0.3237	1.0617	1.0304
No log	2.5149	254	1.0768	0.3950	1.0768	1.0377
No log	2.5347	256	1.0605	0.4040	1.0605	1.0298
No log	2.5545	258	1.0032	0.3601	1.0032	1.0016
No log	2.5743	260	1.0039	0.3369	1.0039	1.0020
No log	2.5941	262	1.0143	0.2822	1.0143	1.0071
No log	2.6139	264	1.0387	0.2772	1.0387	1.0192
No log	2.6337	266	1.0325	0.2772	1.0325	1.0161
No log	2.6535	268	1.0071	0.3511	1.0071	1.0035
No log	2.6733	270	1.0593	0.3648	1.0593	1.0292
No log	2.6931	272	1.0774	0.3973	1.0774	1.0380
No log	2.7129	274	1.0917	0.3780	1.0917	1.0449
No log	2.7327	276	1.1349	0.3327	1.1349	1.0653
No log	2.7525	278	1.2302	0.2654	1.2302	1.1092
No log	2.7723	280	1.3981	0.1929	1.3981	1.1824
No log	2.7921	282	1.7419	0.2143	1.7419	1.3198
No log	2.8119	284	1.6381	0.2101	1.6381	1.2799
No log	2.8317	286	1.3233	0.3088	1.3233	1.1504
No log	2.8515	288	1.2375	0.2893	1.2375	1.1124
No log	2.8713	290	1.2485	0.2977	1.2485	1.1174
No log	2.8911	292	1.2163	0.3214	1.2163	1.1028
No log	2.9109	294	1.2225	0.2927	1.2225	1.1057
No log	2.9307	296	1.2907	0.1629	1.2907	1.1361
No log	2.9505	298	1.2818	0.1146	1.2818	1.1322
No log	2.9703	300	1.1973	0.1805	1.1973	1.0942
No log	2.9901	302	1.1552	0.2440	1.1552	1.0748
No log	3.0099	304	1.1824	0.2121	1.1824	1.0874
No log	3.0297	306	1.1767	0.2121	1.1767	1.0848
No log	3.0495	308	1.1220	0.2673	1.1220	1.0592
No log	3.0693	310	1.1252	0.2230	1.1252	1.0607
No log	3.0891	312	1.1330	0.2658	1.1330	1.0644
No log	3.1089	314	1.1448	0.2658	1.1448	1.0700
No log	3.1287	316	1.1453	0.3019	1.1453	1.0702
No log	3.1485	318	1.1243	0.3019	1.1243	1.0603
No log	3.1683	320	1.1034	0.2512	1.1034	1.0504
No log	3.1881	322	1.0989	0.2871	1.0989	1.0483
No log	3.2079	324	1.1206	0.2480	1.1206	1.0586
No log	3.2277	326	1.1296	0.2480	1.1296	1.0628
No log	3.2475	328	1.0901	0.2679	1.0901	1.0441
No log	3.2673	330	1.0844	0.2567	1.0844	1.0413
No log	3.2871	332	1.1003	0.2327	1.1003	1.0489
No log	3.3069	334	1.1815	0.2159	1.1815	1.0870
No log	3.3267	336	1.3645	0.2840	1.3645	1.1681
No log	3.3465	338	1.5211	0.2618	1.5211	1.2333
No log	3.3663	340	1.3821	0.3103	1.3821	1.1756
No log	3.3861	342	1.1755	0.2311	1.1755	1.0842
No log	3.4059	344	1.0891	0.2823	1.0891	1.0436
No log	3.4257	346	1.0652	0.3256	1.0652	1.0321
No log	3.4455	348	1.0794	0.3249	1.0794	1.0389
No log	3.4653	350	1.0825	0.3716	1.0825	1.0404
No log	3.4851	352	1.0439	0.4002	1.0439	1.0217
No log	3.5050	354	1.0484	0.3283	1.0484	1.0239
No log	3.5248	356	1.1041	0.3321	1.1041	1.0508
No log	3.5446	358	1.1163	0.3321	1.1163	1.0565
No log	3.5644	360	1.0577	0.3406	1.0577	1.0284
No log	3.5842	362	1.0489	0.3537	1.0489	1.0241
No log	3.6040	364	1.0584	0.4202	1.0584	1.0288
No log	3.6238	366	1.0660	0.4107	1.0660	1.0325
No log	3.6436	368	1.0982	0.2466	1.0982	1.0479
No log	3.6634	370	1.1410	0.2480	1.1410	1.0682
No log	3.6832	372	1.2308	0.1950	1.2308	1.1094
No log	3.7030	374	1.1763	0.1797	1.1763	1.0846
No log	3.7228	376	1.1210	0.2596	1.1210	1.0588
No log	3.7426	378	1.1191	0.2388	1.1191	1.0579
No log	3.7624	380	1.1440	0.2489	1.1440	1.0696
No log	3.7822	382	1.2341	0.1648	1.2341	1.1109
No log	3.8020	384	1.2298	0.1648	1.2298	1.1090
No log	3.8218	386	1.1109	0.2647	1.1109	1.0540
No log	3.8416	388	1.0920	0.2539	1.0920	1.0450
No log	3.8614	390	1.1058	0.2625	1.1058	1.0516
No log	3.8812	392	1.1533	0.2650	1.1533	1.0739
No log	3.9010	394	1.1852	0.1994	1.1852	1.0887
No log	3.9208	396	1.2664	0.2839	1.2664	1.1253
No log	3.9406	398	1.2677	0.2701	1.2677	1.1259
No log	3.9604	400	1.2197	0.2714	1.2197	1.1044
No log	3.9802	402	1.1280	0.3297	1.1280	1.0621
No log	4.0	404	1.1165	0.2814	1.1165	1.0566
No log	4.0198	406	1.1105	0.2814	1.1105	1.0538
No log	4.0396	408	1.1250	0.2832	1.1250	1.0607
No log	4.0594	410	1.2096	0.3047	1.2096	1.0998
No log	4.0792	412	1.2154	0.3047	1.2154	1.1024
No log	4.0990	414	1.1360	0.2657	1.1360	1.0658
No log	4.1188	416	1.0607	0.3089	1.0607	1.0299
No log	4.1386	418	1.1028	0.3343	1.1028	1.0501
No log	4.1584	420	1.1047	0.3656	1.1047	1.0510
No log	4.1782	422	1.0502	0.2822	1.0502	1.0248
No log	4.1980	424	1.0807	0.2403	1.0807	1.0396
No log	4.2178	426	1.3142	0.2733	1.3142	1.1464
No log	4.2376	428	1.4209	0.25	1.4209	1.1920
No log	4.2574	430	1.2900	0.2733	1.2900	1.1358
No log	4.2772	432	1.1968	0.2347	1.1968	1.0940
No log	4.2970	434	1.0841	0.3189	1.0841	1.0412
No log	4.3168	436	1.0338	0.3578	1.0338	1.0168
No log	4.3366	438	1.0437	0.3868	1.0437	1.0216
No log	4.3564	440	1.0483	0.4202	1.0483	1.0239
No log	4.3762	442	1.0357	0.4377	1.0357	1.0177
No log	4.3960	444	1.0331	0.3804	1.0331	1.0164
No log	4.4158	446	1.0455	0.3468	1.0455	1.0225
No log	4.4356	448	1.0506	0.3250	1.0506	1.0250
No log	4.4554	450	1.0572	0.2775	1.0573	1.0282
No log	4.4752	452	1.1113	0.2685	1.1113	1.0542
No log	4.4950	454	1.1297	0.2870	1.1297	1.0629
No log	4.5149	456	1.1486	0.3165	1.1486	1.0717
No log	4.5347	458	1.1432	0.3165	1.1432	1.0692
No log	4.5545	460	1.0915	0.2732	1.0915	1.0448
No log	4.5743	462	1.0815	0.3213	1.0815	1.0399
No log	4.5941	464	1.0809	0.3169	1.0809	1.0397
No log	4.6139	466	1.0323	0.3210	1.0323	1.0160
No log	4.6337	468	1.0824	0.2506	1.0824	1.0404
No log	4.6535	470	1.1516	0.2506	1.1516	1.0731
No log	4.6733	472	1.1415	0.1662	1.1415	1.0684
No log	4.6931	474	1.0837	0.2743	1.0837	1.0410
No log	4.7129	476	1.1223	0.2964	1.1223	1.0594
No log	4.7327	478	1.2865	0.3004	1.2865	1.1342
No log	4.7525	480	1.2804	0.3064	1.2804	1.1315
No log	4.7723	482	1.1985	0.3115	1.1985	1.0948
No log	4.7921	484	1.1835	0.2624	1.1835	1.0879
No log	4.8119	486	1.2334	0.2702	1.2334	1.1106
No log	4.8317	488	1.2356	0.2702	1.2356	1.1116
No log	4.8515	490	1.2285	0.2053	1.2285	1.1084
No log	4.8713	492	1.1750	0.2609	1.1750	1.0840
No log	4.8911	494	1.1960	0.2283	1.1960	1.0936
No log	4.9109	496	1.2050	0.1636	1.2050	1.0977
No log	4.9307	498	1.1690	0.2748	1.1690	1.0812
0.3627	4.9505	500	1.1571	0.2824	1.1571	1.0757
0.3627	4.9703	502	1.1484	0.2664	1.1484	1.0716
0.3627	4.9901	504	1.1697	0.2667	1.1697	1.0815
0.3627	5.0099	506	1.1626	0.3056	1.1626	1.0782
0.3627	5.0297	508	1.1850	0.2896	1.1850	1.0886
0.3627	5.0495	510	1.1604	0.2299	1.1604	1.0772
0.3627	5.0693	512	1.1173	0.2664	1.1173	1.0570
0.3627	5.0891	514	1.1148	0.2395	1.1148	1.0558
0.3627	5.1089	516	1.1500	0.2169	1.1500	1.0724
0.3627	5.1287	518	1.2468	0.1700	1.2468	1.1166

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1