ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k10_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0307
• Qwk: 0.2965
• Mse: 1.0307
• Rmse: 1.0152

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	4.8493	-0.0075	4.8493	2.2021
No log	0.0784	4	3.0846	0.0005	3.0846	1.7563
No log	0.1176	6	2.1414	-0.0361	2.1414	1.4634
No log	0.1569	8	1.5286	-0.0126	1.5286	1.2364
No log	0.1961	10	1.4230	0.0622	1.4230	1.1929
No log	0.2353	12	1.2466	0.0499	1.2466	1.1165
No log	0.2745	14	1.1154	0.2733	1.1154	1.0561
No log	0.3137	16	1.2739	0.0750	1.2739	1.1287
No log	0.3529	18	1.3483	0.0750	1.3483	1.1612
No log	0.3922	20	1.2946	0.0926	1.2946	1.1378
No log	0.4314	22	1.6337	0.0936	1.6337	1.2782
No log	0.4706	24	2.0022	0.0444	2.0022	1.4150
No log	0.5098	26	1.7885	0.0416	1.7885	1.3373
No log	0.5490	28	1.6836	0.0672	1.6836	1.2975
No log	0.5882	30	2.2801	-0.0427	2.2801	1.5100
No log	0.6275	32	2.1697	0.0019	2.1697	1.4730
No log	0.6667	34	1.5565	0.1849	1.5565	1.2476
No log	0.7059	36	1.3575	0.2040	1.3575	1.1651
No log	0.7451	38	1.5837	0.2418	1.5837	1.2585
No log	0.7843	40	2.2206	0.0908	2.2206	1.4902
No log	0.8235	42	3.3732	0.0724	3.3732	1.8366
No log	0.8627	44	3.4185	0.0383	3.4185	1.8489
No log	0.9020	46	2.5480	0.1001	2.5480	1.5963
No log	0.9412	48	1.8090	0.1038	1.8090	1.3450
No log	0.9804	50	1.3177	0.1288	1.3177	1.1479
No log	1.0196	52	1.1849	0.1848	1.1849	1.0885
No log	1.0588	54	1.1729	0.1696	1.1729	1.0830
No log	1.0980	56	1.2425	0.1565	1.2425	1.1147
No log	1.1373	58	1.4171	0.1587	1.4171	1.1904
No log	1.1765	60	1.5648	0.1051	1.5648	1.2509
No log	1.2157	62	1.7602	0.0851	1.7602	1.3267
No log	1.2549	64	1.7506	0.1020	1.7506	1.3231
No log	1.2941	66	1.8880	0.0952	1.8880	1.3740
No log	1.3333	68	1.8710	0.1094	1.8710	1.3678
No log	1.3725	70	1.8575	0.0709	1.8575	1.3629
No log	1.4118	72	2.1528	0.0570	2.1528	1.4672
No log	1.4510	74	2.4584	0.0066	2.4584	1.5679
No log	1.4902	76	2.3701	0.0239	2.3701	1.5395
No log	1.5294	78	1.6788	0.0	1.6788	1.2957
No log	1.5686	80	1.2458	0.1168	1.2458	1.1161
No log	1.6078	82	1.1613	0.2278	1.1613	1.0776
No log	1.6471	84	1.1529	0.1870	1.1529	1.0737
No log	1.6863	86	1.2476	0.1507	1.2476	1.1170
No log	1.7255	88	1.4359	0.1920	1.4359	1.1983
No log	1.7647	90	1.5829	0.1901	1.5829	1.2581
No log	1.8039	92	1.4714	0.2424	1.4714	1.2130
No log	1.8431	94	1.2318	0.1848	1.2318	1.1099
No log	1.8824	96	1.1320	0.2555	1.1320	1.0640
No log	1.9216	98	1.1217	0.2669	1.1217	1.0591
No log	1.9608	100	1.2633	0.1772	1.2633	1.1240
No log	2.0	102	1.4700	0.0838	1.4700	1.2124
No log	2.0392	104	1.4754	0.1196	1.4754	1.2147
No log	2.0784	106	1.4534	0.1196	1.4534	1.2056
No log	2.1176	108	1.2859	0.1106	1.2859	1.1340
No log	2.1569	110	1.1874	0.1809	1.1874	1.0897
No log	2.1961	112	1.0991	0.3179	1.0991	1.0484
No log	2.2353	114	1.0605	0.3472	1.0605	1.0298
No log	2.2745	116	1.0511	0.3472	1.0511	1.0252
No log	2.3137	118	1.1545	0.2337	1.1545	1.0745
No log	2.3529	120	1.2237	0.1974	1.2237	1.1062
No log	2.3922	122	1.1182	0.2672	1.1182	1.0574
No log	2.4314	124	1.0578	0.3321	1.0578	1.0285
No log	2.4706	126	0.9970	0.4119	0.9970	0.9985
No log	2.5098	128	1.0440	0.4103	1.0440	1.0218
No log	2.5490	130	1.3930	0.3353	1.3930	1.1802
No log	2.5882	132	1.5849	0.2240	1.5849	1.2589
No log	2.6275	134	1.7261	0.2014	1.7261	1.3138
No log	2.6667	136	1.4731	0.2435	1.4731	1.2137
No log	2.7059	138	1.2590	0.2832	1.2590	1.1220
No log	2.7451	140	1.0864	0.3607	1.0864	1.0423
No log	2.7843	142	1.0731	0.2964	1.0731	1.0359
No log	2.8235	144	1.0450	0.2843	1.0450	1.0222
No log	2.8627	146	1.0016	0.3804	1.0016	1.0008
No log	2.9020	148	1.0304	0.3834	1.0304	1.0151
No log	2.9412	150	1.0070	0.3914	1.0070	1.0035
No log	2.9804	152	1.0340	0.3969	1.0340	1.0168
No log	3.0196	154	1.1551	0.2627	1.1551	1.0747
No log	3.0588	156	1.2306	0.2364	1.2306	1.1093
No log	3.0980	158	1.2334	0.2364	1.2334	1.1106
No log	3.1373	160	1.0839	0.3827	1.0839	1.0411
No log	3.1765	162	1.0347	0.4087	1.0347	1.0172
No log	3.2157	164	1.0627	0.3268	1.0627	1.0309
No log	3.2549	166	1.1375	0.3636	1.1375	1.0665
No log	3.2941	168	1.0976	0.3829	1.0976	1.0477
No log	3.3333	170	1.1598	0.2757	1.1598	1.0770
No log	3.3725	172	1.3476	0.2172	1.3476	1.1609
No log	3.4118	174	1.2562	0.1907	1.2562	1.1208
No log	3.4510	176	1.2382	0.3056	1.2382	1.1128
No log	3.4902	178	1.3429	0.2857	1.3429	1.1588
No log	3.5294	180	1.3512	0.2944	1.3512	1.1624
No log	3.5686	182	1.2439	0.3788	1.2439	1.1153
No log	3.6078	184	1.2280	0.3995	1.2280	1.1082
No log	3.6471	186	1.3358	0.2734	1.3358	1.1558
No log	3.6863	188	1.3682	0.2472	1.3682	1.1697
No log	3.7255	190	1.3022	0.2926	1.3022	1.1411
No log	3.7647	192	1.1821	0.4011	1.1821	1.0872
No log	3.8039	194	1.1364	0.3450	1.1364	1.0660
No log	3.8431	196	1.1241	0.3128	1.1241	1.0602
No log	3.8824	198	1.1028	0.2993	1.1028	1.0502
No log	3.9216	200	1.1705	0.3819	1.1705	1.0819
No log	3.9608	202	1.2982	0.2925	1.2982	1.1394
No log	4.0	204	1.2540	0.3579	1.2540	1.1198
No log	4.0392	206	1.1668	0.3305	1.1668	1.0802
No log	4.0784	208	1.1652	0.2845	1.1652	1.0795
No log	4.1176	210	1.2044	0.3720	1.2044	1.0975
No log	4.1569	212	1.2683	0.3496	1.2683	1.1262
No log	4.1961	214	1.1655	0.2556	1.1655	1.0796
No log	4.2353	216	1.1281	0.2280	1.1281	1.0621
No log	4.2745	218	1.1264	0.2079	1.1264	1.0613
No log	4.3137	220	1.1482	0.2317	1.1482	1.0715
No log	4.3529	222	1.1048	0.2132	1.1048	1.0511
No log	4.3922	224	1.0849	0.2612	1.0849	1.0416
No log	4.4314	226	1.0935	0.3014	1.0935	1.0457
No log	4.4706	228	1.0782	0.3107	1.0782	1.0384
No log	4.5098	230	1.0754	0.3176	1.0754	1.0370
No log	4.5490	232	1.0626	0.3037	1.0626	1.0308
No log	4.5882	234	1.1074	0.4335	1.1074	1.0523
No log	4.6275	236	1.3195	0.3145	1.3195	1.1487
No log	4.6667	238	1.2967	0.3145	1.2967	1.1387
No log	4.7059	240	1.1819	0.3584	1.1819	1.0871
No log	4.7451	242	1.0742	0.3997	1.0742	1.0364
No log	4.7843	244	1.0545	0.3789	1.0545	1.0269
No log	4.8235	246	1.0552	0.3668	1.0552	1.0272
No log	4.8627	248	1.0926	0.3607	1.0926	1.0453
No log	4.9020	250	1.1084	0.3834	1.1084	1.0528
No log	4.9412	252	1.1170	0.4265	1.1170	1.0569
No log	4.9804	254	1.1028	0.3490	1.1028	1.0502
No log	5.0196	256	1.0795	0.2991	1.0795	1.0390
No log	5.0588	258	1.0712	0.2991	1.0712	1.0350
No log	5.0980	260	1.0569	0.3085	1.0569	1.0281
No log	5.1373	262	1.0445	0.3017	1.0445	1.0220
No log	5.1765	264	1.0521	0.3537	1.0521	1.0257
No log	5.2157	266	1.0731	0.3590	1.0731	1.0359
No log	5.2549	268	1.1216	0.4053	1.1216	1.0591
No log	5.2941	270	1.3174	0.2217	1.3174	1.1478
No log	5.3333	272	1.3599	0.2136	1.3599	1.1661
No log	5.3725	274	1.1613	0.4053	1.1613	1.0777
No log	5.4118	276	1.1042	0.3407	1.1042	1.0508
No log	5.4510	278	1.0806	0.3880	1.0806	1.0395
No log	5.4902	280	1.0504	0.2439	1.0504	1.0249
No log	5.5294	282	1.0789	0.3110	1.0789	1.0387
No log	5.5686	284	1.0758	0.3133	1.0758	1.0372
No log	5.6078	286	1.0824	0.3250	1.0824	1.0404
No log	5.6471	288	1.1674	0.2986	1.1674	1.0805
No log	5.6863	290	1.3205	0.2364	1.3205	1.1491
No log	5.7255	292	1.2989	0.2451	1.2989	1.1397
No log	5.7647	294	1.2134	0.3008	1.2134	1.1016
No log	5.8039	296	1.1216	0.2618	1.1216	1.0590
No log	5.8431	298	1.0656	0.3318	1.0656	1.0323
No log	5.8824	300	1.0879	0.2752	1.0879	1.0430
No log	5.9216	302	1.1082	0.2586	1.1082	1.0527
No log	5.9608	304	1.0610	0.2822	1.0610	1.0300
No log	6.0	306	1.1101	0.2263	1.1101	1.0536
No log	6.0392	308	1.2450	0.2229	1.2450	1.1158
No log	6.0784	310	1.1965	0.2581	1.1965	1.0938
No log	6.1176	312	1.0774	0.3243	1.0774	1.0380
No log	6.1569	314	1.0618	0.3180	1.0618	1.0305
No log	6.1961	316	1.0615	0.3336	1.0615	1.0303
No log	6.2353	318	1.0742	0.2712	1.0742	1.0365
No log	6.2745	320	1.1380	0.3009	1.1380	1.0668
No log	6.3137	322	1.1537	0.2920	1.1537	1.0741
No log	6.3529	324	1.1000	0.2921	1.1000	1.0488
No log	6.3922	326	1.0522	0.3715	1.0522	1.0258
No log	6.4314	328	1.0643	0.3455	1.0643	1.0317
No log	6.4706	330	1.0543	0.3924	1.0543	1.0268
No log	6.5098	332	1.0704	0.3319	1.0704	1.0346
No log	6.5490	334	1.1024	0.3500	1.1024	1.0499
No log	6.5882	336	1.0986	0.3174	1.0986	1.0481
No log	6.6275	338	1.1354	0.2989	1.1354	1.0656
No log	6.6667	340	1.1325	0.2967	1.1325	1.0642
No log	6.7059	342	1.2039	0.3368	1.2039	1.0972
No log	6.7451	344	1.3652	0.2436	1.3652	1.1684
No log	6.7843	346	1.2963	0.2472	1.2963	1.1385
No log	6.8235	348	1.1397	0.3304	1.1397	1.0676
No log	6.8627	350	1.0974	0.4216	1.0974	1.0475
No log	6.9020	352	1.0908	0.3151	1.0908	1.0444
No log	6.9412	354	1.1600	0.3033	1.1600	1.0770
No log	6.9804	356	1.2239	0.2787	1.2239	1.1063
No log	7.0196	358	1.2298	0.2857	1.2298	1.1090
No log	7.0588	360	1.1157	0.2989	1.1157	1.0562
No log	7.0980	362	1.0476	0.3650	1.0476	1.0235
No log	7.1373	364	1.0332	0.3596	1.0332	1.0164
No log	7.1765	366	1.0538	0.3081	1.0538	1.0265
No log	7.2157	368	1.1185	0.3033	1.1185	1.0576
No log	7.2549	370	1.1579	0.2851	1.1579	1.0761
No log	7.2941	372	1.1312	0.3231	1.1312	1.0636
No log	7.3333	374	1.1251	0.3231	1.1251	1.0607
No log	7.3725	376	1.1428	0.3290	1.1428	1.0690
No log	7.4118	378	1.1350	0.2920	1.1350	1.0654
No log	7.4510	380	1.0755	0.2945	1.0755	1.0370
No log	7.4902	382	1.1030	0.2486	1.1030	1.0503
No log	7.5294	384	1.1374	0.2687	1.1374	1.0665
No log	7.5686	386	1.2285	0.3071	1.2285	1.1084
No log	7.6078	388	1.3323	0.2961	1.3323	1.1543
No log	7.6471	390	1.3465	0.3024	1.3465	1.1604
No log	7.6863	392	1.2148	0.2574	1.2148	1.1022
No log	7.7255	394	1.0267	0.3879	1.0267	1.0133
No log	7.7647	396	1.0066	0.3596	1.0066	1.0033
No log	7.8039	398	0.9995	0.3979	0.9995	0.9997
No log	7.8431	400	1.0392	0.3013	1.0392	1.0194
No log	7.8824	402	1.0642	0.2511	1.0642	1.0316
No log	7.9216	404	1.0583	0.2511	1.0583	1.0287
No log	7.9608	406	1.0031	0.4119	1.0031	1.0016
No log	8.0	408	0.9886	0.2993	0.9886	0.9943
No log	8.0392	410	1.0172	0.4334	1.0172	1.0086
No log	8.0784	412	1.0120	0.4540	1.0120	1.0060
No log	8.1176	414	1.0522	0.3126	1.0522	1.0258
No log	8.1569	416	1.2013	0.2757	1.2013	1.0960
No log	8.1961	418	1.2577	0.2468	1.2577	1.1215
No log	8.2353	420	1.1748	0.3271	1.1748	1.0839
No log	8.2745	422	1.0434	0.3280	1.0434	1.0215
No log	8.3137	424	1.0216	0.3406	1.0216	1.0107
No log	8.3529	426	1.0788	0.3280	1.0788	1.0386
No log	8.3922	428	1.1139	0.3544	1.1139	1.0554
No log	8.4314	430	1.0990	0.3280	1.0990	1.0483
No log	8.4706	432	1.0362	0.3733	1.0362	1.0180
No log	8.5098	434	1.0210	0.3090	1.0210	1.0104
No log	8.5490	436	1.0235	0.3290	1.0235	1.0117
No log	8.5882	438	1.0542	0.3829	1.0542	1.0268
No log	8.6275	440	1.1622	0.2732	1.1622	1.0780
No log	8.6667	442	1.2210	0.2369	1.2210	1.1050
No log	8.7059	444	1.1381	0.2593	1.1381	1.0668
No log	8.7451	446	1.0937	0.2700	1.0937	1.0458
No log	8.7843	448	1.0447	0.3263	1.0447	1.0221
No log	8.8235	450	1.0403	0.2938	1.0403	1.0199
No log	8.8627	452	1.0769	0.2618	1.0769	1.0377
No log	8.9020	454	1.1253	0.2560	1.1253	1.0608
No log	8.9412	456	1.1545	0.2844	1.1545	1.0745
No log	8.9804	458	1.1523	0.2844	1.1523	1.0735
No log	9.0196	460	1.1115	0.2452	1.1115	1.0543
No log	9.0588	462	1.1014	0.3490	1.1014	1.0495
No log	9.0980	464	1.1144	0.3490	1.1144	1.0557
No log	9.1373	466	1.1776	0.3663	1.1776	1.0852
No log	9.1765	468	1.3229	0.2619	1.3229	1.1502
No log	9.2157	470	1.4097	0.2029	1.4097	1.1873
No log	9.2549	472	1.3013	0.2321	1.3013	1.1407
No log	9.2941	474	1.1438	0.2308	1.1438	1.0695
No log	9.3333	476	1.0921	0.3618	1.0921	1.0450
No log	9.3725	478	1.0898	0.3618	1.0898	1.0439
No log	9.4118	480	1.1141	0.2650	1.1141	1.0555
No log	9.4510	482	1.2060	0.2002	1.2060	1.0982
No log	9.4902	484	1.3188	0.1928	1.3188	1.1484
No log	9.5294	486	1.4093	0.2072	1.4093	1.1872
No log	9.5686	488	1.4138	0.1742	1.4138	1.1890
No log	9.6078	490	1.2538	0.3028	1.2538	1.1197
No log	9.6471	492	1.0972	0.4196	1.0972	1.0475
No log	9.6863	494	1.0857	0.3833	1.0857	1.0420
No log	9.7255	496	1.0645	0.3848	1.0645	1.0317
No log	9.7647	498	1.0166	0.3948	1.0166	1.0083
0.4014	9.8039	500	1.0413	0.3276	1.0413	1.0204
0.4014	9.8431	502	1.1412	0.2961	1.1412	1.0682
0.4014	9.8824	504	1.1746	0.3049	1.1746	1.0838
0.4014	9.9216	506	1.1308	0.3188	1.1308	1.0634
0.4014	9.9608	508	1.0342	0.3128	1.0342	1.0169
0.4014	10.0	510	0.9946	0.3542	0.9946	0.9973
0.4014	10.0392	512	0.9823	0.3542	0.9823	0.9911
0.4014	10.0784	514	0.9834	0.3542	0.9834	0.9916
0.4014	10.1176	516	1.0219	0.3224	1.0219	1.0109
0.4014	10.1569	518	1.0296	0.2844	1.0296	1.0147
0.4014	10.1961	520	0.9965	0.3780	0.9965	0.9982
0.4014	10.2353	522	0.9876	0.3788	0.9876	0.9938
0.4014	10.2745	524	0.9920	0.4077	0.9920	0.9960
0.4014	10.3137	526	1.0292	0.2988	1.0292	1.0145
0.4014	10.3529	528	1.1313	0.3330	1.1313	1.0636
0.4014	10.3922	530	1.2496	0.2465	1.2496	1.1179
0.4014	10.4314	532	1.2959	0.2503	1.2959	1.1384
0.4014	10.4706	534	1.2150	0.2152	1.2150	1.1023
0.4014	10.5098	536	1.1048	0.3128	1.1048	1.0511
0.4014	10.5490	538	1.0307	0.2965	1.0307	1.0152

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1