ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run2_AugV5_k9_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0372
• Qwk: 0.3130
• Mse: 1.0372
• Rmse: 1.0184

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	4.6236	-0.0191	4.6236	2.1503
No log	0.0909	4	2.9635	-0.0519	2.9635	1.7215
No log	0.1364	6	1.9633	0.0062	1.9633	1.4012
No log	0.1818	8	1.9611	0.0328	1.9611	1.4004
No log	0.2273	10	1.6123	0.0205	1.6123	1.2698
No log	0.2727	12	1.3128	0.1422	1.3128	1.1458
No log	0.3182	14	1.2354	0.1081	1.2354	1.1115
No log	0.3636	16	1.3480	0.0300	1.3480	1.1610
No log	0.4091	18	1.3911	0.0091	1.3911	1.1794
No log	0.4545	20	1.7277	-0.0407	1.7277	1.3144
No log	0.5	22	1.7495	-0.0259	1.7495	1.3227
No log	0.5455	24	1.3203	0.1206	1.3203	1.1490
No log	0.5909	26	1.2981	0.0434	1.2981	1.1393
No log	0.6364	28	1.4906	0.0165	1.4906	1.2209
No log	0.6818	30	2.1008	-0.0291	2.1008	1.4494
No log	0.7273	32	2.1697	0.0091	2.1697	1.4730
No log	0.7727	34	1.7488	0.0774	1.7488	1.3224
No log	0.8182	36	1.6775	0.0489	1.6775	1.2952
No log	0.8636	38	1.7276	0.0876	1.7276	1.3144
No log	0.9091	40	1.5530	0.0911	1.5530	1.2462
No log	0.9545	42	1.4577	0.1257	1.4577	1.2073
No log	1.0	44	1.4695	0.1404	1.4695	1.2122
No log	1.0455	46	1.5000	0.1784	1.5000	1.2248
No log	1.0909	48	1.4331	0.1257	1.4331	1.1971
No log	1.1364	50	1.2382	0.2560	1.2382	1.1128
No log	1.1818	52	1.2410	0.2445	1.2410	1.1140
No log	1.2273	54	1.4709	0.2435	1.4709	1.2128
No log	1.2727	56	1.4501	0.2836	1.4501	1.2042
No log	1.3182	58	1.2200	0.3076	1.2200	1.1046
No log	1.3636	60	1.2405	0.3745	1.2405	1.1138
No log	1.4091	62	1.3288	0.3233	1.3288	1.1528
No log	1.4545	64	1.2137	0.3616	1.2137	1.1017
No log	1.5	66	1.1633	0.2839	1.1633	1.0786
No log	1.5455	68	1.3549	0.2940	1.3549	1.1640
No log	1.5909	70	1.4192	0.2366	1.4192	1.1913
No log	1.6364	72	1.1820	0.2324	1.1820	1.0872
No log	1.6818	74	1.1057	0.2474	1.1057	1.0515
No log	1.7273	76	1.1188	0.2523	1.1188	1.0577
No log	1.7727	78	1.1422	0.2523	1.1422	1.0687
No log	1.8182	80	1.2573	0.2361	1.2573	1.1213
No log	1.8636	82	1.4423	0.2503	1.4423	1.2010
No log	1.9091	84	1.4291	0.2572	1.4291	1.1955
No log	1.9545	86	1.2749	0.2839	1.2749	1.1291
No log	2.0	88	1.2366	0.3117	1.2366	1.1120
No log	2.0455	90	1.3988	0.2731	1.3988	1.1827
No log	2.0909	92	1.7601	0.1752	1.7601	1.3267
No log	2.1364	94	1.5586	0.2075	1.5586	1.2484
No log	2.1818	96	1.1613	0.2654	1.1613	1.0777
No log	2.2273	98	1.1761	0.4114	1.1761	1.0845
No log	2.2727	100	1.2727	0.3637	1.2727	1.1282
No log	2.3182	102	1.1598	0.2502	1.1598	1.0769
No log	2.3636	104	1.4309	0.2690	1.4309	1.1962
No log	2.4091	106	1.8101	0.2020	1.8101	1.3454
No log	2.4545	108	1.6494	0.2742	1.6494	1.2843
No log	2.5	110	1.2643	0.1858	1.2643	1.1244
No log	2.5455	112	1.2173	0.2326	1.2173	1.1033
No log	2.5909	114	1.2501	0.3127	1.2501	1.1181
No log	2.6364	116	1.1714	0.2390	1.1714	1.0823
No log	2.6818	118	1.2244	0.1761	1.2244	1.1065
No log	2.7273	120	1.3632	0.2242	1.3632	1.1676
No log	2.7727	122	1.2832	0.2098	1.2832	1.1328
No log	2.8182	124	1.1590	0.1911	1.1590	1.0766
No log	2.8636	126	1.1704	0.1699	1.1704	1.0819
No log	2.9091	128	1.2074	0.1840	1.2074	1.0988
No log	2.9545	130	1.2013	0.2418	1.2013	1.0960
No log	3.0	132	1.5183	0.2297	1.5183	1.2322
No log	3.0455	134	1.8181	0.2141	1.8181	1.3484
No log	3.0909	136	1.6152	0.2493	1.6152	1.2709
No log	3.1364	138	1.3449	0.2632	1.3449	1.1597
No log	3.1818	140	1.2105	0.2418	1.2105	1.1002
No log	3.2273	142	1.1388	0.2691	1.1388	1.0671
No log	3.2727	144	1.1138	0.2784	1.1138	1.0554
No log	3.3182	146	1.1256	0.2555	1.1256	1.0609
No log	3.3636	148	1.1186	0.2221	1.1186	1.0576
No log	3.4091	150	1.0675	0.2850	1.0675	1.0332
No log	3.4545	152	1.0755	0.3486	1.0755	1.0371
No log	3.5	154	1.1293	0.2906	1.1293	1.0627
No log	3.5455	156	1.1804	0.4381	1.1804	1.0865
No log	3.5909	158	1.3461	0.4824	1.3461	1.1602
No log	3.6364	160	1.4763	0.3861	1.4763	1.2150
No log	3.6818	162	1.4556	0.3898	1.4556	1.2065
No log	3.7273	164	1.2862	0.4160	1.2862	1.1341
No log	3.7727	166	1.2573	0.3056	1.2573	1.1213
No log	3.8182	168	1.2683	0.2418	1.2683	1.1262
No log	3.8636	170	1.3128	0.3056	1.3128	1.1458
No log	3.9091	172	1.3465	0.2991	1.3465	1.1604
No log	3.9545	174	1.3118	0.2411	1.3118	1.1453
No log	4.0	176	1.2953	0.2311	1.2953	1.1381
No log	4.0455	178	1.2942	0.2916	1.2942	1.1376
No log	4.0909	180	1.2801	0.2672	1.2801	1.1314
No log	4.1364	182	1.3084	0.2707	1.3084	1.1438
No log	4.1818	184	1.3287	0.3389	1.3287	1.1527
No log	4.2273	186	1.2725	0.3266	1.2725	1.1280
No log	4.2727	188	1.2394	0.2542	1.2394	1.1133
No log	4.3182	190	1.2507	0.2979	1.2507	1.1183
No log	4.3636	192	1.1880	0.2908	1.1880	1.0899
No log	4.4091	194	1.1663	0.3468	1.1663	1.0800
No log	4.4545	196	1.1695	0.3261	1.1695	1.0814
No log	4.5	198	1.1829	0.3172	1.1829	1.0876
No log	4.5455	200	1.1978	0.1915	1.1978	1.0944
No log	4.5909	202	1.2831	0.2654	1.2831	1.1328
No log	4.6364	204	1.2458	0.3237	1.2458	1.1162
No log	4.6818	206	1.2431	0.3199	1.2431	1.1149
No log	4.7273	208	1.2203	0.2869	1.2203	1.1047
No log	4.7727	210	1.2550	0.2120	1.2550	1.1202
No log	4.8182	212	1.4385	0.3021	1.4385	1.1994
No log	4.8636	214	1.3914	0.2339	1.3914	1.1796
No log	4.9091	216	1.2195	0.1829	1.2195	1.1043
No log	4.9545	218	1.2077	0.2497	1.2077	1.0990
No log	5.0	220	1.2334	0.2497	1.2334	1.1106
No log	5.0455	222	1.2463	0.3562	1.2463	1.1164
No log	5.0909	224	1.4963	0.2125	1.4963	1.2232
No log	5.1364	226	1.5974	0.2745	1.5974	1.2639
No log	5.1818	228	1.3662	0.2775	1.3662	1.1688
No log	5.2273	230	1.1368	0.3384	1.1368	1.0662
No log	5.2727	232	1.1042	0.3040	1.1042	1.0508
No log	5.3182	234	1.1125	0.3107	1.1125	1.0547
No log	5.3636	236	1.0845	0.3310	1.0845	1.0414
No log	5.4091	238	1.0370	0.3014	1.0370	1.0183
No log	5.4545	240	1.0877	0.2452	1.0877	1.0429
No log	5.5	242	1.0657	0.2871	1.0657	1.0323
No log	5.5455	244	1.0307	0.3369	1.0307	1.0152
No log	5.5909	246	1.0498	0.4144	1.0498	1.0246
No log	5.6364	248	1.0410	0.4124	1.0410	1.0203
No log	5.6818	250	1.0415	0.3516	1.0415	1.0205
No log	5.7273	252	1.1185	0.3471	1.1185	1.0576
No log	5.7727	254	1.0859	0.3862	1.0859	1.0421
No log	5.8182	256	1.0356	0.4196	1.0356	1.0177
No log	5.8636	258	1.0525	0.3522	1.0525	1.0259
No log	5.9091	260	1.0677	0.2845	1.0677	1.0333
No log	5.9545	262	1.0343	0.3087	1.0343	1.0170
No log	6.0	264	0.9955	0.4601	0.9955	0.9978
No log	6.0455	266	1.0057	0.3556	1.0057	1.0028
No log	6.0909	268	1.0760	0.4090	1.0760	1.0373
No log	6.1364	270	1.0400	0.4255	1.0400	1.0198
No log	6.1818	272	0.9832	0.4385	0.9832	0.9916
No log	6.2273	274	1.0121	0.3468	1.0121	1.0060
No log	6.2727	276	1.0188	0.4311	1.0188	1.0094
No log	6.3182	278	1.0644	0.5063	1.0644	1.0317
No log	6.3636	280	1.1502	0.4254	1.1502	1.0725
No log	6.4091	282	1.1346	0.4275	1.1346	1.0652
No log	6.4545	284	1.0835	0.4141	1.0835	1.0409
No log	6.5	286	1.0830	0.3459	1.0830	1.0407
No log	6.5455	288	1.0688	0.3353	1.0688	1.0338
No log	6.5909	290	1.0644	0.2115	1.0644	1.0317
No log	6.6364	292	1.1039	0.2605	1.1039	1.0507
No log	6.6818	294	1.1027	0.2605	1.1027	1.0501
No log	6.7273	296	1.0874	0.2461	1.0874	1.0428
No log	6.7727	298	1.0564	0.2824	1.0564	1.0278
No log	6.8182	300	1.0703	0.3304	1.0703	1.0345
No log	6.8636	302	1.1098	0.2933	1.1098	1.0535
No log	6.9091	304	1.1678	0.3672	1.1678	1.0807
No log	6.9545	306	1.2389	0.4887	1.2389	1.1131
No log	7.0	308	1.2254	0.4081	1.2254	1.1070
No log	7.0455	310	1.1879	0.2515	1.1879	1.0899
No log	7.0909	312	1.1448	0.2583	1.1448	1.0700
No log	7.1364	314	1.0920	0.2125	1.0920	1.0450
No log	7.1818	316	1.0994	0.2550	1.0994	1.0485
No log	7.2273	318	1.1049	0.2941	1.1049	1.0512
No log	7.2727	320	1.0962	0.2550	1.0962	1.0470
No log	7.3182	322	1.1061	0.2823	1.1061	1.0517
No log	7.3636	324	1.0854	0.2993	1.0854	1.0418
No log	7.4091	326	1.0970	0.2931	1.0970	1.0474
No log	7.4545	328	1.0959	0.3601	1.0959	1.0468
No log	7.5	330	1.1018	0.3514	1.1018	1.0497
No log	7.5455	332	1.1270	0.3012	1.1270	1.0616
No log	7.5909	334	1.1560	0.3056	1.1560	1.0752
No log	7.6364	336	1.1708	0.2805	1.1708	1.0820
No log	7.6818	338	1.0902	0.3796	1.0902	1.0441
No log	7.7273	340	1.0976	0.3041	1.0976	1.0477
No log	7.7727	342	1.1454	0.3458	1.1454	1.0702
No log	7.8182	344	1.0864	0.2912	1.0864	1.0423
No log	7.8636	346	1.0409	0.3897	1.0409	1.0203
No log	7.9091	348	1.0399	0.3415	1.0399	1.0198
No log	7.9545	350	1.0482	0.4144	1.0482	1.0238
No log	8.0	352	1.0600	0.3794	1.0600	1.0296
No log	8.0455	354	1.0437	0.3225	1.0437	1.0216
No log	8.0909	356	1.0471	0.3415	1.0471	1.0233
No log	8.1364	358	1.0569	0.3237	1.0569	1.0281
No log	8.1818	360	1.0494	0.3788	1.0494	1.0244
No log	8.2273	362	1.0416	0.3445	1.0416	1.0206
No log	8.2727	364	1.0552	0.3561	1.0552	1.0272
No log	8.3182	366	1.0417	0.3176	1.0417	1.0206
No log	8.3636	368	1.0360	0.2941	1.0360	1.0178
No log	8.4091	370	1.0347	0.2941	1.0347	1.0172
No log	8.4545	372	1.0135	0.3275	1.0135	1.0067
No log	8.5	374	1.0223	0.3919	1.0223	1.0111
No log	8.5455	376	1.0219	0.3392	1.0219	1.0109
No log	8.5909	378	1.0281	0.3392	1.0281	1.0140
No log	8.6364	380	1.0267	0.3981	1.0267	1.0132
No log	8.6818	382	1.0738	0.3812	1.0738	1.0362
No log	8.7273	384	1.0873	0.3439	1.0873	1.0427
No log	8.7727	386	1.0393	0.2988	1.0393	1.0195
No log	8.8182	388	1.0295	0.2728	1.0295	1.0146
No log	8.8636	390	1.0452	0.2988	1.0452	1.0223
No log	8.9091	392	1.1449	0.2961	1.1449	1.0700
No log	8.9545	394	1.1752	0.2870	1.1752	1.0841
No log	9.0	396	1.0767	0.3827	1.0767	1.0376
No log	9.0455	398	1.0324	0.3811	1.0324	1.0161
No log	9.0909	400	1.0228	0.3811	1.0228	1.0113
No log	9.1364	402	1.0288	0.2988	1.0288	1.0143
No log	9.1818	404	1.1171	0.3028	1.1171	1.0569
No log	9.2273	406	1.2594	0.3562	1.2594	1.1222
No log	9.2727	408	1.2305	0.3220	1.2305	1.1093
No log	9.3182	410	1.0992	0.3142	1.0992	1.0484
No log	9.3636	412	1.0234	0.3459	1.0234	1.0116
No log	9.4091	414	1.0535	0.3382	1.0535	1.0264
No log	9.4545	416	1.0486	0.3038	1.0486	1.0240
No log	9.5	418	1.0709	0.3741	1.0709	1.0348
No log	9.5455	420	1.2103	0.3007	1.2103	1.1001
No log	9.5909	422	1.2333	0.2962	1.2333	1.1105
No log	9.6364	424	1.1146	0.2511	1.1146	1.0557
No log	9.6818	426	1.0421	0.3039	1.0421	1.0209
No log	9.7273	428	1.0583	0.3396	1.0583	1.0287
No log	9.7727	430	1.0615	0.3396	1.0615	1.0303
No log	9.8182	432	1.0480	0.2661	1.0480	1.0237
No log	9.8636	434	1.0779	0.2700	1.0779	1.0382
No log	9.9091	436	1.1605	0.3050	1.1605	1.0773
No log	9.9545	438	1.1589	0.3050	1.1589	1.0765
No log	10.0	440	1.0626	0.3218	1.0626	1.0308
No log	10.0455	442	1.0289	0.2931	1.0289	1.0144
No log	10.0909	444	1.0564	0.4166	1.0564	1.0278
No log	10.1364	446	1.1130	0.3438	1.1130	1.0550
No log	10.1818	448	1.0699	0.3686	1.0699	1.0344
No log	10.2273	450	1.0196	0.3408	1.0196	1.0097
No log	10.2727	452	1.0114	0.3059	1.0114	1.0057
No log	10.3182	454	1.0543	0.2938	1.0543	1.0268
No log	10.3636	456	1.1457	0.3291	1.1457	1.0704
No log	10.4091	458	1.1420	0.3611	1.1420	1.0687
No log	10.4545	460	1.0432	0.3719	1.0432	1.0214
No log	10.5	462	0.9881	0.4514	0.9881	0.9940
No log	10.5455	464	0.9790	0.3384	0.9790	0.9895
No log	10.5909	466	0.9771	0.3590	0.9771	0.9885
No log	10.6364	468	0.9788	0.3128	0.9788	0.9894
No log	10.6818	470	1.0054	0.3773	1.0054	1.0027
No log	10.7273	472	1.0008	0.3773	1.0008	1.0004
No log	10.7727	474	1.0105	0.3952	1.0105	1.0053
No log	10.8182	476	0.9778	0.3701	0.9778	0.9888
No log	10.8636	478	0.9617	0.3590	0.9617	0.9806
No log	10.9091	480	0.9558	0.3590	0.9558	0.9776
No log	10.9545	482	0.9548	0.3590	0.9548	0.9771
No log	11.0	484	0.9546	0.4064	0.9546	0.9770
No log	11.0455	486	0.9884	0.3433	0.9884	0.9942
No log	11.0909	488	1.0545	0.3052	1.0545	1.0269
No log	11.1364	490	1.0128	0.3100	1.0128	1.0064
No log	11.1818	492	0.9631	0.3869	0.9631	0.9814
No log	11.2273	494	0.9482	0.4160	0.9482	0.9738
No log	11.2727	496	0.9523	0.4064	0.9523	0.9759
No log	11.3182	498	0.9933	0.3448	0.9933	0.9966
0.3245	11.3636	500	1.0289	0.3273	1.0289	1.0144
0.3245	11.4091	502	1.0507	0.3121	1.0507	1.0250
0.3245	11.4545	504	1.0315	0.3010	1.0315	1.0156
0.3245	11.5	506	1.0069	0.2941	1.0069	1.0035
0.3245	11.5455	508	1.0364	0.2263	1.0364	1.0180
0.3245	11.5909	510	1.0372	0.3130	1.0372	1.0184

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1