ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run2_AugV5_k6_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1654
• Qwk: 0.2180
• Mse: 1.1654
• Rmse: 1.0795

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0909	2	4.7406	0.0010	4.7406	2.1773
No log	0.1818	4	2.8840	-0.0189	2.8840	1.6982
No log	0.2727	6	2.0258	-0.0370	2.0258	1.4233
No log	0.3636	8	1.9272	-0.0291	1.9272	1.3882
No log	0.4545	10	2.0507	-0.0158	2.0507	1.4320
No log	0.5455	12	1.6895	0.0610	1.6895	1.2998
No log	0.6364	14	1.5757	0.1226	1.5757	1.2553
No log	0.7273	16	1.6962	0.0227	1.6962	1.3024
No log	0.8182	18	1.8279	0.0414	1.8279	1.3520
No log	0.9091	20	1.7090	0.0227	1.7090	1.3073
No log	1.0	22	1.2913	0.1165	1.2913	1.1364
No log	1.0909	24	1.3575	0.0339	1.3575	1.1651
No log	1.1818	26	1.7152	0.0	1.7152	1.3097
No log	1.2727	28	1.6861	0.0414	1.6861	1.2985
No log	1.3636	30	1.3506	0.1371	1.3506	1.1622
No log	1.4545	32	1.2288	0.1470	1.2288	1.1085
No log	1.5455	34	1.4274	0.2481	1.4274	1.1947
No log	1.6364	36	1.7882	0.1835	1.7882	1.3372
No log	1.7273	38	1.5084	0.1774	1.5084	1.2282
No log	1.8182	40	1.3401	0.1725	1.3401	1.1576
No log	1.9091	42	1.1259	0.3354	1.1259	1.0611
No log	2.0	44	1.1498	0.2210	1.1498	1.0723
No log	2.0909	46	1.4412	0.1427	1.4412	1.2005
No log	2.1818	48	1.4219	0.1690	1.4219	1.1924
No log	2.2727	50	1.3220	0.2141	1.3220	1.1498
No log	2.3636	52	1.2522	0.2570	1.2522	1.1190
No log	2.4545	54	1.3061	0.2923	1.3061	1.1428
No log	2.5455	56	1.6194	0.2537	1.6194	1.2726
No log	2.6364	58	1.5573	0.2583	1.5573	1.2479
No log	2.7273	60	1.4824	0.1984	1.4824	1.2175
No log	2.8182	62	1.2790	0.1912	1.2790	1.1309
No log	2.9091	64	1.2147	0.1912	1.2147	1.1021
No log	3.0	66	1.1352	0.2372	1.1352	1.0655
No log	3.0909	68	1.1740	0.2572	1.1740	1.0835
No log	3.1818	70	1.4529	0.1637	1.4529	1.2054
No log	3.2727	72	1.7159	0.1412	1.7159	1.3099
No log	3.3636	74	1.5060	0.1916	1.5060	1.2272
No log	3.4545	76	1.3765	0.1972	1.3765	1.1732
No log	3.5455	78	1.2179	0.2191	1.2179	1.1036
No log	3.6364	80	1.2098	0.2233	1.2098	1.0999
No log	3.7273	82	1.2840	0.2320	1.2840	1.1332
No log	3.8182	84	1.3611	0.2632	1.3611	1.1667
No log	3.9091	86	1.3091	0.2472	1.3091	1.1442
No log	4.0	88	1.1678	0.3092	1.1678	1.0806
No log	4.0909	90	1.1550	0.3373	1.1550	1.0747
No log	4.1818	92	1.3733	0.3281	1.3733	1.1719
No log	4.2727	94	1.4483	0.3073	1.4483	1.2035
No log	4.3636	96	1.1977	0.3008	1.1977	1.0944
No log	4.4545	98	1.0968	0.3810	1.0968	1.0473
No log	4.5455	100	1.1502	0.2361	1.1502	1.0725
No log	4.6364	102	1.2529	0.2797	1.2529	1.1193
No log	4.7273	104	1.1121	0.2839	1.1121	1.0546
No log	4.8182	106	1.1347	0.3443	1.1347	1.0652
No log	4.9091	108	1.1179	0.3876	1.1179	1.0573
No log	5.0	110	1.3136	0.1830	1.3136	1.1461
No log	5.0909	112	1.4313	0.2961	1.4313	1.1964
No log	5.1818	114	1.1731	0.2625	1.1731	1.0831
No log	5.2727	116	1.1153	0.3545	1.1153	1.0561
No log	5.3636	118	1.0832	0.3243	1.0832	1.0408
No log	5.4545	120	1.1853	0.2919	1.1853	1.0887
No log	5.5455	122	1.3281	0.3003	1.3281	1.1524
No log	5.6364	124	1.1413	0.2964	1.1413	1.0683
No log	5.7273	126	1.0584	0.3237	1.0584	1.0288
No log	5.8182	128	1.1585	0.3197	1.1585	1.0764
No log	5.9091	130	1.2427	0.3174	1.2427	1.1148
No log	6.0	132	1.2427	0.3475	1.2427	1.1148
No log	6.0909	134	1.1090	0.3193	1.1090	1.0531
No log	6.1818	136	1.1612	0.3050	1.1612	1.0776
No log	6.2727	138	1.1467	0.3534	1.1467	1.0709
No log	6.3636	140	1.3432	0.2525	1.3432	1.1589
No log	6.4545	142	1.8546	0.1664	1.8546	1.3618
No log	6.5455	144	1.8502	0.1664	1.8502	1.3602
No log	6.6364	146	1.4041	0.2443	1.4041	1.1849
No log	6.7273	148	1.2937	0.3047	1.2937	1.1374
No log	6.8182	150	1.2145	0.3028	1.2145	1.1020
No log	6.9091	152	1.2080	0.2961	1.2080	1.0991
No log	7.0	154	1.2361	0.3028	1.2361	1.1118
No log	7.0909	156	1.2023	0.3028	1.2023	1.0965
No log	7.1818	158	1.1247	0.2281	1.1247	1.0605
No log	7.2727	160	1.1107	0.2610	1.1107	1.0539
No log	7.3636	162	1.1585	0.2219	1.1585	1.0764
No log	7.4545	164	1.2061	0.3226	1.2061	1.0982
No log	7.5455	166	1.1350	0.2524	1.1350	1.0654
No log	7.6364	168	1.0690	0.3596	1.0690	1.0339
No log	7.7273	170	1.0680	0.3013	1.0680	1.0334
No log	7.8182	172	1.1097	0.2588	1.1097	1.0534
No log	7.9091	174	1.0998	0.2358	1.0998	1.0487
No log	8.0	176	1.1330	0.2169	1.1330	1.0644
No log	8.0909	178	1.1456	0.2169	1.1456	1.0703
No log	8.1818	180	1.1365	0.2169	1.1365	1.0661
No log	8.2727	182	1.2070	0.2130	1.2070	1.0986
No log	8.3636	184	1.3119	0.2405	1.3119	1.1454
No log	8.4545	186	1.1570	0.2624	1.1570	1.0756
No log	8.5455	188	1.0779	0.2663	1.0779	1.0382
No log	8.6364	190	1.0847	0.2284	1.0847	1.0415
No log	8.7273	192	1.2108	0.2734	1.2108	1.1003
No log	8.8182	194	1.2355	0.2417	1.2355	1.1115
No log	8.9091	196	1.1666	0.2417	1.1666	1.0801
No log	9.0	198	1.0995	0.2614	1.0995	1.0486
No log	9.0909	200	1.1080	0.2263	1.1080	1.0526
No log	9.1818	202	1.1296	0.2035	1.1296	1.0628
No log	9.2727	204	1.2522	0.3005	1.2522	1.1190
No log	9.3636	206	1.1666	0.2627	1.1666	1.0801
No log	9.4545	208	1.0478	0.3154	1.0478	1.0236
No log	9.5455	210	1.0220	0.3346	1.0220	1.0109
No log	9.6364	212	1.0493	0.2824	1.0493	1.0244
No log	9.7273	214	1.0764	0.3010	1.0764	1.0375
No log	9.8182	216	1.0711	0.3010	1.0711	1.0349
No log	9.9091	218	1.0535	0.2964	1.0535	1.0264
No log	10.0	220	1.0844	0.2891	1.0844	1.0414
No log	10.0909	222	1.1676	0.3124	1.1676	1.0805
No log	10.1818	224	1.1466	0.2609	1.1466	1.0708
No log	10.2727	226	1.0955	0.3397	1.0955	1.0467
No log	10.3636	228	1.0874	0.3126	1.0874	1.0428
No log	10.4545	230	1.0662	0.2682	1.0662	1.0326
No log	10.5455	232	1.0651	0.2682	1.0651	1.0320
No log	10.6364	234	1.0809	0.2682	1.0809	1.0397
No log	10.7273	236	1.1789	0.3100	1.1789	1.0857
No log	10.8182	238	1.1911	0.3008	1.1911	1.0914
No log	10.9091	240	1.1251	0.2637	1.1251	1.0607
No log	11.0	242	1.1389	0.2637	1.1389	1.0672
No log	11.0909	244	1.2298	0.2451	1.2298	1.1090
No log	11.1818	246	1.2826	0.2417	1.2826	1.1325
No log	11.2727	248	1.4518	0.2314	1.4518	1.2049
No log	11.3636	250	1.4334	0.2191	1.4334	1.1972
No log	11.4545	252	1.3362	0.1928	1.3362	1.1559
No log	11.5455	254	1.1486	0.2685	1.1486	1.0717
No log	11.6364	256	1.0946	0.2739	1.0946	1.0462
No log	11.7273	258	1.1053	0.2677	1.1053	1.0513
No log	11.8182	260	1.1369	0.3555	1.1369	1.0663
No log	11.9091	262	1.1389	0.3208	1.1389	1.0672
No log	12.0	264	1.2866	0.2632	1.2866	1.1343
No log	12.0909	266	1.3580	0.2602	1.3580	1.1653
No log	12.1818	268	1.1932	0.2438	1.1932	1.0923
No log	12.2727	270	1.1037	0.2942	1.1037	1.0506
No log	12.3636	272	1.1161	0.2917	1.1161	1.0565
No log	12.4545	274	1.1458	0.2896	1.1458	1.0704
No log	12.5455	276	1.1163	0.2605	1.1163	1.0565
No log	12.6364	278	1.0869	0.2115	1.0869	1.0426
No log	12.7273	280	1.0850	0.2843	1.0850	1.0416
No log	12.8182	282	1.0901	0.2499	1.0901	1.0441
No log	12.9091	284	1.1182	0.2118	1.1182	1.0575
No log	13.0	286	1.2483	0.2280	1.2483	1.1173
No log	13.0909	288	1.3145	0.2690	1.3145	1.1465
No log	13.1818	290	1.1933	0.2141	1.1933	1.0924
No log	13.2727	292	1.1203	0.2115	1.1203	1.0584
No log	13.3636	294	1.1028	0.2306	1.1028	1.0502
No log	13.4545	296	1.0979	0.2402	1.0979	1.0478
No log	13.5455	298	1.1122	0.2021	1.1122	1.0546
No log	13.6364	300	1.2367	0.2565	1.2367	1.1121
No log	13.7273	302	1.3328	0.1568	1.3328	1.1545
No log	13.8182	304	1.2382	0.2473	1.2382	1.1128
No log	13.9091	306	1.1200	0.1873	1.1200	1.0583
No log	14.0	308	1.1133	0.2176	1.1133	1.0551
No log	14.0909	310	1.1148	0.1830	1.1148	1.0558
No log	14.1818	312	1.0877	0.2893	1.0877	1.0429
No log	14.2727	314	1.1278	0.2169	1.1278	1.0620
No log	14.3636	316	1.1405	0.1898	1.1405	1.0679
No log	14.4545	318	1.1036	0.2633	1.1036	1.0505
No log	14.5455	320	1.0793	0.3205	1.0793	1.0389
No log	14.6364	322	1.0851	0.3371	1.0851	1.0417
No log	14.7273	324	1.1466	0.1898	1.1466	1.0708
No log	14.8182	326	1.2750	0.1965	1.2750	1.1292
No log	14.9091	328	1.2358	0.2002	1.2358	1.1117
No log	15.0	330	1.1229	0.2169	1.1229	1.0597
No log	15.0909	332	1.0752	0.3525	1.0752	1.0369
No log	15.1818	334	1.0806	0.3496	1.0806	1.0395
No log	15.2727	336	1.0959	0.2897	1.0959	1.0468
No log	15.3636	338	1.1750	0.2627	1.1750	1.0840
No log	15.4545	340	1.3142	0.2450	1.3142	1.1464
No log	15.5455	342	1.5319	0.2718	1.5319	1.2377
No log	15.6364	344	1.6433	0.1556	1.6433	1.2819
No log	15.7273	346	1.5037	0.2353	1.5037	1.2263
No log	15.8182	348	1.3087	0.1884	1.3087	1.1440
No log	15.9091	350	1.1794	0.2333	1.1794	1.0860
No log	16.0	352	1.1781	0.2687	1.1781	1.0854
No log	16.0909	354	1.1629	0.2501	1.1629	1.0784
No log	16.1818	356	1.1555	0.2501	1.1555	1.0750
No log	16.2727	358	1.2146	0.1779	1.2146	1.1021
No log	16.3636	360	1.2936	0.2503	1.2936	1.1373
No log	16.4545	362	1.3453	0.2634	1.3453	1.1599
No log	16.5455	364	1.2422	0.1743	1.2422	1.1145
No log	16.6364	366	1.1271	0.2315	1.1271	1.0616
No log	16.7273	368	1.1120	0.2210	1.1120	1.0545
No log	16.8182	370	1.1228	0.2210	1.1228	1.0596
No log	16.9091	372	1.1505	0.2505	1.1505	1.0726
No log	17.0	374	1.2323	0.1371	1.2323	1.1101
No log	17.0909	376	1.3235	0.1743	1.3235	1.1504
No log	17.1818	378	1.3285	0.1743	1.3285	1.1526
No log	17.2727	380	1.2416	0.1636	1.2416	1.1143
No log	17.3636	382	1.1665	0.1943	1.1665	1.0800
No log	17.4545	384	1.1475	0.1889	1.1475	1.0712
No log	17.5455	386	1.1701	0.1943	1.1701	1.0817
No log	17.6364	388	1.2355	0.2705	1.2355	1.1115
No log	17.7273	390	1.3846	0.2065	1.3846	1.1767
No log	17.8182	392	1.3874	0.2371	1.3874	1.1779
No log	17.9091	394	1.2943	0.2763	1.2943	1.1377
No log	18.0	396	1.1746	0.2770	1.1746	1.0838
No log	18.0909	398	1.1243	0.2770	1.1243	1.0603
No log	18.1818	400	1.0876	0.3077	1.0876	1.0429
No log	18.2727	402	1.0608	0.2786	1.0608	1.0300
No log	18.3636	404	1.0956	0.2220	1.0956	1.0467
No log	18.4545	406	1.2148	0.2465	1.2148	1.1022
No log	18.5455	408	1.3130	0.1979	1.3130	1.1459
No log	18.6364	410	1.2834	0.2065	1.2834	1.1329
No log	18.7273	412	1.1458	0.2295	1.1458	1.0704
No log	18.8182	414	1.0682	0.2897	1.0682	1.0336
No log	18.9091	416	1.0527	0.3387	1.0527	1.0260
No log	19.0	418	1.0575	0.3415	1.0575	1.0283
No log	19.0909	420	1.1197	0.2825	1.1197	1.0581
No log	19.1818	422	1.2490	0.1979	1.2490	1.1176
No log	19.2727	424	1.2891	0.2286	1.2891	1.1354
No log	19.3636	426	1.2511	0.2201	1.2511	1.1185
No log	19.4545	428	1.1618	0.2937	1.1618	1.0779
No log	19.5455	430	1.1405	0.2797	1.1405	1.0679
No log	19.6364	432	1.1304	0.2984	1.1304	1.0632
No log	19.7273	434	1.1756	0.2752	1.1756	1.0842
No log	19.8182	436	1.2340	0.2736	1.2340	1.1108
No log	19.9091	438	1.2233	0.2825	1.2233	1.1060
No log	20.0	440	1.2027	0.2431	1.2027	1.0967
No log	20.0909	442	1.1648	0.2752	1.1648	1.0793
No log	20.1818	444	1.1355	0.2844	1.1355	1.0656
No log	20.2727	446	1.1408	0.2844	1.1408	1.0681
No log	20.3636	448	1.1366	0.2864	1.1366	1.0661
No log	20.4545	450	1.1886	0.2844	1.1886	1.0902
No log	20.5455	452	1.1905	0.2937	1.1905	1.0911
No log	20.6364	454	1.1661	0.2937	1.1661	1.0799
No log	20.7273	456	1.1157	0.3144	1.1157	1.0563
No log	20.8182	458	1.0871	0.2311	1.0871	1.0426
No log	20.9091	460	1.0901	0.2637	1.0901	1.0441
No log	21.0	462	1.1374	0.3124	1.1374	1.0665
No log	21.0909	464	1.2507	0.2292	1.2507	1.1184
No log	21.1818	466	1.4136	0.1585	1.4136	1.1890
No log	21.2727	468	1.4794	0.1877	1.4794	1.2163
No log	21.3636	470	1.3454	0.2875	1.3454	1.1599
No log	21.4545	472	1.1907	0.2657	1.1907	1.0912
No log	21.5455	474	1.0963	0.2777	1.0963	1.0471
No log	21.6364	476	1.0604	0.2843	1.0604	1.0298
No log	21.7273	478	1.0579	0.3190	1.0579	1.0285
No log	21.8182	480	1.0743	0.2824	1.0743	1.0365
No log	21.9091	482	1.1305	0.2270	1.1305	1.0633
No log	22.0	484	1.1650	0.2180	1.1650	1.0793
No log	22.0909	486	1.1728	0.2191	1.1728	1.0829
No log	22.1818	488	1.2086	0.1636	1.2086	1.0994
No log	22.2727	490	1.1855	0.2191	1.1855	1.0888
No log	22.3636	492	1.1316	0.2270	1.1316	1.0638
No log	22.4545	494	1.0861	0.2892	1.0861	1.0422
No log	22.5455	496	1.0887	0.3275	1.0887	1.0434
No log	22.6364	498	1.1170	0.3555	1.1170	1.0569
0.2684	22.7273	500	1.1407	0.2608	1.1407	1.0680
0.2684	22.8182	502	1.1323	0.3237	1.1323	1.0641
0.2684	22.9091	504	1.1266	0.3036	1.1266	1.0614
0.2684	23.0	506	1.1674	0.2270	1.1674	1.0805
0.2684	23.0909	508	1.1947	0.1632	1.1947	1.0930
0.2684	23.1818	510	1.2087	0.1773	1.2087	1.0994
0.2684	23.2727	512	1.2038	0.1862	1.2038	1.0972
0.2684	23.3636	514	1.1654	0.2180	1.1654	1.0795

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1