ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run2_AugV5_k12_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2841
• Qwk: 0.1158
• Mse: 1.2841
• Rmse: 1.1332

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0377	2	3.1547	-0.0341	3.1547	1.7761
No log	0.0755	4	1.6949	0.0255	1.6949	1.3019
No log	0.1132	6	0.9501	0.0418	0.9501	0.9747
No log	0.1509	8	0.7525	0.1915	0.7525	0.8675
No log	0.1887	10	0.6077	0.0071	0.6077	0.7795
No log	0.2264	12	0.6680	-0.0732	0.6680	0.8173
No log	0.2642	14	0.7703	-0.2810	0.7703	0.8777
No log	0.3019	16	0.8278	-0.0872	0.8278	0.9099
No log	0.3396	18	0.8166	-0.0090	0.8166	0.9037
No log	0.3774	20	0.8066	0.0	0.8066	0.8981
No log	0.4151	22	0.8663	-0.0081	0.8663	0.9308
No log	0.4528	24	0.7294	0.0952	0.7294	0.8540
No log	0.4906	26	0.6440	0.0	0.6440	0.8025
No log	0.5283	28	0.6910	0.0	0.6910	0.8313
No log	0.5660	30	0.7556	0.0	0.7556	0.8693
No log	0.6038	32	0.8173	-0.0133	0.8173	0.9040
No log	0.6415	34	0.8208	0.0968	0.8208	0.9060
No log	0.6792	36	0.7278	-0.0560	0.7278	0.8531
No log	0.7170	38	0.6938	0.0	0.6938	0.8329
No log	0.7547	40	0.6769	0.0	0.6769	0.8227
No log	0.7925	42	0.6617	0.0388	0.6617	0.8134
No log	0.8302	44	0.7604	0.0164	0.7604	0.8720
No log	0.8679	46	0.7922	-0.0667	0.7922	0.8900
No log	0.9057	48	0.8031	-0.1124	0.8031	0.8962
No log	0.9434	50	0.9224	0.0857	0.9224	0.9604
No log	0.9811	52	0.8313	0.0164	0.8313	0.9118
No log	1.0189	54	0.6775	-0.0159	0.6775	0.8231
No log	1.0566	56	0.6854	-0.0370	0.6854	0.8279
No log	1.0943	58	0.6739	-0.0963	0.6739	0.8209
No log	1.1321	60	0.6462	-0.0159	0.6462	0.8038
No log	1.1698	62	0.6365	-0.0233	0.6365	0.7978
No log	1.2075	64	0.6560	0.0189	0.6560	0.8099
No log	1.2453	66	0.6593	0.0769	0.6593	0.8120
No log	1.2830	68	0.7955	0.0130	0.7955	0.8919
No log	1.3208	70	0.9065	0.0	0.9065	0.9521
No log	1.3585	72	0.8894	0.1028	0.8894	0.9431
No log	1.3962	74	0.6571	0.0	0.6571	0.8106
No log	1.4340	76	0.6479	0.2000	0.6479	0.8049
No log	1.4717	78	0.6721	0.1905	0.6721	0.8198
No log	1.5094	80	0.6086	0.1773	0.6086	0.7801
No log	1.5472	82	0.8460	0.1005	0.8460	0.9198
No log	1.5849	84	1.1134	0.0303	1.1134	1.0552
No log	1.6226	86	1.1079	0.0365	1.1079	1.0526
No log	1.6604	88	0.7258	0.1398	0.7258	0.8519
No log	1.6981	90	0.5867	0.1788	0.5867	0.7660
No log	1.7358	92	0.6134	0.2821	0.6134	0.7832
No log	1.7736	94	0.8490	0.1321	0.8490	0.9214
No log	1.8113	96	0.9219	0.0140	0.9219	0.9602
No log	1.8491	98	1.2041	-0.0544	1.2041	1.0973
No log	1.8868	100	1.3344	-0.0196	1.3344	1.1551
No log	1.9245	102	1.3592	0.0515	1.3592	1.1659
No log	1.9623	104	0.6801	0.1340	0.6801	0.8247
No log	2.0	106	0.6136	0.2418	0.6136	0.7833
No log	2.0377	108	0.6576	0.2707	0.6576	0.8109
No log	2.0755	110	0.7832	0.1321	0.7832	0.8850
No log	2.1132	112	0.8377	0.0476	0.8377	0.9153
No log	2.1509	114	1.0538	0.1062	1.0538	1.0265
No log	2.1887	116	1.1339	0.1212	1.1339	1.0649
No log	2.2264	118	1.1292	0.0861	1.1292	1.0627
No log	2.2642	120	0.9646	0.0667	0.9646	0.9821
No log	2.3019	122	0.6603	0.2542	0.6603	0.8126
No log	2.3396	124	0.6117	0.2542	0.6117	0.7821
No log	2.3774	126	0.6844	0.2432	0.6844	0.8273
No log	2.4151	128	1.2764	0.1233	1.2764	1.1298
No log	2.4528	130	1.4064	0.0657	1.4064	1.1859
No log	2.4906	132	1.1408	-0.0450	1.1408	1.0681
No log	2.5283	134	1.0240	-0.0753	1.0240	1.0119
No log	2.5660	136	0.9251	-0.0950	0.9251	0.9618
No log	2.6038	138	0.8954	-0.0053	0.8954	0.9462
No log	2.6415	140	0.8893	0.1034	0.8893	0.9430
No log	2.6792	142	0.9267	0.1486	0.9267	0.9627
No log	2.7170	144	1.0201	0.1235	1.0201	1.0100
No log	2.7547	146	1.0857	0.0938	1.0857	1.0420
No log	2.7925	148	1.0394	0.0598	1.0394	1.0195
No log	2.8302	150	1.2097	0.0614	1.2097	1.0999
No log	2.8679	152	1.4037	0.12	1.4037	1.1848
No log	2.9057	154	1.4303	0.12	1.4303	1.1960
No log	2.9434	156	1.2953	0.1186	1.2953	1.1381
No log	2.9811	158	1.1878	0.0556	1.1878	1.0899
No log	3.0189	160	1.2673	0.0210	1.2673	1.1257
No log	3.0566	162	1.4374	0.1141	1.4374	1.1989
No log	3.0943	164	1.2965	0.0857	1.2965	1.1386
No log	3.1321	166	0.8916	0.1469	0.8916	0.9442
No log	3.1698	168	0.8195	0.2609	0.8195	0.9053
No log	3.2075	170	1.0743	0.0888	1.0743	1.0365
No log	3.2453	172	1.6990	0.1254	1.6990	1.3035
No log	3.2830	174	2.2998	0.0195	2.2998	1.5165
No log	3.3208	176	2.1302	0.0485	2.1302	1.4595
No log	3.3585	178	1.7208	0.1202	1.7208	1.3118
No log	3.3962	180	1.2105	0.0657	1.2105	1.1002
No log	3.4340	182	0.8915	0.1211	0.8915	0.9442
No log	3.4717	184	0.9070	0.1304	0.9070	0.9523
No log	3.5094	186	1.4081	0.1136	1.4081	1.1866
No log	3.5472	188	1.7086	0.1342	1.7086	1.3071
No log	3.5849	190	1.3369	0.1354	1.3369	1.1562
No log	3.6226	192	1.1178	0.0949	1.1178	1.0572
No log	3.6604	194	1.2044	0.1191	1.2044	1.0974
No log	3.6981	196	1.2718	0.0463	1.2718	1.1277
No log	3.7358	198	1.4459	-0.0263	1.4459	1.2024
No log	3.7736	200	1.6607	-0.0161	1.6607	1.2887
No log	3.8113	202	1.7106	0.0508	1.7106	1.3079
No log	3.8491	204	1.5386	0.0714	1.5386	1.2404
No log	3.8868	206	1.2927	0.12	1.2927	1.1370
No log	3.9245	208	1.0732	0.0506	1.0732	1.0360
No log	3.9623	210	1.0995	0.0866	1.0995	1.0486
No log	4.0	212	1.5083	0.1354	1.5083	1.2281
No log	4.0377	214	1.6635	0.1136	1.6635	1.2898
No log	4.0755	216	1.2449	0.1498	1.2449	1.1158
No log	4.1132	218	1.0045	0.0588	1.0045	1.0022
No log	4.1509	220	0.9253	0.1169	0.9253	0.9619
No log	4.1887	222	0.8983	0.0933	0.8983	0.9478
No log	4.2264	224	0.9959	0.0569	0.9959	0.9980
No log	4.2642	226	1.3270	0.1293	1.3270	1.1520
No log	4.3019	228	1.5734	0.0909	1.5734	1.2544
No log	4.3396	230	1.3549	0.0807	1.3549	1.1640
No log	4.3774	232	0.9325	0.0380	0.9325	0.9657
No log	4.4151	234	0.7710	0.2000	0.7710	0.8781
No log	4.4528	236	0.7784	0.2000	0.7784	0.8823
No log	4.4906	238	0.8555	0.0385	0.8555	0.9249
No log	4.5283	240	1.2399	0.0993	1.2399	1.1135
No log	4.5660	242	1.6294	-0.0029	1.6294	1.2765
No log	4.6038	244	1.8114	0.0444	1.8114	1.3459
No log	4.6415	246	1.5720	-0.0123	1.5720	1.2538
No log	4.6792	248	1.2800	-0.0117	1.2800	1.1314
No log	4.7170	250	1.1100	0.0445	1.1100	1.0536
No log	4.7547	252	1.0950	0.1191	1.0950	1.0464
No log	4.7925	254	1.2076	0.0769	1.2076	1.0989
No log	4.8302	256	1.4951	0.0952	1.4951	1.2227
No log	4.8679	258	1.5892	0.0520	1.5892	1.2606
No log	4.9057	260	1.3555	0.0712	1.3555	1.1643
No log	4.9434	262	0.9682	0.0938	0.9682	0.9840
No log	4.9811	264	0.8408	0.0933	0.8408	0.9169
No log	5.0189	266	0.9309	0.1000	0.9309	0.9648
No log	5.0566	268	1.1506	0.0949	1.1506	1.0726
No log	5.0943	270	1.4341	0.0596	1.4341	1.1975
No log	5.1321	272	1.6301	-0.0091	1.6301	1.2768
No log	5.1698	274	1.6955	-0.0642	1.6955	1.3021
No log	5.2075	276	1.4177	0.0614	1.4177	1.1907
No log	5.2453	278	1.2903	0.0588	1.2903	1.1359
No log	5.2830	280	1.2429	0.0922	1.2429	1.1149
No log	5.3208	282	1.1292	0.1045	1.1292	1.0627
No log	5.3585	284	1.1361	0.1145	1.1361	1.0659
No log	5.3962	286	1.2785	0.0903	1.2785	1.1307
No log	5.4340	288	1.4584	0.0204	1.4584	1.2076
No log	5.4717	290	1.4153	0.0993	1.4153	1.1897
No log	5.5094	292	1.1474	0.1450	1.1474	1.0712
No log	5.5472	294	1.0490	0.0794	1.0490	1.0242
No log	5.5849	296	1.1657	0.1264	1.1657	1.0797
No log	5.6226	298	1.2753	0.1515	1.2753	1.1293
No log	5.6604	300	1.5261	0.0909	1.5261	1.2354
No log	5.6981	302	1.6203	0.0692	1.6203	1.2729
No log	5.7358	304	1.4663	0.0927	1.4663	1.2109
No log	5.7736	306	1.3869	0.1155	1.3869	1.1776
No log	5.8113	308	1.1882	0.1128	1.1882	1.0901
No log	5.8491	310	0.9614	0.0933	0.9614	0.9805
No log	5.8868	312	0.9465	0.0933	0.9465	0.9729
No log	5.9245	314	1.0431	0.1093	1.0431	1.0213
No log	5.9623	316	1.1774	0.1407	1.1774	1.0851
No log	6.0	318	1.3140	0.1220	1.3140	1.1463
No log	6.0377	320	1.2237	0.1158	1.2237	1.1062
No log	6.0755	322	1.2154	0.1176	1.2154	1.1025
No log	6.1132	324	1.1353	0.1396	1.1353	1.0655
No log	6.1509	326	1.0335	0.1396	1.0335	1.0166
No log	6.1887	328	0.9157	0.0979	0.9157	0.9569
No log	6.2264	330	0.9152	0.0979	0.9152	0.9567
No log	6.2642	332	1.0805	0.1524	1.0805	1.0395
No log	6.3019	334	1.2994	0.1293	1.2994	1.1399
No log	6.3396	336	1.4159	0.1335	1.4159	1.1899
No log	6.3774	338	1.3234	0.1282	1.3234	1.1504
No log	6.4151	340	1.0574	0.1407	1.0574	1.0283
No log	6.4528	342	0.9787	0.1331	0.9787	0.9893
No log	6.4906	344	1.1089	0.1429	1.1089	1.0530
No log	6.5283	346	1.3733	0.1546	1.3733	1.1719
No log	6.5660	348	1.6412	0.0700	1.6412	1.2811
No log	6.6038	350	1.6880	0.0700	1.6880	1.2992
No log	6.6415	352	1.4718	0.1098	1.4718	1.2132
No log	6.6792	354	1.2621	0.1538	1.2621	1.1234
No log	6.7170	356	1.1024	0.1145	1.1024	1.0500
No log	6.7547	358	1.1462	0.0861	1.1462	1.0706
No log	6.7925	360	1.3107	0.1158	1.3107	1.1449
No log	6.8302	362	1.5413	0.0303	1.5413	1.2415
No log	6.8679	364	1.6820	-0.0222	1.6820	1.2969
No log	6.9057	366	1.6258	0.0118	1.6258	1.2751
No log	6.9434	368	1.4562	0.0489	1.4562	1.2067
No log	6.9811	370	1.3223	0.1220	1.3223	1.1499
No log	7.0189	372	1.2326	0.0949	1.2326	1.1102
No log	7.0566	374	1.1732	0.1825	1.1732	1.0832
No log	7.0943	376	1.2787	0.1280	1.2787	1.1308
No log	7.1321	378	1.4758	0.1083	1.4758	1.2148
No log	7.1698	380	1.5229	0.0536	1.5229	1.2340
No log	7.2075	382	1.4722	0.1515	1.4722	1.2134
No log	7.2453	384	1.3481	0.1220	1.3481	1.1611
No log	7.2830	386	1.2962	0.1172	1.2962	1.1385
No log	7.3208	388	1.2166	0.0882	1.2166	1.1030
No log	7.3585	390	1.2313	0.0882	1.2313	1.1096
No log	7.3962	392	1.2778	0.1206	1.2778	1.1304
No log	7.4340	394	1.4087	0.1233	1.4087	1.1869
No log	7.4717	396	1.5019	0.0	1.5019	1.2255
No log	7.5094	398	1.5174	-0.0221	1.5174	1.2318
No log	7.5472	400	1.4829	-0.0221	1.4829	1.2178
No log	7.5849	402	1.3891	0.0976	1.3891	1.1786
No log	7.6226	404	1.2577	0.0929	1.2577	1.1215
No log	7.6604	406	1.1464	0.0929	1.1464	1.0707
No log	7.6981	408	1.0438	0.1145	1.0438	1.0216
No log	7.7358	410	1.0395	0.1128	1.0395	1.0196
No log	7.7736	412	1.0860	0.1161	1.0860	1.0421
No log	7.8113	414	1.1625	0.0929	1.1625	1.0782
No log	7.8491	416	1.2540	0.0657	1.2540	1.1198
No log	7.8868	418	1.2499	0.0657	1.2499	1.1180
No log	7.9245	420	1.2179	0.0929	1.2179	1.1036
No log	7.9623	422	1.2467	0.0929	1.2467	1.1166
No log	8.0	424	1.3270	0.1206	1.3270	1.1520
No log	8.0377	426	1.4043	0.1220	1.4043	1.1850
No log	8.0755	428	1.4719	0.0438	1.4719	1.2132
No log	8.1132	430	1.4216	0.0959	1.4216	1.1923
No log	8.1509	432	1.3746	0.1158	1.3746	1.1724
No log	8.1887	434	1.3233	0.1158	1.3233	1.1503
No log	8.2264	436	1.3521	0.1172	1.3521	1.1628
No log	8.2642	438	1.3417	0.1220	1.3417	1.1583
No log	8.3019	440	1.4123	0.1026	1.4123	1.1884
No log	8.3396	442	1.4750	0.1325	1.4750	1.2145
No log	8.3774	444	1.5082	0.1335	1.5082	1.2281
No log	8.4151	446	1.4991	0.1325	1.4991	1.2244
No log	8.4528	448	1.4370	0.1083	1.4370	1.1987
No log	8.4906	450	1.3976	0.0976	1.3976	1.1822
No log	8.5283	452	1.3717	0.1220	1.3717	1.1712
No log	8.5660	454	1.3348	0.1172	1.3348	1.1553
No log	8.6038	456	1.3778	0.1206	1.3778	1.1738
No log	8.6415	458	1.4586	0.0976	1.4586	1.2077
No log	8.6792	460	1.5236	0.0489	1.5236	1.2344
No log	8.7170	462	1.5614	0.0256	1.5614	1.2495
No log	8.7547	464	1.5490	0.0256	1.5490	1.2446
No log	8.7925	466	1.4695	0.0438	1.4695	1.2122
No log	8.8302	468	1.3677	0.0897	1.3677	1.1695
No log	8.8679	470	1.3164	0.1158	1.3164	1.1473
No log	8.9057	472	1.2768	0.1158	1.2768	1.1300
No log	8.9434	474	1.2557	0.1158	1.2557	1.1206
No log	8.9811	476	1.2634	0.1158	1.2634	1.1240
No log	9.0189	478	1.2815	0.1158	1.2815	1.1320
No log	9.0566	480	1.2776	0.0903	1.2776	1.1303
No log	9.0943	482	1.2992	0.1206	1.2992	1.1398
No log	9.1321	484	1.3499	0.0769	1.3499	1.1619
No log	9.1698	486	1.3727	0.0809	1.3727	1.1716
No log	9.2075	488	1.3580	0.1083	1.3580	1.1653
No log	9.2453	490	1.3231	0.0809	1.3231	1.1503
No log	9.2830	492	1.3212	0.0769	1.3212	1.1494
No log	9.3208	494	1.3123	0.0689	1.3123	1.1456
No log	9.3585	496	1.2808	0.0903	1.2808	1.1317
No log	9.3962	498	1.2552	0.0882	1.2552	1.1203
0.5117	9.4340	500	1.2464	0.0882	1.2464	1.1164
0.5117	9.4717	502	1.2450	0.0882	1.2450	1.1158
0.5117	9.5094	504	1.2528	0.0882	1.2528	1.1193
0.5117	9.5472	506	1.2692	0.0882	1.2692	1.1266
0.5117	9.5849	508	1.2991	0.1158	1.2991	1.1398
0.5117	9.6226	510	1.3194	0.1158	1.3194	1.1487
0.5117	9.6604	512	1.3435	0.1206	1.3435	1.1591
0.5117	9.6981	514	1.3506	0.1206	1.3506	1.1621
0.5117	9.7358	516	1.3446	0.1206	1.3446	1.1596
0.5117	9.7736	518	1.3342	0.1158	1.3342	1.1551
0.5117	9.8113	520	1.3276	0.1158	1.3276	1.1522
0.5117	9.8491	522	1.3208	0.1158	1.3208	1.1493
0.5117	9.8868	524	1.3085	0.1158	1.3085	1.1439
0.5117	9.9245	526	1.2962	0.1158	1.2962	1.1385
0.5117	9.9623	528	1.2875	0.1158	1.2875	1.1347
0.5117	10.0	530	1.2841	0.1158	1.2841	1.1332

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1