ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k18_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7049
• Qwk: 0.7617
• Mse: 0.7049
• Rmse: 0.8396

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0333	2	2.4332	0.0396	2.4332	1.5599
No log	0.0667	4	1.6696	0.1467	1.6696	1.2921
No log	0.1	6	1.5756	0.1254	1.5756	1.2552
No log	0.1333	8	1.6194	0.2439	1.6194	1.2725
No log	0.1667	10	1.5901	0.2926	1.5901	1.2610
No log	0.2	12	1.4603	0.3001	1.4603	1.2084
No log	0.2333	14	1.5482	0.3097	1.5482	1.2443
No log	0.2667	16	1.9156	0.2664	1.9156	1.3840
No log	0.3	18	1.5609	0.3075	1.5609	1.2494
No log	0.3333	20	1.3737	0.3324	1.3737	1.1720
No log	0.3667	22	1.5030	0.3563	1.5030	1.2260
No log	0.4	24	1.5070	0.3658	1.5070	1.2276
No log	0.4333	26	1.9975	0.3291	1.9975	1.4133
No log	0.4667	28	2.1235	0.3044	2.1235	1.4572
No log	0.5	30	1.8635	0.3807	1.8635	1.3651
No log	0.5333	32	1.6957	0.3549	1.6957	1.3022
No log	0.5667	34	1.6362	0.3765	1.6362	1.2791
No log	0.6	36	1.7631	0.3981	1.7631	1.3278
No log	0.6333	38	2.2361	0.2985	2.2361	1.4953
No log	0.6667	40	2.2542	0.3448	2.2542	1.5014
No log	0.7	42	1.6090	0.4264	1.6090	1.2685
No log	0.7333	44	1.0531	0.4378	1.0531	1.0262
No log	0.7667	46	0.9484	0.4672	0.9484	0.9739
No log	0.8	48	0.9488	0.5203	0.9488	0.9741
No log	0.8333	50	1.1387	0.5146	1.1387	1.0671
No log	0.8667	52	1.8572	0.4040	1.8572	1.3628
No log	0.9	54	2.2307	0.3419	2.2307	1.4935
No log	0.9333	56	2.4038	0.3470	2.4038	1.5504
No log	0.9667	58	2.2262	0.3695	2.2262	1.4920
No log	1.0	60	1.5840	0.4728	1.5840	1.2586
No log	1.0333	62	1.4385	0.4591	1.4385	1.1994
No log	1.0667	64	1.7361	0.4436	1.7361	1.3176
No log	1.1	66	1.7658	0.4403	1.7658	1.3288
No log	1.1333	68	1.2492	0.4951	1.2492	1.1177
No log	1.1667	70	1.0912	0.5556	1.0912	1.0446
No log	1.2	72	1.3711	0.5092	1.3711	1.1709
No log	1.2333	74	1.9345	0.4542	1.9345	1.3909
No log	1.2667	76	2.1286	0.4077	2.1286	1.4590
No log	1.3	78	1.6525	0.4854	1.6525	1.2855
No log	1.3333	80	1.1142	0.5360	1.1142	1.0555
No log	1.3667	82	0.9818	0.6053	0.9818	0.9908
No log	1.4	84	0.9980	0.6031	0.9980	0.9990
No log	1.4333	86	1.2292	0.5033	1.2292	1.1087
No log	1.4667	88	1.5627	0.4378	1.5627	1.2501
No log	1.5	90	1.6858	0.4244	1.6858	1.2984
No log	1.5333	92	1.4597	0.4375	1.4597	1.2082
No log	1.5667	94	1.1971	0.5365	1.1971	1.0941
No log	1.6	96	0.9612	0.6415	0.9612	0.9804
No log	1.6333	98	0.9424	0.5835	0.9424	0.9708
No log	1.6667	100	1.0096	0.5675	1.0096	1.0048
No log	1.7	102	1.0703	0.5508	1.0703	1.0345
No log	1.7333	104	1.0263	0.5761	1.0263	1.0131
No log	1.7667	106	1.0664	0.5562	1.0664	1.0327
No log	1.8	108	1.1451	0.5760	1.1451	1.0701
No log	1.8333	110	1.0261	0.6113	1.0261	1.0130
No log	1.8667	112	1.0190	0.6369	1.0190	1.0094
No log	1.9	114	0.8823	0.6551	0.8823	0.9393
No log	1.9333	116	0.6923	0.6705	0.6923	0.8321
No log	1.9667	118	0.6558	0.6959	0.6558	0.8098
No log	2.0	120	0.6541	0.6754	0.6541	0.8088
No log	2.0333	122	0.6947	0.6979	0.6947	0.8335
No log	2.0667	124	0.9229	0.6867	0.9229	0.9607
No log	2.1	126	1.1607	0.6131	1.1607	1.0773
No log	2.1333	128	1.2210	0.5858	1.2210	1.1050
No log	2.1667	130	1.0523	0.5985	1.0523	1.0258
No log	2.2	132	0.9789	0.6204	0.9789	0.9894
No log	2.2333	134	0.8613	0.6600	0.8613	0.9281
No log	2.2667	136	0.8556	0.6756	0.8556	0.9250
No log	2.3	138	0.9251	0.6704	0.9251	0.9618
No log	2.3333	140	0.8494	0.7140	0.8494	0.9216
No log	2.3667	142	0.7286	0.7339	0.7286	0.8536
No log	2.4	144	0.7228	0.7340	0.7228	0.8502
No log	2.4333	146	0.6708	0.7203	0.6708	0.8190
No log	2.4667	148	0.6339	0.7319	0.6339	0.7962
No log	2.5	150	0.6029	0.7388	0.6029	0.7765
No log	2.5333	152	0.5859	0.7439	0.5859	0.7654
No log	2.5667	154	0.6098	0.7579	0.6098	0.7809
No log	2.6	156	0.6158	0.7579	0.6158	0.7847
No log	2.6333	158	0.6050	0.7671	0.6050	0.7778
No log	2.6667	160	0.5990	0.7746	0.5990	0.7739
No log	2.7	162	0.6191	0.7703	0.6191	0.7868
No log	2.7333	164	0.5784	0.7398	0.5784	0.7605
No log	2.7667	166	0.5770	0.7054	0.5770	0.7596
No log	2.8	168	0.5742	0.7149	0.5742	0.7578
No log	2.8333	170	0.5782	0.7395	0.5782	0.7604
No log	2.8667	172	0.6136	0.7513	0.6136	0.7833
No log	2.9	174	0.5743	0.7372	0.5743	0.7578
No log	2.9333	176	0.5706	0.7230	0.5706	0.7554
No log	2.9667	178	0.5645	0.7180	0.5645	0.7513
No log	3.0	180	0.5538	0.7223	0.5538	0.7442
No log	3.0333	182	0.5502	0.7223	0.5502	0.7417
No log	3.0667	184	0.5630	0.7579	0.5630	0.7503
No log	3.1	186	0.5698	0.7552	0.5698	0.7549
No log	3.1333	188	0.5586	0.7587	0.5586	0.7474
No log	3.1667	190	0.5465	0.7387	0.5465	0.7393
No log	3.2	192	0.5552	0.7471	0.5552	0.7451
No log	3.2333	194	0.5608	0.7568	0.5608	0.7489
No log	3.2667	196	0.5780	0.7720	0.5780	0.7602
No log	3.3	198	0.5705	0.7720	0.5705	0.7553
No log	3.3333	200	0.5538	0.7631	0.5538	0.7442
No log	3.3667	202	0.5450	0.7226	0.5450	0.7382
No log	3.4	204	0.5789	0.7460	0.5789	0.7609
No log	3.4333	206	0.6810	0.7459	0.6810	0.8252
No log	3.4667	208	0.6747	0.7464	0.6747	0.8214
No log	3.5	210	0.6417	0.7457	0.6417	0.8011
No log	3.5333	212	0.6307	0.7418	0.6307	0.7942
No log	3.5667	214	0.6423	0.7560	0.6423	0.8014
No log	3.6	216	0.6940	0.7566	0.6940	0.8331
No log	3.6333	218	0.6635	0.7529	0.6635	0.8146
No log	3.6667	220	0.7308	0.7595	0.7308	0.8549
No log	3.7	222	0.9828	0.7015	0.9828	0.9913
No log	3.7333	224	1.1436	0.6695	1.1436	1.0694
No log	3.7667	226	1.0583	0.6855	1.0583	1.0287
No log	3.8	228	0.8516	0.7184	0.8516	0.9228
No log	3.8333	230	0.6980	0.7634	0.6980	0.8355
No log	3.8667	232	0.6158	0.7534	0.6158	0.7847
No log	3.9	234	0.6242	0.7451	0.6242	0.7900
No log	3.9333	236	0.6883	0.7319	0.6883	0.8296
No log	3.9667	238	0.8125	0.6941	0.8125	0.9014
No log	4.0	240	0.8932	0.6632	0.8932	0.9451
No log	4.0333	242	0.8499	0.6950	0.8499	0.9219
No log	4.0667	244	0.7109	0.7484	0.7109	0.8431
No log	4.1	246	0.6647	0.7401	0.6647	0.8153
No log	4.1333	248	0.6687	0.7516	0.6687	0.8177
No log	4.1667	250	0.7244	0.7484	0.7244	0.8511
No log	4.2	252	0.8453	0.7019	0.8453	0.9194
No log	4.2333	254	0.9665	0.6697	0.9665	0.9831
No log	4.2667	256	0.9245	0.6632	0.9245	0.9615
No log	4.3	258	0.7753	0.7282	0.7753	0.8805
No log	4.3333	260	0.6508	0.7507	0.6508	0.8067
No log	4.3667	262	0.6425	0.7469	0.6425	0.8016
No log	4.4	264	0.7296	0.7387	0.7296	0.8541
No log	4.4333	266	0.7960	0.7227	0.7960	0.8922
No log	4.4667	268	0.8582	0.7052	0.8582	0.9264
No log	4.5	270	0.9670	0.6628	0.9670	0.9834
No log	4.5333	272	0.8957	0.6752	0.8957	0.9464
No log	4.5667	274	0.7206	0.7302	0.7206	0.8489
No log	4.6	276	0.6013	0.7599	0.6013	0.7754
No log	4.6333	278	0.5881	0.7441	0.5881	0.7669
No log	4.6667	280	0.6221	0.7651	0.6221	0.7887
No log	4.7	282	0.7361	0.7296	0.7361	0.8580
No log	4.7333	284	0.8279	0.6892	0.8279	0.9099
No log	4.7667	286	0.8185	0.7056	0.8185	0.9047
No log	4.8	288	0.7349	0.7384	0.7349	0.8573
No log	4.8333	290	0.6153	0.7665	0.6153	0.7844
No log	4.8667	292	0.5885	0.7677	0.5885	0.7671
No log	4.9	294	0.6083	0.7739	0.6083	0.7799
No log	4.9333	296	0.7011	0.7633	0.7011	0.8373
No log	4.9667	298	0.8385	0.7209	0.8385	0.9157
No log	5.0	300	1.0825	0.6452	1.0825	1.0405
No log	5.0333	302	1.2119	0.6304	1.2119	1.1008
No log	5.0667	304	1.1400	0.6525	1.1400	1.0677
No log	5.1	306	0.9702	0.6713	0.9702	0.9850
No log	5.1333	308	0.8264	0.7221	0.8264	0.9091
No log	5.1667	310	0.8278	0.7016	0.8278	0.9099
No log	5.2	312	0.8036	0.6867	0.8036	0.8964
No log	5.2333	314	0.8127	0.6779	0.8127	0.9015
No log	5.2667	316	0.8823	0.6847	0.8823	0.9393
No log	5.3	318	0.8954	0.6829	0.8954	0.9463
No log	5.3333	320	0.8601	0.6973	0.8601	0.9274
No log	5.3667	322	0.8143	0.7098	0.8143	0.9024
No log	5.4	324	0.8328	0.7039	0.8328	0.9126
No log	5.4333	326	0.8153	0.7204	0.8153	0.9029
No log	5.4667	328	0.8321	0.7187	0.8321	0.9122
No log	5.5	330	0.8057	0.7248	0.8057	0.8976
No log	5.5333	332	0.8249	0.7303	0.8249	0.9082
No log	5.5667	334	0.8580	0.7169	0.8580	0.9263
No log	5.6	336	0.9071	0.6640	0.9071	0.9524
No log	5.6333	338	0.9973	0.6457	0.9973	0.9987
No log	5.6667	340	0.9543	0.6575	0.9543	0.9769
No log	5.7	342	0.8422	0.7049	0.8422	0.9177
No log	5.7333	344	0.7105	0.7532	0.7105	0.8429
No log	5.7667	346	0.6583	0.7520	0.6583	0.8114
No log	5.8	348	0.6408	0.7488	0.6408	0.8005
No log	5.8333	350	0.6458	0.7442	0.6458	0.8036
No log	5.8667	352	0.6779	0.7564	0.6779	0.8233
No log	5.9	354	0.7018	0.7724	0.7018	0.8378
No log	5.9333	356	0.7397	0.7572	0.7397	0.8601
No log	5.9667	358	0.7200	0.7544	0.7200	0.8485
No log	6.0	360	0.7166	0.7470	0.7166	0.8465
No log	6.0333	362	0.6650	0.7686	0.6650	0.8155
No log	6.0667	364	0.6434	0.7624	0.6434	0.8021
No log	6.1	366	0.6515	0.7727	0.6515	0.8071
No log	6.1333	368	0.6378	0.7727	0.6378	0.7987
No log	6.1667	370	0.6241	0.7679	0.6241	0.7900
No log	6.2	372	0.6245	0.7605	0.6245	0.7902
No log	6.2333	374	0.6528	0.7777	0.6528	0.8079
No log	6.2667	376	0.7178	0.7603	0.7178	0.8472
No log	6.3	378	0.7571	0.7552	0.7571	0.8701
No log	6.3333	380	0.7283	0.7639	0.7283	0.8534
No log	6.3667	382	0.7224	0.7602	0.7224	0.8499
No log	6.4	384	0.7311	0.7475	0.7311	0.8550
No log	6.4333	386	0.7342	0.7469	0.7342	0.8568
No log	6.4667	388	0.7021	0.7475	0.7021	0.8379
No log	6.5	390	0.6579	0.7834	0.6579	0.8111
No log	6.5333	392	0.6383	0.7609	0.6383	0.7989
No log	6.5667	394	0.6195	0.7470	0.6195	0.7871
No log	6.6	396	0.6229	0.7387	0.6229	0.7892
No log	6.6333	398	0.6468	0.7509	0.6468	0.8043
No log	6.6667	400	0.7177	0.7426	0.7177	0.8472
No log	6.7	402	0.7777	0.7234	0.7777	0.8819
No log	6.7333	404	0.8037	0.7290	0.8037	0.8965
No log	6.7667	406	0.7678	0.7509	0.7678	0.8762
No log	6.8	408	0.7106	0.7780	0.7106	0.8430
No log	6.8333	410	0.6733	0.7860	0.6733	0.8206
No log	6.8667	412	0.6718	0.7860	0.6718	0.8196
No log	6.9	414	0.6635	0.7826	0.6635	0.8146
No log	6.9333	416	0.6529	0.7826	0.6529	0.8080
No log	6.9667	418	0.6758	0.7821	0.6758	0.8221
No log	7.0	420	0.7391	0.7457	0.7391	0.8597
No log	7.0333	422	0.8479	0.7123	0.8479	0.9208
No log	7.0667	424	0.9029	0.6944	0.9029	0.9502
No log	7.1	426	0.8821	0.6962	0.8821	0.9392
No log	7.1333	428	0.8147	0.7330	0.8147	0.9026
No log	7.1667	430	0.7439	0.7416	0.7439	0.8625
No log	7.2	432	0.6906	0.7469	0.6906	0.8310
No log	7.2333	434	0.6562	0.7784	0.6562	0.8101
No log	7.2667	436	0.6487	0.7860	0.6487	0.8054
No log	7.3	438	0.6717	0.7745	0.6717	0.8196
No log	7.3333	440	0.7065	0.7699	0.7065	0.8405
No log	7.3667	442	0.7097	0.7699	0.7097	0.8424
No log	7.4	444	0.6754	0.7675	0.6754	0.8218
No log	7.4333	446	0.6436	0.7893	0.6436	0.8022
No log	7.4667	448	0.6360	0.7901	0.6360	0.7975
No log	7.5	450	0.6575	0.7852	0.6575	0.8108
No log	7.5333	452	0.7073	0.7740	0.7073	0.8410
No log	7.5667	454	0.7339	0.7694	0.7339	0.8567
No log	7.6	456	0.7365	0.7694	0.7365	0.8582
No log	7.6333	458	0.7113	0.7629	0.7113	0.8434
No log	7.6667	460	0.7039	0.7633	0.7039	0.8390
No log	7.7	462	0.7093	0.7669	0.7093	0.8422
No log	7.7333	464	0.6856	0.7681	0.6856	0.8280
No log	7.7667	466	0.6673	0.7681	0.6673	0.8169
No log	7.8	468	0.6650	0.7722	0.6650	0.8155
No log	7.8333	470	0.6791	0.7716	0.6791	0.8241
No log	7.8667	472	0.7158	0.7745	0.7158	0.8461
No log	7.9	474	0.7483	0.7733	0.7483	0.8651
No log	7.9333	476	0.7690	0.7649	0.7690	0.8769
No log	7.9667	478	0.7785	0.7609	0.7785	0.8823
No log	8.0	480	0.7799	0.7609	0.7799	0.8831
No log	8.0333	482	0.7744	0.7609	0.7744	0.8800
No log	8.0667	484	0.7507	0.7728	0.7507	0.8664
No log	8.1	486	0.7064	0.7621	0.7064	0.8405
No log	8.1333	488	0.6610	0.7650	0.6610	0.8130
No log	8.1667	490	0.6400	0.7595	0.6400	0.8000
No log	8.2	492	0.6247	0.7722	0.6247	0.7904
No log	8.2333	494	0.6301	0.7722	0.6301	0.7938
No log	8.2667	496	0.6461	0.7595	0.6461	0.8038
No log	8.3	498	0.6717	0.7650	0.6717	0.8196
0.3428	8.3333	500	0.6970	0.7717	0.6970	0.8349
0.3428	8.3667	502	0.7157	0.7705	0.7157	0.8460
0.3428	8.4	504	0.7261	0.7682	0.7261	0.8521
0.3428	8.4333	506	0.7343	0.7682	0.7343	0.8569
0.3428	8.4667	508	0.7450	0.7559	0.7450	0.8631
0.3428	8.5	510	0.7412	0.7563	0.7412	0.8609
0.3428	8.5333	512	0.7220	0.7554	0.7220	0.8497
0.3428	8.5667	514	0.7042	0.7554	0.7042	0.8392
0.3428	8.6	516	0.6910	0.7596	0.6910	0.8313
0.3428	8.6333	518	0.6902	0.7554	0.6902	0.8308
0.3428	8.6667	520	0.6975	0.7554	0.6975	0.8352
0.3428	8.7	522	0.6957	0.7554	0.6957	0.8341
0.3428	8.7333	524	0.7024	0.7628	0.7024	0.8381
0.3428	8.7667	526	0.7167	0.7628	0.7167	0.8466
0.3428	8.8	528	0.7380	0.7688	0.7380	0.8591
0.3428	8.8333	530	0.7700	0.7531	0.7700	0.8775
0.3428	8.8667	532	0.7973	0.7371	0.7973	0.8929
0.3428	8.9	534	0.8134	0.7371	0.8134	0.9019
0.3428	8.9333	536	0.8210	0.7371	0.8210	0.9061
0.3428	8.9667	538	0.8113	0.7391	0.8113	0.9007
0.3428	9.0	540	0.7885	0.7490	0.7885	0.8880
0.3428	9.0333	542	0.7768	0.7490	0.7768	0.8814
0.3428	9.0667	544	0.7652	0.7490	0.7652	0.8747
0.3428	9.1	546	0.7584	0.7490	0.7584	0.8709
0.3428	9.1333	548	0.7498	0.7531	0.7498	0.8659
0.3428	9.1667	550	0.7353	0.7572	0.7353	0.8575
0.3428	9.2	552	0.7293	0.7729	0.7293	0.8540
0.3428	9.2333	554	0.7286	0.7729	0.7286	0.8536
0.3428	9.2667	556	0.7233	0.7694	0.7233	0.8505
0.3428	9.3	558	0.7274	0.7694	0.7274	0.8529
0.3428	9.3333	560	0.7343	0.7694	0.7343	0.8569
0.3428	9.3667	562	0.7346	0.7729	0.7346	0.8571
0.3428	9.4	564	0.7349	0.7688	0.7349	0.8573
0.3428	9.4333	566	0.7278	0.7688	0.7278	0.8531
0.3428	9.4667	568	0.7202	0.7688	0.7202	0.8486
0.3428	9.5	570	0.7172	0.7576	0.7172	0.8469
0.3428	9.5333	572	0.7178	0.7576	0.7178	0.8473
0.3428	9.5667	574	0.7169	0.7576	0.7169	0.8467
0.3428	9.6	576	0.7136	0.7576	0.7136	0.8448
0.3428	9.6333	578	0.7107	0.7576	0.7107	0.8430
0.3428	9.6667	580	0.7059	0.7502	0.7059	0.8402
0.3428	9.7	582	0.7048	0.7502	0.7048	0.8395
0.3428	9.7333	584	0.7038	0.7544	0.7038	0.8389
0.3428	9.7667	586	0.7010	0.7544	0.7010	0.8372
0.3428	9.8	588	0.6981	0.7544	0.6981	0.8355
0.3428	9.8333	590	0.6976	0.7664	0.6976	0.8352
0.3428	9.8667	592	0.6989	0.7735	0.6989	0.8360
0.3428	9.9	594	0.7013	0.7735	0.7013	0.8374
0.3428	9.9333	596	0.7036	0.7617	0.7036	0.8388
0.3428	9.9667	598	0.7047	0.7617	0.7047	0.8395
0.3428	10.0	600	0.7049	0.7617	0.7049	0.8396

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1