ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k18_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7048
• Qwk: 0.7617
• Mse: 0.7048
• Rmse: 0.8395

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0333	2	2.4332	0.0396	2.4332	1.5599
No log	0.0667	4	1.6696	0.1467	1.6696	1.2921
No log	0.1	6	1.5756	0.1254	1.5756	1.2552
No log	0.1333	8	1.6194	0.2439	1.6194	1.2725
No log	0.1667	10	1.5901	0.2926	1.5901	1.2610
No log	0.2	12	1.4603	0.3001	1.4603	1.2084
No log	0.2333	14	1.5482	0.3097	1.5482	1.2443
No log	0.2667	16	1.9156	0.2664	1.9156	1.3840
No log	0.3	18	1.5609	0.3075	1.5609	1.2494
No log	0.3333	20	1.3737	0.3324	1.3737	1.1720
No log	0.3667	22	1.5031	0.3563	1.5031	1.2260
No log	0.4	24	1.5071	0.3658	1.5071	1.2276
No log	0.4333	26	1.9975	0.3291	1.9975	1.4133
No log	0.4667	28	2.1235	0.3044	2.1235	1.4572
No log	0.5	30	1.8635	0.3807	1.8635	1.3651
No log	0.5333	32	1.6957	0.3549	1.6957	1.3022
No log	0.5667	34	1.6362	0.3765	1.6362	1.2791
No log	0.6	36	1.7631	0.3981	1.7631	1.3278
No log	0.6333	38	2.2361	0.2985	2.2361	1.4953
No log	0.6667	40	2.2542	0.3448	2.2542	1.5014
No log	0.7	42	1.6090	0.4264	1.6090	1.2685
No log	0.7333	44	1.0531	0.4378	1.0531	1.0262
No log	0.7667	46	0.9484	0.4672	0.9484	0.9739
No log	0.8	48	0.9488	0.5203	0.9488	0.9741
No log	0.8333	50	1.1387	0.5146	1.1387	1.0671
No log	0.8667	52	1.8572	0.4040	1.8572	1.3628
No log	0.9	54	2.2307	0.3419	2.2307	1.4935
No log	0.9333	56	2.4038	0.3470	2.4038	1.5504
No log	0.9667	58	2.2262	0.3695	2.2262	1.4920
No log	1.0	60	1.5840	0.4728	1.5840	1.2586
No log	1.0333	62	1.4385	0.4591	1.4385	1.1994
No log	1.0667	64	1.7361	0.4436	1.7361	1.3176
No log	1.1	66	1.7657	0.4403	1.7657	1.3288
No log	1.1333	68	1.2492	0.4951	1.2492	1.1177
No log	1.1667	70	1.0912	0.5556	1.0912	1.0446
No log	1.2	72	1.3711	0.5098	1.3711	1.1709
No log	1.2333	74	1.9345	0.4542	1.9345	1.3909
No log	1.2667	76	2.1287	0.4077	2.1287	1.4590
No log	1.3	78	1.6525	0.4854	1.6525	1.2855
No log	1.3333	80	1.1142	0.5360	1.1142	1.0555
No log	1.3667	82	0.9817	0.6053	0.9817	0.9908
No log	1.4	84	0.9979	0.6031	0.9979	0.9990
No log	1.4333	86	1.2292	0.5033	1.2292	1.1087
No log	1.4667	88	1.5627	0.4378	1.5627	1.2501
No log	1.5	90	1.6858	0.4244	1.6858	1.2984
No log	1.5333	92	1.4597	0.4375	1.4597	1.2082
No log	1.5667	94	1.1970	0.5365	1.1970	1.0941
No log	1.6	96	0.9612	0.6415	0.9612	0.9804
No log	1.6333	98	0.9423	0.5835	0.9423	0.9707
No log	1.6667	100	1.0096	0.5675	1.0096	1.0048
No log	1.7	102	1.0703	0.5508	1.0703	1.0345
No log	1.7333	104	1.0263	0.5761	1.0263	1.0131
No log	1.7667	106	1.0665	0.5562	1.0665	1.0327
No log	1.8	108	1.1451	0.5760	1.1451	1.0701
No log	1.8333	110	1.0261	0.6113	1.0261	1.0130
No log	1.8667	112	1.0189	0.6369	1.0189	1.0094
No log	1.9	114	0.8823	0.6551	0.8823	0.9393
No log	1.9333	116	0.6923	0.6705	0.6923	0.8321
No log	1.9667	118	0.6558	0.6959	0.6558	0.8098
No log	2.0	120	0.6541	0.6754	0.6541	0.8088
No log	2.0333	122	0.6946	0.6979	0.6946	0.8335
No log	2.0667	124	0.9228	0.6867	0.9228	0.9606
No log	2.1	126	1.1606	0.6131	1.1606	1.0773
No log	2.1333	128	1.2210	0.5858	1.2210	1.1050
No log	2.1667	130	1.0523	0.5985	1.0523	1.0258
No log	2.2	132	0.9789	0.6204	0.9789	0.9894
No log	2.2333	134	0.8613	0.6600	0.8613	0.9281
No log	2.2667	136	0.8556	0.6756	0.8556	0.9250
No log	2.3	138	0.9251	0.6704	0.9251	0.9618
No log	2.3333	140	0.8493	0.7140	0.8493	0.9216
No log	2.3667	142	0.7286	0.7339	0.7286	0.8536
No log	2.4	144	0.7228	0.7340	0.7228	0.8502
No log	2.4333	146	0.6708	0.7203	0.6708	0.8190
No log	2.4667	148	0.6338	0.7319	0.6338	0.7961
No log	2.5	150	0.6029	0.7388	0.6029	0.7764
No log	2.5333	152	0.5859	0.7439	0.5859	0.7654
No log	2.5667	154	0.6098	0.7579	0.6098	0.7809
No log	2.6	156	0.6157	0.7579	0.6157	0.7847
No log	2.6333	158	0.6049	0.7671	0.6049	0.7778
No log	2.6667	160	0.5989	0.7746	0.5989	0.7739
No log	2.7	162	0.6191	0.7703	0.6191	0.7868
No log	2.7333	164	0.5784	0.7398	0.5784	0.7605
No log	2.7667	166	0.5770	0.7054	0.5770	0.7596
No log	2.8	168	0.5742	0.7149	0.5742	0.7578
No log	2.8333	170	0.5782	0.7395	0.5782	0.7604
No log	2.8667	172	0.6136	0.7513	0.6136	0.7833
No log	2.9	174	0.5743	0.7372	0.5743	0.7578
No log	2.9333	176	0.5706	0.7230	0.5706	0.7554
No log	2.9667	178	0.5645	0.7180	0.5645	0.7514
No log	3.0	180	0.5538	0.7223	0.5538	0.7442
No log	3.0333	182	0.5502	0.7223	0.5502	0.7417
No log	3.0667	184	0.5630	0.7579	0.5630	0.7503
No log	3.1	186	0.5697	0.7552	0.5697	0.7548
No log	3.1333	188	0.5586	0.7587	0.5586	0.7474
No log	3.1667	190	0.5466	0.7387	0.5466	0.7393
No log	3.2	192	0.5553	0.7471	0.5553	0.7452
No log	3.2333	194	0.5608	0.7568	0.5608	0.7489
No log	3.2667	196	0.5779	0.7720	0.5779	0.7602
No log	3.3	198	0.5705	0.7720	0.5705	0.7553
No log	3.3333	200	0.5538	0.7631	0.5538	0.7442
No log	3.3667	202	0.5450	0.7226	0.5450	0.7383
No log	3.4	204	0.5791	0.7460	0.5791	0.7610
No log	3.4333	206	0.6812	0.7459	0.6812	0.8254
No log	3.4667	208	0.6749	0.7464	0.6749	0.8215
No log	3.5	210	0.6419	0.7457	0.6419	0.8012
No log	3.5333	212	0.6309	0.7418	0.6309	0.7943
No log	3.5667	214	0.6425	0.7560	0.6425	0.8016
No log	3.6	216	0.6944	0.7566	0.6944	0.8333
No log	3.6333	218	0.6637	0.7529	0.6637	0.8147
No log	3.6667	220	0.7307	0.7595	0.7307	0.8548
No log	3.7	222	0.9821	0.7015	0.9821	0.9910
No log	3.7333	224	1.1428	0.6695	1.1428	1.0690
No log	3.7667	226	1.0578	0.6855	1.0578	1.0285
No log	3.8	228	0.8517	0.7184	0.8517	0.9229
No log	3.8333	230	0.6980	0.7634	0.6980	0.8355
No log	3.8667	232	0.6158	0.7534	0.6158	0.7847
No log	3.9	234	0.6241	0.7451	0.6241	0.7900
No log	3.9333	236	0.6881	0.7319	0.6881	0.8295
No log	3.9667	238	0.8123	0.6941	0.8123	0.9013
No log	4.0	240	0.8929	0.6632	0.8929	0.9449
No log	4.0333	242	0.8496	0.6950	0.8496	0.9217
No log	4.0667	244	0.7108	0.7526	0.7108	0.8431
No log	4.1	246	0.6647	0.7401	0.6647	0.8153
No log	4.1333	248	0.6687	0.7516	0.6687	0.8177
No log	4.1667	250	0.7243	0.7484	0.7243	0.8511
No log	4.2	252	0.8452	0.7019	0.8452	0.9194
No log	4.2333	254	0.9666	0.6697	0.9666	0.9832
No log	4.2667	256	0.9248	0.6632	0.9248	0.9617
No log	4.3	258	0.7758	0.7282	0.7758	0.8808
No log	4.3333	260	0.6510	0.7507	0.6510	0.8068
No log	4.3667	262	0.6426	0.7469	0.6426	0.8016
No log	4.4	264	0.7295	0.7387	0.7295	0.8541
No log	4.4333	266	0.7958	0.7227	0.7958	0.8921
No log	4.4667	268	0.8581	0.7052	0.8581	0.9263
No log	4.5	270	0.9669	0.6628	0.9669	0.9833
No log	4.5333	272	0.8957	0.6752	0.8957	0.9464
No log	4.5667	274	0.7206	0.7302	0.7206	0.8489
No log	4.6	276	0.6013	0.7599	0.6013	0.7755
No log	4.6333	278	0.5882	0.7441	0.5882	0.7669
No log	4.6667	280	0.6222	0.7651	0.6222	0.7888
No log	4.7	282	0.7362	0.7296	0.7362	0.8580
No log	4.7333	284	0.8280	0.6892	0.8280	0.9099
No log	4.7667	286	0.8186	0.7056	0.8186	0.9048
No log	4.8	288	0.7351	0.7384	0.7351	0.8574
No log	4.8333	290	0.6154	0.7665	0.6154	0.7845
No log	4.8667	292	0.5886	0.7677	0.5886	0.7672
No log	4.9	294	0.6084	0.7739	0.6084	0.7800
No log	4.9333	296	0.7012	0.7633	0.7012	0.8374
No log	4.9667	298	0.8388	0.7209	0.8388	0.9159
No log	5.0	300	1.0827	0.6452	1.0827	1.0405
No log	5.0333	302	1.2119	0.6304	1.2119	1.1009
No log	5.0667	304	1.1399	0.6525	1.1399	1.0677
No log	5.1	306	0.9703	0.6713	0.9703	0.9850
No log	5.1333	308	0.8266	0.7221	0.8266	0.9092
No log	5.1667	310	0.8281	0.7016	0.8281	0.9100
No log	5.2	312	0.8038	0.6867	0.8038	0.8966
No log	5.2333	314	0.8128	0.6779	0.8128	0.9016
No log	5.2667	316	0.8822	0.6847	0.8822	0.9392
No log	5.3	318	0.8952	0.6829	0.8952	0.9461
No log	5.3333	320	0.8598	0.6973	0.8598	0.9273
No log	5.3667	322	0.8141	0.7098	0.8141	0.9023
No log	5.4	324	0.8326	0.7039	0.8326	0.9125
No log	5.4333	326	0.8152	0.7204	0.8152	0.9029
No log	5.4667	328	0.8323	0.7187	0.8323	0.9123
No log	5.5	330	0.8060	0.7248	0.8060	0.8978
No log	5.5333	332	0.8252	0.7303	0.8252	0.9084
No log	5.5667	334	0.8582	0.7169	0.8582	0.9264
No log	5.6	336	0.9073	0.6640	0.9073	0.9525
No log	5.6333	338	0.9976	0.6457	0.9976	0.9988
No log	5.6667	340	0.9546	0.6575	0.9546	0.9770
No log	5.7	342	0.8427	0.7049	0.8427	0.9180
No log	5.7333	344	0.7108	0.7532	0.7108	0.8431
No log	5.7667	346	0.6584	0.7520	0.6584	0.8114
No log	5.8	348	0.6408	0.7488	0.6408	0.8005
No log	5.8333	350	0.6457	0.7442	0.6457	0.8035
No log	5.8667	352	0.6776	0.7564	0.6776	0.8232
No log	5.9	354	0.7015	0.7724	0.7015	0.8376
No log	5.9333	356	0.7395	0.7572	0.7395	0.8599
No log	5.9667	358	0.7199	0.7544	0.7199	0.8485
No log	6.0	360	0.7166	0.7470	0.7166	0.8465
No log	6.0333	362	0.6651	0.7686	0.6651	0.8155
No log	6.0667	364	0.6434	0.7624	0.6434	0.8021
No log	6.1	366	0.6515	0.7727	0.6515	0.8071
No log	6.1333	368	0.6378	0.7674	0.6378	0.7986
No log	6.1667	370	0.6241	0.7679	0.6241	0.7900
No log	6.2	372	0.6246	0.7605	0.6246	0.7903
No log	6.2333	374	0.6529	0.7777	0.6529	0.8080
No log	6.2667	376	0.7178	0.7603	0.7178	0.8473
No log	6.3	378	0.7569	0.7552	0.7569	0.8700
No log	6.3333	380	0.7280	0.7639	0.7280	0.8532
No log	6.3667	382	0.7221	0.7602	0.7221	0.8497
No log	6.4	384	0.7309	0.7475	0.7309	0.8549
No log	6.4333	386	0.7341	0.7469	0.7341	0.8568
No log	6.4667	388	0.7020	0.7475	0.7020	0.8378
No log	6.5	390	0.6578	0.7761	0.6578	0.8110
No log	6.5333	392	0.6382	0.7609	0.6382	0.7988
No log	6.5667	394	0.6194	0.7470	0.6194	0.7870
No log	6.6	396	0.6228	0.7387	0.6228	0.7892
No log	6.6333	398	0.6467	0.7379	0.6467	0.8042
No log	6.6667	400	0.7175	0.7426	0.7175	0.8471
No log	6.7	402	0.7775	0.7234	0.7775	0.8818
No log	6.7333	404	0.8033	0.7290	0.8033	0.8963
No log	6.7667	406	0.7674	0.7509	0.7674	0.8760
No log	6.8	408	0.7103	0.7780	0.7103	0.8428
No log	6.8333	410	0.6732	0.7860	0.6732	0.8205
No log	6.8667	412	0.6718	0.7860	0.6718	0.8197
No log	6.9	414	0.6637	0.7826	0.6637	0.8147
No log	6.9333	416	0.6531	0.7826	0.6531	0.8082
No log	6.9667	418	0.6761	0.7821	0.6761	0.8222
No log	7.0	420	0.7395	0.7457	0.7395	0.8600
No log	7.0333	422	0.8485	0.7123	0.8485	0.9211
No log	7.0667	424	0.9034	0.6944	0.9034	0.9505
No log	7.1	426	0.8823	0.6962	0.8823	0.9393
No log	7.1333	428	0.8147	0.7330	0.8147	0.9026
No log	7.1667	430	0.7438	0.7416	0.7438	0.8624
No log	7.2	432	0.6904	0.7469	0.6904	0.8309
No log	7.2333	434	0.6560	0.7784	0.6560	0.8099
No log	7.2667	436	0.6485	0.7860	0.6485	0.8053
No log	7.3	438	0.6715	0.7745	0.6715	0.8195
No log	7.3333	440	0.7062	0.7699	0.7062	0.8403
No log	7.3667	442	0.7093	0.7699	0.7093	0.8422
No log	7.4	444	0.6750	0.7675	0.6750	0.8216
No log	7.4333	446	0.6433	0.7893	0.6433	0.8021
No log	7.4667	448	0.6359	0.7901	0.6359	0.7974
No log	7.5	450	0.6575	0.7675	0.6575	0.8109
No log	7.5333	452	0.7076	0.7740	0.7076	0.8412
No log	7.5667	454	0.7343	0.7694	0.7343	0.8569
No log	7.6	456	0.7370	0.7694	0.7370	0.8585
No log	7.6333	458	0.7118	0.7629	0.7118	0.8437
No log	7.6667	460	0.7044	0.7633	0.7044	0.8393
No log	7.7	462	0.7097	0.7669	0.7097	0.8424
No log	7.7333	464	0.6859	0.7717	0.6859	0.8282
No log	7.7667	466	0.6675	0.7681	0.6675	0.8170
No log	7.8	468	0.6651	0.7722	0.6651	0.8155
No log	7.8333	470	0.6793	0.7716	0.6793	0.8242
No log	7.8667	472	0.7163	0.7745	0.7163	0.8463
No log	7.9	474	0.7492	0.7733	0.7492	0.8655
No log	7.9333	476	0.7702	0.7609	0.7702	0.8776
No log	7.9667	478	0.7800	0.7609	0.7800	0.8832
No log	8.0	480	0.7817	0.7609	0.7817	0.8841
No log	8.0333	482	0.7763	0.7609	0.7763	0.8811
No log	8.0667	484	0.7524	0.7649	0.7524	0.8674
No log	8.1	486	0.7078	0.7616	0.7078	0.8413
No log	8.1333	488	0.6621	0.7650	0.6621	0.8137
No log	8.1667	490	0.6407	0.7595	0.6407	0.8004
No log	8.2	492	0.6250	0.7722	0.6250	0.7906
No log	8.2333	494	0.6302	0.7722	0.6302	0.7938
No log	8.2667	496	0.6460	0.7595	0.6460	0.8037
No log	8.3	498	0.6715	0.7650	0.6715	0.8195
0.3428	8.3333	500	0.6969	0.7717	0.6969	0.8348
0.3428	8.3667	502	0.7158	0.7705	0.7158	0.8460
0.3428	8.4	504	0.7265	0.7682	0.7265	0.8523
0.3428	8.4333	506	0.7349	0.7682	0.7349	0.8573
0.3428	8.4667	508	0.7457	0.7559	0.7457	0.8636
0.3428	8.5	510	0.7414	0.7563	0.7414	0.8611
0.3428	8.5333	512	0.7219	0.7554	0.7219	0.8496
0.3428	8.5667	514	0.7040	0.7554	0.7040	0.8390
0.3428	8.6	516	0.6907	0.7596	0.6907	0.8311
0.3428	8.6333	518	0.6899	0.7554	0.6899	0.8306
0.3428	8.6667	520	0.6973	0.7554	0.6973	0.8350
0.3428	8.7	522	0.6956	0.7554	0.6956	0.8340
0.3428	8.7333	524	0.7025	0.7628	0.7025	0.8382
0.3428	8.7667	526	0.7169	0.7628	0.7169	0.8467
0.3428	8.8	528	0.7384	0.7688	0.7384	0.8593
0.3428	8.8333	530	0.7704	0.7531	0.7704	0.8777
0.3428	8.8667	532	0.7977	0.7371	0.7977	0.8932
0.3428	8.9	534	0.8137	0.7371	0.8137	0.9021
0.3428	8.9333	536	0.8213	0.7371	0.8213	0.9062
0.3428	8.9667	538	0.8116	0.7391	0.8116	0.9009
0.3428	9.0	540	0.7887	0.7490	0.7887	0.8881
0.3428	9.0333	542	0.7769	0.7490	0.7769	0.8814
0.3428	9.0667	544	0.7652	0.7490	0.7652	0.8747
0.3428	9.1	546	0.7584	0.7490	0.7584	0.8709
0.3428	9.1333	548	0.7497	0.7531	0.7497	0.8658
0.3428	9.1667	550	0.7350	0.7572	0.7350	0.8573
0.3428	9.2	552	0.7291	0.7729	0.7291	0.8539
0.3428	9.2333	554	0.7284	0.7729	0.7284	0.8535
0.3428	9.2667	556	0.7231	0.7694	0.7231	0.8504
0.3428	9.3	558	0.7273	0.7694	0.7273	0.8528
0.3428	9.3333	560	0.7343	0.7694	0.7343	0.8569
0.3428	9.3667	562	0.7345	0.7729	0.7345	0.8570
0.3428	9.4	564	0.7349	0.7688	0.7349	0.8572
0.3428	9.4333	566	0.7278	0.7688	0.7278	0.8531
0.3428	9.4667	568	0.7200	0.7688	0.7200	0.8486
0.3428	9.5	570	0.7170	0.7576	0.7170	0.8468
0.3428	9.5333	572	0.7176	0.7576	0.7176	0.8471
0.3428	9.5667	574	0.7167	0.7576	0.7167	0.8466
0.3428	9.6	576	0.7134	0.7576	0.7134	0.8446
0.3428	9.6333	578	0.7105	0.7502	0.7105	0.8429
0.3428	9.6667	580	0.7057	0.7502	0.7057	0.8401
0.3428	9.7	582	0.7046	0.7502	0.7046	0.8394
0.3428	9.7333	584	0.7036	0.7544	0.7036	0.8388
0.3428	9.7667	586	0.7008	0.7544	0.7008	0.8371
0.3428	9.8	588	0.6980	0.7664	0.6980	0.8354
0.3428	9.8333	590	0.6974	0.7664	0.6974	0.8351
0.3428	9.8667	592	0.6988	0.7735	0.6988	0.8359
0.3428	9.9	594	0.7012	0.7735	0.7012	0.8374
0.3428	9.9333	596	0.7034	0.7617	0.7034	0.8387
0.3428	9.9667	598	0.7046	0.7617	0.7046	0.8394
0.3428	10.0	600	0.7048	0.7617	0.7048	0.8395

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1