ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run2_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7998
• Qwk: 0.6792
• Mse: 0.7998
• Rmse: 0.8943

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0323	2	5.6802	-0.0649	5.6802	2.3833
No log	0.0645	4	3.1625	0.1025	3.1625	1.7783
No log	0.0968	6	1.8476	0.1163	1.8476	1.3593
No log	0.1290	8	1.3128	0.2797	1.3128	1.1458
No log	0.1613	10	1.1391	0.1814	1.1391	1.0673
No log	0.1935	12	1.6168	0.0532	1.6168	1.2715
No log	0.2258	14	2.1401	-0.1675	2.1401	1.4629
No log	0.2581	16	1.8629	-0.1111	1.8629	1.3649
No log	0.2903	18	1.4279	0.0529	1.4279	1.1949
No log	0.3226	20	1.3872	0.0478	1.3872	1.1778
No log	0.3548	22	1.2581	0.1596	1.2581	1.1217
No log	0.3871	24	1.2414	0.2179	1.2414	1.1142
No log	0.4194	26	1.1418	0.2085	1.1418	1.0685
No log	0.4516	28	1.1472	0.0698	1.1472	1.0711
No log	0.4839	30	1.2105	0.0443	1.2105	1.1002
No log	0.5161	32	1.2738	0.0222	1.2738	1.1286
No log	0.5484	34	1.3980	-0.0171	1.3980	1.1824
No log	0.5806	36	1.5104	-0.0074	1.5104	1.2290
No log	0.6129	38	1.7068	-0.0596	1.7068	1.3065
No log	0.6452	40	1.5276	-0.0063	1.5276	1.2360
No log	0.6774	42	1.2847	0.1084	1.2847	1.1335
No log	0.7097	44	1.3252	0.0945	1.3252	1.1512
No log	0.7419	46	1.2284	0.1578	1.2284	1.1083
No log	0.7742	48	1.0871	0.2822	1.0871	1.0427
No log	0.8065	50	0.9400	0.4258	0.9400	0.9696
No log	0.8387	52	0.8512	0.4954	0.8512	0.9226
No log	0.8710	54	0.8978	0.5438	0.8978	0.9475
No log	0.9032	56	0.8546	0.5604	0.8546	0.9244
No log	0.9355	58	0.8280	0.5109	0.8280	0.9099
No log	0.9677	60	1.0121	0.4935	1.0121	1.0061
No log	1.0	62	1.0482	0.4639	1.0482	1.0238
No log	1.0323	64	1.2459	0.3974	1.2459	1.1162
No log	1.0645	66	1.4198	0.3508	1.4198	1.1915
No log	1.0968	68	1.1294	0.4300	1.1294	1.0627
No log	1.1290	70	0.7913	0.5553	0.7913	0.8895
No log	1.1613	72	0.8556	0.5856	0.8556	0.9250
No log	1.1935	74	0.8049	0.5761	0.8049	0.8972
No log	1.2258	76	0.7496	0.5980	0.7496	0.8658
No log	1.2581	78	0.7550	0.6137	0.7550	0.8689
No log	1.2903	80	0.7652	0.6433	0.7652	0.8748
No log	1.3226	82	0.7790	0.6172	0.7790	0.8826
No log	1.3548	84	0.7324	0.6369	0.7324	0.8558
No log	1.3871	86	0.7338	0.5888	0.7338	0.8566
No log	1.4194	88	0.7501	0.5933	0.7501	0.8661
No log	1.4516	90	0.8003	0.5882	0.8003	0.8946
No log	1.4839	92	0.8865	0.6366	0.8865	0.9415
No log	1.5161	94	0.9167	0.6580	0.9167	0.9575
No log	1.5484	96	1.0243	0.5918	1.0243	1.0121
No log	1.5806	98	0.9626	0.6412	0.9626	0.9811
No log	1.6129	100	0.9030	0.6371	0.9030	0.9503
No log	1.6452	102	0.7135	0.6804	0.7135	0.8447
No log	1.6774	104	0.6768	0.6884	0.6768	0.8227
No log	1.7097	106	0.7413	0.6757	0.7413	0.8610
No log	1.7419	108	0.7275	0.6882	0.7275	0.8530
No log	1.7742	110	0.6751	0.6740	0.6751	0.8217
No log	1.8065	112	0.6557	0.6771	0.6557	0.8097
No log	1.8387	114	0.6471	0.6771	0.6471	0.8044
No log	1.8710	116	0.6381	0.7109	0.6381	0.7988
No log	1.9032	118	0.6888	0.6950	0.6888	0.8299
No log	1.9355	120	0.7922	0.7042	0.7922	0.8900
No log	1.9677	122	0.7045	0.7276	0.7045	0.8394
No log	2.0	124	0.6579	0.7163	0.6579	0.8111
No log	2.0323	126	0.6995	0.7411	0.6995	0.8364
No log	2.0645	128	0.8388	0.7005	0.8388	0.9159
No log	2.0968	130	0.9131	0.6830	0.9131	0.9556
No log	2.1290	132	0.7247	0.6961	0.7247	0.8513
No log	2.1613	134	0.6573	0.6957	0.6573	0.8107
No log	2.1935	136	0.6631	0.7030	0.6631	0.8143
No log	2.2258	138	0.6954	0.6951	0.6954	0.8339
No log	2.2581	140	1.0863	0.6570	1.0863	1.0423
No log	2.2903	142	1.5595	0.5347	1.5595	1.2488
No log	2.3226	144	1.8292	0.4850	1.8292	1.3525
No log	2.3548	146	1.8527	0.4678	1.8527	1.3611
No log	2.3871	148	1.6323	0.4591	1.6323	1.2776
No log	2.4194	150	1.2457	0.5004	1.2457	1.1161
No log	2.4516	152	0.9898	0.5722	0.9898	0.9949
No log	2.4839	154	0.8836	0.6171	0.8836	0.9400
No log	2.5161	156	0.7711	0.6835	0.7711	0.8781
No log	2.5484	158	0.7198	0.7335	0.7198	0.8484
No log	2.5806	160	0.7234	0.7425	0.7234	0.8505
No log	2.6129	162	0.8380	0.7139	0.8380	0.9154
No log	2.6452	164	0.9846	0.6446	0.9846	0.9922
No log	2.6774	166	0.9578	0.6474	0.9578	0.9787
No log	2.7097	168	0.8572	0.6440	0.8572	0.9258
No log	2.7419	170	0.6956	0.7361	0.6956	0.8340
No log	2.7742	172	0.5819	0.7322	0.5819	0.7629
No log	2.8065	174	0.5685	0.7038	0.5685	0.7540
No log	2.8387	176	0.5923	0.7147	0.5923	0.7696
No log	2.8710	178	0.7779	0.7053	0.7779	0.8820
No log	2.9032	180	1.1151	0.5834	1.1151	1.0560
No log	2.9355	182	1.1771	0.5618	1.1771	1.0849
No log	2.9677	184	1.0114	0.6033	1.0114	1.0057
No log	3.0	186	0.7659	0.6773	0.7659	0.8752
No log	3.0323	188	0.7150	0.6893	0.7150	0.8456
No log	3.0645	190	0.7528	0.6809	0.7528	0.8676
No log	3.0968	192	0.8553	0.6874	0.8553	0.9248
No log	3.1290	194	0.8287	0.7037	0.8287	0.9103
No log	3.1613	196	0.7097	0.7208	0.7097	0.8424
No log	3.1935	198	0.6592	0.7214	0.6592	0.8119
No log	3.2258	200	0.6329	0.7226	0.6329	0.7956
No log	3.2581	202	0.6461	0.7179	0.6461	0.8038
No log	3.2903	204	0.7074	0.7381	0.7074	0.8410
No log	3.3226	206	0.6639	0.7366	0.6639	0.8148
No log	3.3548	208	0.6580	0.7330	0.6580	0.8112
No log	3.3871	210	0.6695	0.7330	0.6695	0.8183
No log	3.4194	212	0.7384	0.7411	0.7384	0.8593
No log	3.4516	214	0.8647	0.6746	0.8647	0.9299
No log	3.4839	216	0.8067	0.6893	0.8067	0.8982
No log	3.5161	218	0.6676	0.6984	0.6676	0.8171
No log	3.5484	220	0.6395	0.6999	0.6395	0.7997
No log	3.5806	222	0.6670	0.6916	0.6670	0.8167
No log	3.6129	224	0.7344	0.7330	0.7344	0.8570
No log	3.6452	226	0.8375	0.6927	0.8375	0.9151
No log	3.6774	228	0.8318	0.6839	0.8318	0.9121
No log	3.7097	230	0.7439	0.7354	0.7439	0.8625
No log	3.7419	232	0.7598	0.7445	0.7598	0.8717
No log	3.7742	234	0.7662	0.7347	0.7662	0.8753
No log	3.8065	236	0.8022	0.7360	0.8022	0.8957
No log	3.8387	238	0.8096	0.7287	0.8096	0.8998
No log	3.8710	240	0.7803	0.7295	0.7803	0.8833
No log	3.9032	242	0.7079	0.7389	0.7079	0.8414
No log	3.9355	244	0.6507	0.7282	0.6507	0.8067
No log	3.9677	246	0.6006	0.7413	0.6006	0.7750
No log	4.0	248	0.6112	0.7272	0.6112	0.7818
No log	4.0323	250	0.7395	0.7452	0.7395	0.8599
No log	4.0645	252	1.0278	0.6228	1.0278	1.0138
No log	4.0968	254	1.2287	0.5583	1.2287	1.1085
No log	4.1290	256	1.0610	0.5881	1.0610	1.0300
No log	4.1613	258	0.7719	0.6990	0.7719	0.8786
No log	4.1935	260	0.6267	0.7136	0.6267	0.7916
No log	4.2258	262	0.6294	0.7228	0.6294	0.7933
No log	4.2581	264	0.7197	0.7486	0.7197	0.8484
No log	4.2903	266	0.9130	0.6861	0.9130	0.9555
No log	4.3226	268	1.2283	0.5993	1.2283	1.1083
No log	4.3548	270	1.3495	0.5821	1.3495	1.1617
No log	4.3871	272	1.1680	0.6174	1.1680	1.0807
No log	4.4194	274	1.0242	0.6539	1.0242	1.0120
No log	4.4516	276	0.9371	0.6649	0.9371	0.9681
No log	4.4839	278	0.8498	0.7046	0.8498	0.9218
No log	4.5161	280	0.8281	0.7015	0.8281	0.9100
No log	4.5484	282	0.8893	0.7053	0.8893	0.9430
No log	4.5806	284	0.8660	0.7059	0.8660	0.9306
No log	4.6129	286	0.8565	0.7076	0.8565	0.9255
No log	4.6452	288	0.8146	0.7174	0.8146	0.9026
No log	4.6774	290	0.8433	0.7226	0.8433	0.9183
No log	4.7097	292	0.8572	0.7226	0.8572	0.9258
No log	4.7419	294	0.9184	0.6706	0.9184	0.9583
No log	4.7742	296	0.8164	0.7389	0.8164	0.9036
No log	4.8065	298	0.7890	0.7557	0.7890	0.8883
No log	4.8387	300	0.8350	0.7405	0.8350	0.9138
No log	4.8710	302	0.9406	0.6755	0.9406	0.9698
No log	4.9032	304	1.0072	0.6475	1.0072	1.0036
No log	4.9355	306	0.9614	0.6724	0.9614	0.9805
No log	4.9677	308	0.8026	0.7161	0.8026	0.8959
No log	5.0	310	0.6661	0.7133	0.6661	0.8162
No log	5.0323	312	0.6559	0.7151	0.6559	0.8099
No log	5.0645	314	0.7066	0.7242	0.7066	0.8406
No log	5.0968	316	0.7626	0.6985	0.7626	0.8733
No log	5.1290	318	0.8393	0.6942	0.8393	0.9162
No log	5.1613	320	0.8646	0.6947	0.8646	0.9298
No log	5.1935	322	0.8843	0.6952	0.8843	0.9404
No log	5.2258	324	0.9316	0.6642	0.9316	0.9652
No log	5.2581	326	0.9131	0.6740	0.9131	0.9556
No log	5.2903	328	0.8784	0.6930	0.8784	0.9372
No log	5.3226	330	0.8493	0.7053	0.8493	0.9216
No log	5.3548	332	0.8872	0.6930	0.8872	0.9419
No log	5.3871	334	0.8954	0.6771	0.8954	0.9463
No log	5.4194	336	0.8608	0.6882	0.8608	0.9278
No log	5.4516	338	0.8467	0.6823	0.8467	0.9202
No log	5.4839	340	0.7444	0.7132	0.7444	0.8628
No log	5.5161	342	0.7255	0.7033	0.7255	0.8518
No log	5.5484	344	0.7223	0.7070	0.7223	0.8499
No log	5.5806	346	0.7194	0.7070	0.7194	0.8482
No log	5.6129	348	0.7463	0.7209	0.7463	0.8639
No log	5.6452	350	0.7700	0.7220	0.7700	0.8775
No log	5.6774	352	0.7420	0.7169	0.7420	0.8614
No log	5.7097	354	0.6672	0.7245	0.6672	0.8168
No log	5.7419	356	0.6436	0.7146	0.6436	0.8023
No log	5.7742	358	0.6560	0.7156	0.6560	0.8099
No log	5.8065	360	0.7089	0.7350	0.7089	0.8419
No log	5.8387	362	0.7610	0.7159	0.7610	0.8724
No log	5.8710	364	0.8286	0.6956	0.8286	0.9103
No log	5.9032	366	0.9434	0.6478	0.9434	0.9713
No log	5.9355	368	0.9922	0.5868	0.9922	0.9961
No log	5.9677	370	0.9139	0.6273	0.9139	0.9560
No log	6.0	372	0.7708	0.7208	0.7708	0.8780
No log	6.0323	374	0.7358	0.7240	0.7358	0.8578
No log	6.0645	376	0.7788	0.7317	0.7788	0.8825
No log	6.0968	378	0.8942	0.6619	0.8942	0.9456
No log	6.1290	380	0.9951	0.6273	0.9951	0.9975
No log	6.1613	382	0.9778	0.6338	0.9778	0.9888
No log	6.1935	384	0.8514	0.6699	0.8514	0.9227
No log	6.2258	386	0.7487	0.7323	0.7487	0.8653
No log	6.2581	388	0.7057	0.7268	0.7057	0.8401
No log	6.2903	390	0.7231	0.7239	0.7231	0.8503
No log	6.3226	392	0.7926	0.7127	0.7926	0.8903
No log	6.3548	394	0.8393	0.6955	0.8393	0.9161
No log	6.3871	396	0.8110	0.7110	0.8110	0.9006
No log	6.4194	398	0.7619	0.7149	0.7619	0.8729
No log	6.4516	400	0.6880	0.7381	0.6880	0.8294
No log	6.4839	402	0.6445	0.7198	0.6445	0.8028
No log	6.5161	404	0.6437	0.7198	0.6437	0.8023
No log	6.5484	406	0.6851	0.7301	0.6851	0.8277
No log	6.5806	408	0.7952	0.7056	0.7952	0.8917
No log	6.6129	410	0.8702	0.6573	0.8702	0.9329
No log	6.6452	412	0.8707	0.6680	0.8707	0.9331
No log	6.6774	414	0.8279	0.6644	0.8279	0.9099
No log	6.7097	416	0.7394	0.7397	0.7394	0.8599
No log	6.7419	418	0.6853	0.7179	0.6853	0.8278
No log	6.7742	420	0.6891	0.7201	0.6891	0.8301
No log	6.8065	422	0.7172	0.7360	0.7172	0.8469
No log	6.8387	424	0.7957	0.7110	0.7957	0.8920
No log	6.8710	426	0.9207	0.6530	0.9207	0.9595
No log	6.9032	428	0.9854	0.6165	0.9854	0.9927
No log	6.9355	430	0.9403	0.6450	0.9403	0.9697
No log	6.9677	432	0.8360	0.6496	0.8360	0.9143
No log	7.0	434	0.7358	0.7311	0.7358	0.8578
No log	7.0323	436	0.6997	0.7360	0.6997	0.8365
No log	7.0645	438	0.6964	0.7382	0.6964	0.8345
No log	7.0968	440	0.7341	0.7311	0.7341	0.8568
No log	7.1290	442	0.7948	0.6803	0.7948	0.8915
No log	7.1613	444	0.8959	0.6432	0.8959	0.9465
No log	7.1935	446	0.9468	0.5768	0.9468	0.9731
No log	7.2258	448	0.9159	0.6197	0.9159	0.9570
No log	7.2581	450	0.8480	0.6407	0.8480	0.9208
No log	7.2903	452	0.8036	0.6627	0.8036	0.8964
No log	7.3226	454	0.8149	0.6593	0.8149	0.9027
No log	7.3548	456	0.8479	0.6429	0.8479	0.9208
No log	7.3871	458	0.8395	0.6646	0.8395	0.9163
No log	7.4194	460	0.8587	0.6413	0.8587	0.9267
No log	7.4516	462	0.8864	0.6324	0.8864	0.9415
No log	7.4839	464	0.9103	0.6310	0.9103	0.9541
No log	7.5161	466	0.8902	0.6365	0.8902	0.9435
No log	7.5484	468	0.8451	0.6612	0.8451	0.9193
No log	7.5806	470	0.7997	0.6809	0.7997	0.8943
No log	7.6129	472	0.8141	0.6685	0.8141	0.9022
No log	7.6452	474	0.7943	0.6809	0.7943	0.8913
No log	7.6774	476	0.7946	0.6792	0.7946	0.8914
No log	7.7097	478	0.8227	0.6735	0.8227	0.9071
No log	7.7419	480	0.8603	0.6481	0.8603	0.9275
No log	7.7742	482	0.8676	0.6413	0.8676	0.9314
No log	7.8065	484	0.8286	0.6628	0.8286	0.9103
No log	7.8387	486	0.7773	0.7023	0.7773	0.8816
No log	7.8710	488	0.7299	0.7204	0.7299	0.8544
No log	7.9032	490	0.7113	0.7216	0.7113	0.8434
No log	7.9355	492	0.7312	0.7167	0.7312	0.8551
No log	7.9677	494	0.7682	0.7121	0.7682	0.8765
No log	8.0	496	0.7840	0.6889	0.7840	0.8854
No log	8.0323	498	0.7995	0.6712	0.7995	0.8941
0.4819	8.0645	500	0.7993	0.6669	0.7993	0.8941
0.4819	8.0968	502	0.8021	0.6653	0.8021	0.8956
0.4819	8.1290	504	0.8312	0.6653	0.8312	0.9117
0.4819	8.1613	506	0.8664	0.6427	0.8664	0.9308
0.4819	8.1935	508	0.8545	0.6537	0.8545	0.9244
0.4819	8.2258	510	0.8061	0.6786	0.8061	0.8978
0.4819	8.2581	512	0.7623	0.7213	0.7623	0.8731
0.4819	8.2903	514	0.7273	0.7317	0.7273	0.8528
0.4819	8.3226	516	0.7221	0.7359	0.7221	0.8497
0.4819	8.3548	518	0.7344	0.7317	0.7344	0.8570
0.4819	8.3871	520	0.7397	0.7254	0.7397	0.8600
0.4819	8.4194	522	0.7357	0.7254	0.7357	0.8577
0.4819	8.4516	524	0.7326	0.7254	0.7326	0.8559
0.4819	8.4839	526	0.7587	0.7152	0.7587	0.8710
0.4819	8.5161	528	0.8126	0.6890	0.8126	0.9014
0.4819	8.5484	530	0.8452	0.6537	0.8452	0.9194
0.4819	8.5806	532	0.8585	0.6537	0.8585	0.9265
0.4819	8.6129	534	0.8391	0.6537	0.8391	0.9160
0.4819	8.6452	536	0.8214	0.6796	0.8214	0.9063
0.4819	8.6774	538	0.7839	0.6908	0.7839	0.8854
0.4819	8.7097	540	0.7333	0.7275	0.7333	0.8563
0.4819	8.7419	542	0.6936	0.7403	0.6936	0.8328
0.4819	8.7742	544	0.6799	0.7429	0.6799	0.8245
0.4819	8.8065	546	0.6863	0.7403	0.6863	0.8284
0.4819	8.8387	548	0.7074	0.7317	0.7074	0.8411
0.4819	8.8710	550	0.7461	0.7136	0.7461	0.8638
0.4819	8.9032	552	0.7791	0.6992	0.7791	0.8827
0.4819	8.9355	554	0.8079	0.6635	0.8079	0.8988
0.4819	8.9677	556	0.8239	0.6635	0.8239	0.9077
0.4819	9.0	558	0.8352	0.6719	0.8352	0.9139
0.4819	9.0323	560	0.8465	0.6703	0.8465	0.9200
0.4819	9.0645	562	0.8598	0.6598	0.8598	0.9272
0.4819	9.0968	564	0.8564	0.6613	0.8564	0.9254
0.4819	9.1290	566	0.8378	0.6635	0.8378	0.9153
0.4819	9.1613	568	0.8066	0.6635	0.8066	0.8981
0.4819	9.1935	570	0.7880	0.6992	0.7880	0.8877
0.4819	9.2258	572	0.7773	0.6992	0.7773	0.8817
0.4819	9.2581	574	0.7756	0.6992	0.7756	0.8807
0.4819	9.2903	576	0.7828	0.6992	0.7828	0.8847
0.4819	9.3226	578	0.7920	0.6897	0.7920	0.8899
0.4819	9.3548	580	0.7951	0.6897	0.7951	0.8917
0.4819	9.3871	582	0.7938	0.6897	0.7938	0.8909
0.4819	9.4194	584	0.7952	0.6897	0.7952	0.8918
0.4819	9.4516	586	0.7910	0.6897	0.7910	0.8894
0.4819	9.4839	588	0.7820	0.7056	0.7820	0.8843
0.4819	9.5161	590	0.7822	0.7056	0.7822	0.8844
0.4819	9.5484	592	0.7888	0.6961	0.7888	0.8882
0.4819	9.5806	594	0.7947	0.6961	0.7947	0.8915
0.4819	9.6129	596	0.7989	0.6897	0.7989	0.8938
0.4819	9.6452	598	0.7969	0.6897	0.7969	0.8927
0.4819	9.6774	600	0.7964	0.6961	0.7964	0.8924
0.4819	9.7097	602	0.7954	0.6961	0.7954	0.8919
0.4819	9.7419	604	0.7918	0.6961	0.7918	0.8898
0.4819	9.7742	606	0.7918	0.6961	0.7918	0.8898
0.4819	9.8065	608	0.7941	0.6961	0.7941	0.8911
0.4819	9.8387	610	0.7943	0.6961	0.7943	0.8913
0.4819	9.8710	612	0.7960	0.6961	0.7960	0.8922
0.4819	9.9032	614	0.7967	0.6961	0.7967	0.8926
0.4819	9.9355	616	0.7984	0.6792	0.7984	0.8935
0.4819	9.9677	618	0.7995	0.6792	0.7995	0.8942
0.4819	10.0	620	0.7998	0.6792	0.7998	0.8943

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1