ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run1_AugV5_k11_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5854
• Qwk: 0.3617
• Mse: 0.5854
• Rmse: 0.7651

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0357	2	3.2888	-0.0149	3.2888	1.8135
No log	0.0714	4	1.8450	-0.0070	1.8450	1.3583
No log	0.1071	6	1.5939	0.0210	1.5939	1.2625
No log	0.1429	8	0.7923	0.2000	0.7923	0.8901
No log	0.1786	10	0.5749	0.0909	0.5749	0.7582
No log	0.2143	12	0.6012	0.1467	0.6012	0.7754
No log	0.25	14	0.5842	0.1373	0.5842	0.7644
No log	0.2857	16	1.1569	0.1333	1.1569	1.0756
No log	0.3214	18	1.1258	0.0843	1.1258	1.0610
No log	0.3571	20	0.6037	0.1000	0.6037	0.7770
No log	0.3929	22	0.6007	0.1258	0.6007	0.7751
No log	0.4286	24	0.6112	0.1795	0.6112	0.7818
No log	0.4643	26	0.7182	0.2090	0.7182	0.8475
No log	0.5	28	0.7360	0.1230	0.7360	0.8579
No log	0.5357	30	0.7944	0.2222	0.7944	0.8913
No log	0.5714	32	0.8344	0.2566	0.8344	0.9135
No log	0.6071	34	0.8519	0.1610	0.8519	0.9230
No log	0.6429	36	1.0615	0.0988	1.0615	1.0303
No log	0.6786	38	0.8244	0.1691	0.8244	0.9080
No log	0.7143	40	0.8246	0.2432	0.8246	0.9081
No log	0.75	42	0.7661	0.2487	0.7661	0.8753
No log	0.7857	44	0.8844	0.0741	0.8844	0.9404
No log	0.8214	46	0.9413	0.0476	0.9413	0.9702
No log	0.8571	48	0.7364	0.2083	0.7364	0.8582
No log	0.8929	50	0.7090	0.2577	0.7090	0.8420
No log	0.9286	52	0.8989	0.1238	0.8989	0.9481
No log	0.9643	54	0.9604	0.0690	0.9604	0.9800
No log	1.0	56	0.6274	0.1732	0.6274	0.7921
No log	1.0357	58	0.6004	0.2090	0.6004	0.7749
No log	1.0714	60	0.8143	0.1919	0.8143	0.9024
No log	1.1071	62	1.8329	0.1330	1.8329	1.3538
No log	1.1429	64	1.2535	0.1560	1.2535	1.1196
No log	1.1786	66	0.6254	0.3023	0.6254	0.7908
No log	1.2143	68	0.6792	0.2626	0.6792	0.8242
No log	1.25	70	1.0951	0.1579	1.0951	1.0465
No log	1.2857	72	0.8760	0.1429	0.8760	0.9360
No log	1.3214	74	0.6384	0.1568	0.6384	0.7990
No log	1.3571	76	0.6463	0.3231	0.6463	0.8039
No log	1.3929	78	1.6425	0.1076	1.6425	1.2816
No log	1.4286	80	2.0203	0.1111	2.0203	1.4214
No log	1.4643	82	0.9186	0.2653	0.9186	0.9585
No log	1.5	84	1.2062	0.1506	1.2062	1.0983
No log	1.5357	86	2.2607	0.0948	2.2607	1.5036
No log	1.5714	88	1.8763	0.1674	1.8763	1.3698
No log	1.6071	90	0.9151	0.1579	0.9151	0.9566
No log	1.6429	92	0.5943	0.3797	0.5943	0.7709
No log	1.6786	94	0.9603	0.1506	0.9603	0.9799
No log	1.7143	96	0.6973	0.2153	0.6973	0.8351
No log	1.75	98	0.6240	0.1527	0.6240	0.7900
No log	1.7857	100	1.1266	0.0698	1.1266	1.0614
No log	1.8214	102	1.1302	0.0698	1.1302	1.0631
No log	1.8571	104	0.8008	0.1453	0.8008	0.8949
No log	1.8929	106	0.5161	0.2329	0.5161	0.7184
No log	1.9286	108	0.6128	0.2000	0.6128	0.7828
No log	1.9643	110	0.7487	0.2000	0.7487	0.8653
No log	2.0	112	0.6875	0.2670	0.6875	0.8292
No log	2.0357	114	0.6023	0.4404	0.6023	0.7761
No log	2.0714	116	0.5970	0.3118	0.5970	0.7726
No log	2.1071	118	0.7405	0.3619	0.7405	0.8605
No log	2.1429	120	1.1833	0.2802	1.1833	1.0878
No log	2.1786	122	0.8741	0.3509	0.8741	0.9349
No log	2.2143	124	0.9328	0.2581	0.9328	0.9658
No log	2.25	126	0.9364	0.2581	0.9364	0.9677
No log	2.2857	128	0.7070	0.2161	0.7070	0.8408
No log	2.3214	130	0.7451	0.2871	0.7451	0.8632
No log	2.3571	132	0.6637	0.2746	0.6637	0.8147
No log	2.3929	134	0.7222	0.1923	0.7222	0.8498
No log	2.4286	136	0.6514	0.2965	0.6514	0.8071
No log	2.4643	138	0.8178	0.3303	0.8178	0.9043
No log	2.5	140	1.0415	0.3566	1.0415	1.0205
No log	2.5357	142	0.7713	0.2593	0.7713	0.8782
No log	2.5714	144	0.6268	0.2821	0.6268	0.7917
No log	2.6071	146	0.6082	0.3778	0.6082	0.7799
No log	2.6429	148	0.6743	0.2000	0.6743	0.8211
No log	2.6786	150	1.1056	0.1355	1.1056	1.0515
No log	2.7143	152	0.8833	0.1549	0.8833	0.9399
No log	2.75	154	0.5768	0.2000	0.5768	0.7595
No log	2.7857	156	0.8028	0.1925	0.8028	0.8960
No log	2.8214	158	0.9223	0.1333	0.9223	0.9604
No log	2.8571	160	0.7341	0.2077	0.7341	0.8568
No log	2.8929	162	0.5588	0.2533	0.5588	0.7475
No log	2.9286	164	0.8423	0.1923	0.8423	0.9178
No log	2.9643	166	0.8431	0.1921	0.8431	0.9182
No log	3.0	168	0.6579	0.3263	0.6579	0.8111
No log	3.0357	170	0.6133	0.4105	0.6133	0.7831
No log	3.0714	172	0.6153	0.3769	0.6153	0.7844
No log	3.1071	174	0.7683	0.3831	0.7683	0.8765
No log	3.1429	176	1.1209	0.2152	1.1209	1.0587
No log	3.1786	178	1.0304	0.2060	1.0304	1.0151
No log	3.2143	180	0.7233	0.3333	0.7233	0.8505
No log	3.25	182	0.6168	0.3333	0.6168	0.7853
No log	3.2857	184	0.7075	0.3035	0.7075	0.8411
No log	3.3214	186	0.7605	0.3077	0.7605	0.8721
No log	3.3571	188	0.5999	0.3333	0.5999	0.7745
No log	3.3929	190	0.6451	0.2245	0.6451	0.8032
No log	3.4286	192	0.6042	0.3089	0.6042	0.7773
No log	3.4643	194	0.5838	0.2893	0.5838	0.7641
No log	3.5	196	0.7634	0.2563	0.7634	0.8737
No log	3.5357	198	0.6669	0.3398	0.6669	0.8167
No log	3.5714	200	0.6219	0.3143	0.6219	0.7886
No log	3.6071	202	0.7525	0.2727	0.7525	0.8674
No log	3.6429	204	0.6333	0.3052	0.6333	0.7958
No log	3.6786	206	0.6544	0.3131	0.6544	0.8089
No log	3.7143	208	1.0855	0.2439	1.0855	1.0419
No log	3.75	210	1.0467	0.2394	1.0467	1.0231
No log	3.7857	212	0.6383	0.2842	0.6383	0.7990
No log	3.8214	214	0.5609	0.4450	0.5609	0.7489
No log	3.8571	216	0.5622	0.4450	0.5622	0.7498
No log	3.8929	218	0.5457	0.4091	0.5457	0.7387
No log	3.9286	220	0.7809	0.2233	0.7809	0.8837
No log	3.9643	222	1.1951	0.1529	1.1951	1.0932
No log	4.0	224	1.0971	0.2053	1.0971	1.0474
No log	4.0357	226	0.6922	0.2174	0.6922	0.8320
No log	4.0714	228	0.6220	0.3617	0.6220	0.7887
No log	4.1071	230	0.6953	0.2554	0.6953	0.8339
No log	4.1429	232	0.6139	0.3043	0.6139	0.7835
No log	4.1786	234	0.7415	0.2893	0.7415	0.8611
No log	4.2143	236	0.9665	0.1765	0.9665	0.9831
No log	4.25	238	0.8370	0.2442	0.8370	0.9149
No log	4.2857	240	0.6689	0.4033	0.6689	0.8179
No log	4.3214	242	0.6430	0.3161	0.6430	0.8019
No log	4.3571	244	0.7410	0.2308	0.7410	0.8608
No log	4.3929	246	0.7837	0.2727	0.7837	0.8853
No log	4.4286	248	0.7765	0.2727	0.7765	0.8812
No log	4.4643	250	0.6977	0.2709	0.6977	0.8353
No log	4.5	252	0.7274	0.2381	0.7274	0.8529
No log	4.5357	254	0.6748	0.2709	0.6748	0.8214
No log	4.5714	256	0.6724	0.2709	0.6724	0.8200
No log	4.6071	258	0.6873	0.2709	0.6873	0.8290
No log	4.6429	260	0.6548	0.2157	0.6548	0.8092
No log	4.6786	262	0.7175	0.2308	0.7175	0.8470
No log	4.7143	264	0.7465	0.2300	0.7465	0.8640
No log	4.75	266	0.6457	0.2157	0.6457	0.8035
No log	4.7857	268	0.5953	0.3224	0.5953	0.7715
No log	4.8214	270	0.6021	0.3182	0.6021	0.7760
No log	4.8571	272	0.5934	0.2809	0.5934	0.7703
No log	4.8929	274	0.6069	0.2083	0.6069	0.7791
No log	4.9286	276	0.6237	0.2083	0.6237	0.7897
No log	4.9643	278	0.6299	0.2165	0.6299	0.7936
No log	5.0	280	0.6666	0.2637	0.6666	0.8164
No log	5.0357	282	0.7292	0.2566	0.7292	0.8539
No log	5.0714	284	0.7017	0.2963	0.7017	0.8377
No log	5.1071	286	0.6154	0.2670	0.6154	0.7844
No log	5.1429	288	0.5760	0.2609	0.5760	0.7589
No log	5.1786	290	0.5546	0.2381	0.5546	0.7447
No log	5.2143	292	0.5417	0.3609	0.5417	0.7360
No log	5.25	294	0.5742	0.3371	0.5742	0.7578
No log	5.2857	296	0.6247	0.2865	0.6247	0.7904
No log	5.3214	298	0.6239	0.2865	0.6239	0.7899
No log	5.3571	300	0.5706	0.3371	0.5706	0.7554
No log	5.3929	302	0.5320	0.3757	0.5320	0.7294
No log	5.4286	304	0.5380	0.3297	0.5380	0.7335
No log	5.4643	306	0.5905	0.2577	0.5905	0.7684
No log	5.5	308	0.7617	0.3067	0.7617	0.8728
No log	5.5357	310	1.0372	0.2409	1.0372	1.0185
No log	5.5714	312	0.9737	0.2124	0.9737	0.9867
No log	5.6071	314	0.7067	0.2780	0.7067	0.8407
No log	5.6429	316	0.6271	0.3617	0.6271	0.7919
No log	5.6786	318	0.6541	0.2842	0.6541	0.8087
No log	5.7143	320	0.7862	0.25	0.7862	0.8867
No log	5.75	322	0.7970	0.25	0.7970	0.8927
No log	5.7857	324	0.6389	0.3263	0.6389	0.7993
No log	5.8214	326	0.5563	0.3371	0.5563	0.7459
No log	5.8571	328	0.5635	0.2644	0.5635	0.7507
No log	5.8929	330	0.5628	0.3446	0.5628	0.7502
No log	5.9286	332	0.6123	0.3778	0.6123	0.7825
No log	5.9643	334	0.7084	0.2850	0.7084	0.8417
No log	6.0	336	0.8175	0.2217	0.8175	0.9041
No log	6.0357	338	0.7473	0.2830	0.7473	0.8644
No log	6.0714	340	0.6138	0.3661	0.6138	0.7835
No log	6.1071	342	0.5896	0.2967	0.5896	0.7678
No log	6.1429	344	0.6012	0.3591	0.6012	0.7754
No log	6.1786	346	0.7086	0.2830	0.7086	0.8418
No log	6.2143	348	0.7942	0.2217	0.7942	0.8912
No log	6.25	350	0.7503	0.2233	0.7503	0.8662
No log	6.2857	352	0.6190	0.3103	0.6190	0.7868
No log	6.3214	354	0.5440	0.3939	0.5440	0.7376
No log	6.3571	356	0.5316	0.3924	0.5316	0.7291
No log	6.3929	358	0.5530	0.3939	0.5530	0.7436
No log	6.4286	360	0.5915	0.2967	0.5915	0.7691
No log	6.4643	362	0.5564	0.3939	0.5564	0.7459
No log	6.5	364	0.5178	0.4634	0.5178	0.7196
No log	6.5357	366	0.5235	0.35	0.5235	0.7235
No log	6.5714	368	0.5231	0.35	0.5231	0.7233
No log	6.6071	370	0.5224	0.4483	0.5224	0.7228
No log	6.6429	372	0.6292	0.3143	0.6292	0.7932
No log	6.6786	374	0.7397	0.2549	0.7397	0.8600
No log	6.7143	376	0.7198	0.2549	0.7198	0.8484
No log	6.75	378	0.6046	0.3641	0.6046	0.7776
No log	6.7857	380	0.5205	0.3882	0.5205	0.7215
No log	6.8214	382	0.5595	0.4083	0.5595	0.7480
No log	6.8571	384	0.5697	0.4083	0.5697	0.7548
No log	6.8929	386	0.5322	0.35	0.5322	0.7295
No log	6.9286	388	0.5425	0.4152	0.5425	0.7365
No log	6.9643	390	0.6356	0.1837	0.6356	0.7972
No log	7.0	392	0.7081	0.2239	0.7081	0.8415
No log	7.0357	394	0.6592	0.1837	0.6592	0.8119
No log	7.0714	396	0.5629	0.3641	0.5629	0.7503
No log	7.1071	398	0.5324	0.4419	0.5324	0.7296
No log	7.1429	400	0.5359	0.3810	0.5359	0.7320
No log	7.1786	402	0.5365	0.3810	0.5365	0.7325
No log	7.2143	404	0.5324	0.4074	0.5324	0.7297
No log	7.25	406	0.5671	0.3297	0.5671	0.7531
No log	7.2857	408	0.5822	0.3043	0.5822	0.7630
No log	7.3214	410	0.5478	0.4	0.5478	0.7401
No log	7.3571	412	0.5169	0.3711	0.5169	0.7189
No log	7.3929	414	0.5193	0.3865	0.5193	0.7206
No log	7.4286	416	0.5188	0.3865	0.5188	0.7203
No log	7.4643	418	0.5064	0.4491	0.5064	0.7116
No log	7.5	420	0.5237	0.3412	0.5237	0.7237
No log	7.5357	422	0.5487	0.3333	0.5487	0.7407
No log	7.5714	424	0.5627	0.3297	0.5627	0.7501
No log	7.6071	426	0.5628	0.3297	0.5628	0.7502
No log	7.6429	428	0.5421	0.3297	0.5421	0.7362
No log	7.6786	430	0.5460	0.3297	0.5460	0.7389
No log	7.7143	432	0.5592	0.3297	0.5592	0.7478
No log	7.75	434	0.5921	0.3706	0.5921	0.7695
No log	7.7857	436	0.6002	0.3267	0.6002	0.7748
No log	7.8214	438	0.5570	0.2967	0.5570	0.7463
No log	7.8571	440	0.5201	0.4286	0.5201	0.7212
No log	7.8929	442	0.5257	0.4682	0.5257	0.7251
No log	7.9286	444	0.5616	0.2967	0.5616	0.7494
No log	7.9643	446	0.5919	0.25	0.5919	0.7693
No log	8.0	448	0.6303	0.3267	0.6303	0.7939
No log	8.0357	450	0.6678	0.2811	0.6678	0.8172
No log	8.0714	452	0.6776	0.2811	0.6776	0.8232
No log	8.1071	454	0.6266	0.25	0.6266	0.7916
No log	8.1429	456	0.5817	0.3161	0.5817	0.7627
No log	8.1786	458	0.5574	0.4157	0.5574	0.7466
No log	8.2143	460	0.5618	0.4157	0.5618	0.7496
No log	8.25	462	0.5597	0.4157	0.5597	0.7481
No log	8.2857	464	0.5752	0.3617	0.5752	0.7584
No log	8.3214	466	0.6069	0.3200	0.6069	0.7790
No log	8.3571	468	0.6031	0.3200	0.6031	0.7766
No log	8.3929	470	0.6012	0.3200	0.6012	0.7754
No log	8.4286	472	0.5699	0.4157	0.5699	0.7549
No log	8.4643	474	0.5496	0.4682	0.5496	0.7413
No log	8.5	476	0.5479	0.4682	0.5479	0.7402
No log	8.5357	478	0.5623	0.4157	0.5623	0.7499
No log	8.5714	480	0.5928	0.2893	0.5928	0.7700
No log	8.6071	482	0.5953	0.2893	0.5953	0.7716
No log	8.6429	484	0.5777	0.3661	0.5777	0.7601
No log	8.6786	486	0.5656	0.3661	0.5656	0.7521
No log	8.7143	488	0.5749	0.3661	0.5749	0.7582
No log	8.75	490	0.5754	0.3661	0.5754	0.7585
No log	8.7857	492	0.5680	0.3661	0.5680	0.7537
No log	8.8214	494	0.5618	0.4157	0.5618	0.7496
No log	8.8571	496	0.5599	0.4157	0.5599	0.7483
No log	8.8929	498	0.5462	0.4682	0.5462	0.7391
0.4026	8.9286	500	0.5304	0.4152	0.5304	0.7283
0.4026	8.9643	502	0.5262	0.4152	0.5262	0.7254
0.4026	9.0	504	0.5271	0.4152	0.5271	0.7260
0.4026	9.0357	506	0.5351	0.4152	0.5351	0.7315
0.4026	9.0714	508	0.5551	0.4157	0.5551	0.7450
0.4026	9.1071	510	0.5867	0.2994	0.5867	0.7660
0.4026	9.1429	512	0.6249	0.2893	0.6249	0.7905
0.4026	9.1786	514	0.6452	0.2830	0.6452	0.8032
0.4026	9.2143	516	0.6398	0.2893	0.6398	0.7999
0.4026	9.25	518	0.6155	0.2893	0.6155	0.7846
0.4026	9.2857	520	0.5888	0.3297	0.5888	0.7673
0.4026	9.3214	522	0.5645	0.4157	0.5645	0.7514
0.4026	9.3571	524	0.5460	0.4545	0.5460	0.7389
0.4026	9.3929	526	0.5372	0.4152	0.5372	0.7329
0.4026	9.4286	528	0.5304	0.4023	0.5304	0.7283
0.4026	9.4643	530	0.5286	0.4023	0.5286	0.7271
0.4026	9.5	532	0.5296	0.4023	0.5296	0.7277
0.4026	9.5357	534	0.5342	0.4152	0.5342	0.7309
0.4026	9.5714	536	0.5380	0.4545	0.5380	0.7335
0.4026	9.6071	538	0.5450	0.4545	0.5450	0.7382
0.4026	9.6429	540	0.5498	0.4682	0.5498	0.7415
0.4026	9.6786	542	0.5551	0.4157	0.5551	0.7451
0.4026	9.7143	544	0.5631	0.4157	0.5631	0.7504
0.4026	9.75	546	0.5698	0.4157	0.5698	0.7548
0.4026	9.7857	548	0.5794	0.3617	0.5794	0.7612
0.4026	9.8214	550	0.5842	0.3617	0.5842	0.7643
0.4026	9.8571	552	0.5871	0.3617	0.5871	0.7662
0.4026	9.8929	554	0.5866	0.3617	0.5866	0.7659
0.4026	9.9286	556	0.5865	0.3617	0.5865	0.7658
0.4026	9.9643	558	0.5861	0.3617	0.5861	0.7655
0.4026	10.0	560	0.5854	0.3617	0.5854	0.7651

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1