ArabicNewSplits6_FineTuningAraBERT_run3_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9048
• Qwk: 0.6513
• Mse: 0.9048
• Rmse: 0.9512

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	5.0263	-0.0284	5.0263	2.2419
No log	0.0769	4	3.1573	0.0119	3.1573	1.7769
No log	0.1154	6	2.9415	-0.0976	2.9415	1.7151
No log	0.1538	8	3.2140	-0.0935	3.2140	1.7928
No log	0.1923	10	2.2387	-0.0848	2.2387	1.4962
No log	0.2308	12	1.6077	0.0834	1.6077	1.2679
No log	0.2692	14	1.4133	0.0506	1.4133	1.1888
No log	0.3077	16	1.3920	0.1534	1.3920	1.1798
No log	0.3462	18	1.6823	0.0531	1.6823	1.2970
No log	0.3846	20	2.7410	-0.0348	2.7410	1.6556
No log	0.4231	22	2.7552	-0.0296	2.7552	1.6599
No log	0.4615	24	1.6975	0.0308	1.6975	1.3029
No log	0.5	26	1.2731	0.2978	1.2731	1.1283
No log	0.5385	28	1.1390	0.3263	1.1390	1.0672
No log	0.5769	30	1.0858	0.3932	1.0858	1.0420
No log	0.6154	32	1.1819	0.3472	1.1819	1.0871
No log	0.6538	34	1.1061	0.3512	1.1061	1.0517
No log	0.6923	36	1.2376	0.2985	1.2376	1.1125
No log	0.7308	38	1.4910	0.3291	1.4910	1.2211
No log	0.7692	40	1.5018	0.3351	1.5018	1.2255
No log	0.8077	42	1.3802	0.3763	1.3802	1.1748
No log	0.8462	44	1.2725	0.3381	1.2725	1.1281
No log	0.8846	46	1.0350	0.4545	1.0350	1.0174
No log	0.9231	48	0.9276	0.4537	0.9276	0.9631
No log	0.9615	50	0.9059	0.4020	0.9059	0.9518
No log	1.0	52	0.8939	0.4183	0.8939	0.9455
No log	1.0385	54	0.8969	0.4586	0.8969	0.9470
No log	1.0769	56	0.8772	0.4403	0.8772	0.9366
No log	1.1154	58	0.9046	0.4065	0.9046	0.9511
No log	1.1538	60	0.9484	0.4213	0.9484	0.9739
No log	1.1923	62	1.0221	0.4729	1.0221	1.0110
No log	1.2308	64	1.2850	0.3976	1.2850	1.1336
No log	1.2692	66	1.3028	0.3698	1.3028	1.1414
No log	1.3077	68	1.0202	0.4432	1.0202	1.0101
No log	1.3462	70	0.8799	0.4670	0.8799	0.9380
No log	1.3846	72	0.8731	0.4503	0.8731	0.9344
No log	1.4231	74	0.8808	0.3931	0.8808	0.9385
No log	1.4615	76	0.8696	0.4779	0.8696	0.9325
No log	1.5	78	0.9463	0.4992	0.9463	0.9728
No log	1.5385	80	0.9827	0.4839	0.9827	0.9913
No log	1.5769	82	0.8735	0.5655	0.8735	0.9346
No log	1.6154	84	0.8438	0.6143	0.8438	0.9186
No log	1.6538	86	0.7865	0.6363	0.7865	0.8868
No log	1.6923	88	0.7840	0.6453	0.7840	0.8855
No log	1.7308	90	0.7872	0.6356	0.7872	0.8873
No log	1.7692	92	0.8262	0.5941	0.8262	0.9090
No log	1.8077	94	0.8267	0.5879	0.8267	0.9092
No log	1.8462	96	0.9148	0.5440	0.9148	0.9564
No log	1.8846	98	0.8348	0.6274	0.8348	0.9137
No log	1.9231	100	0.7108	0.6075	0.7108	0.8431
No log	1.9615	102	0.7216	0.6608	0.7216	0.8495
No log	2.0	104	0.7997	0.6288	0.7997	0.8942
No log	2.0385	106	0.7846	0.5358	0.7846	0.8858
No log	2.0769	108	0.7773	0.5585	0.7773	0.8816
No log	2.1154	110	0.7309	0.6263	0.7309	0.8549
No log	2.1538	112	0.7288	0.6300	0.7288	0.8537
No log	2.1923	114	0.7406	0.6498	0.7406	0.8606
No log	2.2308	116	0.7925	0.5968	0.7925	0.8902
No log	2.2692	118	0.8670	0.5821	0.8670	0.9311
No log	2.3077	120	0.8898	0.6444	0.8898	0.9433
No log	2.3462	122	0.9000	0.6572	0.9000	0.9487
No log	2.3846	124	0.8506	0.6511	0.8506	0.9223
No log	2.4231	126	0.7623	0.7062	0.7623	0.8731
No log	2.4615	128	0.7391	0.6693	0.7391	0.8597
No log	2.5	130	0.7891	0.6711	0.7891	0.8883
No log	2.5385	132	0.7335	0.6822	0.7335	0.8565
No log	2.5769	134	0.7445	0.7146	0.7445	0.8628
No log	2.6154	136	0.9817	0.5969	0.9817	0.9908
No log	2.6538	138	1.1521	0.5225	1.1521	1.0734
No log	2.6923	140	1.1295	0.5392	1.1295	1.0628
No log	2.7308	142	0.9423	0.5914	0.9423	0.9707
No log	2.7692	144	0.7256	0.6919	0.7256	0.8518
No log	2.8077	146	0.6675	0.6907	0.6675	0.8170
No log	2.8462	148	0.6696	0.6788	0.6696	0.8183
No log	2.8846	150	0.6920	0.6599	0.6920	0.8319
No log	2.9231	152	0.7420	0.6998	0.7420	0.8614
No log	2.9615	154	0.8004	0.6915	0.8004	0.8946
No log	3.0	156	0.7686	0.6623	0.7686	0.8767
No log	3.0385	158	0.7853	0.6766	0.7853	0.8862
No log	3.0769	160	0.8837	0.5989	0.8837	0.9400
No log	3.1154	162	0.9232	0.6005	0.9232	0.9608
No log	3.1538	164	0.8916	0.5853	0.8916	0.9442
No log	3.1923	166	0.8536	0.5808	0.8536	0.9239
No log	3.2308	168	0.8324	0.5821	0.8324	0.9124
No log	3.2692	170	0.7956	0.6190	0.7956	0.8920
No log	3.3077	172	0.7627	0.6039	0.7627	0.8733
No log	3.3462	174	0.7589	0.6187	0.7589	0.8712
No log	3.3846	176	0.7802	0.6474	0.7802	0.8833
No log	3.4231	178	0.8273	0.5983	0.8273	0.9096
No log	3.4615	180	0.9012	0.6122	0.9012	0.9493
No log	3.5	182	0.9829	0.6097	0.9829	0.9914
No log	3.5385	184	0.9759	0.6265	0.9759	0.9879
No log	3.5769	186	0.8973	0.6368	0.8973	0.9473
No log	3.6154	188	0.7972	0.6363	0.7972	0.8929
No log	3.6538	190	0.7781	0.6561	0.7781	0.8821
No log	3.6923	192	0.8283	0.6422	0.8283	0.9101
No log	3.7308	194	0.9659	0.5920	0.9659	0.9828
No log	3.7692	196	1.1024	0.5468	1.1024	1.0499
No log	3.8077	198	1.0942	0.5432	1.0942	1.0460
No log	3.8462	200	0.9583	0.6079	0.9583	0.9789
No log	3.8846	202	0.8314	0.6239	0.8314	0.9118
No log	3.9231	204	0.7717	0.6200	0.7717	0.8785
No log	3.9615	206	0.7381	0.6365	0.7381	0.8591
No log	4.0	208	0.7303	0.6399	0.7303	0.8546
No log	4.0385	210	0.7404	0.6844	0.7404	0.8605
No log	4.0769	212	0.8260	0.6215	0.8260	0.9089
No log	4.1154	214	0.9420	0.5898	0.9420	0.9706
No log	4.1538	216	0.9748	0.5820	0.9748	0.9873
No log	4.1923	218	0.9241	0.6127	0.9241	0.9613
No log	4.2308	220	0.8817	0.6315	0.8817	0.9390
No log	4.2692	222	0.8270	0.6899	0.8270	0.9094
No log	4.3077	224	0.8048	0.6933	0.8048	0.8971
No log	4.3462	226	0.8126	0.6788	0.8126	0.9014
No log	4.3846	228	0.8417	0.6609	0.8417	0.9174
No log	4.4231	230	0.8429	0.6698	0.8429	0.9181
No log	4.4615	232	0.8390	0.6717	0.8390	0.9160
No log	4.5	234	0.8734	0.6598	0.8734	0.9345
No log	4.5385	236	0.8803	0.6574	0.8803	0.9382
No log	4.5769	238	0.8469	0.6816	0.8469	0.9203
No log	4.6154	240	0.8012	0.7038	0.8012	0.8951
No log	4.6538	242	0.7984	0.6827	0.7984	0.8935
No log	4.6923	244	0.7973	0.6677	0.7973	0.8929
No log	4.7308	246	0.7571	0.6825	0.7571	0.8701
No log	4.7692	248	0.7217	0.6768	0.7217	0.8495
No log	4.8077	250	0.7676	0.6912	0.7676	0.8762
No log	4.8462	252	0.8563	0.6581	0.8563	0.9254
No log	4.8846	254	0.9358	0.6259	0.9358	0.9674
No log	4.9231	256	0.9038	0.6218	0.9038	0.9507
No log	4.9615	258	0.8279	0.6430	0.8279	0.9099
No log	5.0	260	0.8164	0.6521	0.8164	0.9035
No log	5.0385	262	0.8039	0.6403	0.8039	0.8966
No log	5.0769	264	0.7685	0.6493	0.7685	0.8766
No log	5.1154	266	0.7551	0.6510	0.7551	0.8690
No log	5.1538	268	0.7715	0.6443	0.7715	0.8783
No log	5.1923	270	0.8180	0.6393	0.8180	0.9044
No log	5.2308	272	0.8919	0.5987	0.8919	0.9444
No log	5.2692	274	0.9318	0.5932	0.9318	0.9653
No log	5.3077	276	0.9068	0.5844	0.9068	0.9523
No log	5.3462	278	0.8684	0.6310	0.8684	0.9319
No log	5.3846	280	0.8256	0.6659	0.8256	0.9086
No log	5.4231	282	0.7847	0.6684	0.7847	0.8858
No log	5.4615	284	0.7619	0.6681	0.7619	0.8729
No log	5.5	286	0.7397	0.6968	0.7397	0.8601
No log	5.5385	288	0.7326	0.7194	0.7326	0.8559
No log	5.5769	290	0.7567	0.6832	0.7567	0.8699
No log	5.6154	292	0.7984	0.6796	0.7984	0.8936
No log	5.6538	294	0.8269	0.6624	0.8269	0.9093
No log	5.6923	296	0.8454	0.6610	0.8454	0.9195
No log	5.7308	298	0.8513	0.6678	0.8513	0.9227
No log	5.7692	300	0.8259	0.6737	0.8259	0.9088
No log	5.8077	302	0.8232	0.6676	0.8232	0.9073
No log	5.8462	304	0.7857	0.6803	0.7857	0.8864
No log	5.8846	306	0.7601	0.6645	0.7601	0.8718
No log	5.9231	308	0.7463	0.6956	0.7463	0.8639
No log	5.9615	310	0.7538	0.6831	0.7538	0.8682
No log	6.0	312	0.7571	0.6704	0.7571	0.8701
No log	6.0385	314	0.7866	0.6462	0.7866	0.8869
No log	6.0769	316	0.8195	0.6609	0.8195	0.9052
No log	6.1154	318	0.8069	0.6544	0.8069	0.8983
No log	6.1538	320	0.7981	0.6395	0.7981	0.8934
No log	6.1923	322	0.8079	0.6440	0.8079	0.8988
No log	6.2308	324	0.8553	0.6238	0.8553	0.9248
No log	6.2692	326	0.9424	0.6418	0.9424	0.9708
No log	6.3077	328	1.0159	0.6114	1.0159	1.0079
No log	6.3462	330	1.0966	0.5926	1.0966	1.0472
No log	6.3846	332	1.1125	0.5840	1.1125	1.0548
No log	6.4231	334	1.0370	0.6073	1.0370	1.0183
No log	6.4615	336	0.9478	0.6327	0.9478	0.9735
No log	6.5	338	0.8232	0.6811	0.8232	0.9073
No log	6.5385	340	0.7482	0.7114	0.7482	0.8650
No log	6.5769	342	0.7297	0.7293	0.7297	0.8542
No log	6.6154	344	0.7401	0.7389	0.7401	0.8603
No log	6.6538	346	0.7627	0.7069	0.7627	0.8733
No log	6.6923	348	0.7613	0.7246	0.7613	0.8725
No log	6.7308	350	0.7492	0.7246	0.7492	0.8656
No log	6.7692	352	0.7274	0.7169	0.7274	0.8529
No log	6.8077	354	0.7302	0.7208	0.7302	0.8545
No log	6.8462	356	0.7680	0.6972	0.7680	0.8764
No log	6.8846	358	0.8089	0.6924	0.8089	0.8994
No log	6.9231	360	0.8419	0.6761	0.8419	0.9175
No log	6.9615	362	0.8922	0.6624	0.8922	0.9446
No log	7.0	364	0.9226	0.6620	0.9226	0.9605
No log	7.0385	366	0.9256	0.6645	0.9256	0.9621
No log	7.0769	368	0.8926	0.6740	0.8926	0.9448
No log	7.1154	370	0.8305	0.6729	0.8305	0.9113
No log	7.1538	372	0.7926	0.6603	0.7926	0.8903
No log	7.1923	374	0.7835	0.6603	0.7835	0.8851
No log	7.2308	376	0.8007	0.6603	0.8007	0.8948
No log	7.2692	378	0.8478	0.6764	0.8478	0.9208
No log	7.3077	380	0.8648	0.6808	0.8648	0.9299
No log	7.3462	382	0.8711	0.6897	0.8711	0.9333
No log	7.3846	384	0.8733	0.6897	0.8733	0.9345
No log	7.4231	386	0.9037	0.6742	0.9037	0.9506
No log	7.4615	388	0.9041	0.6742	0.9041	0.9509
No log	7.5	390	0.8836	0.6706	0.8836	0.9400
No log	7.5385	392	0.8395	0.6952	0.8395	0.9163
No log	7.5769	394	0.7859	0.6911	0.7859	0.8865
No log	7.6154	396	0.7491	0.6936	0.7491	0.8655
No log	7.6538	398	0.7351	0.7122	0.7351	0.8574
No log	7.6923	400	0.7207	0.7303	0.7207	0.8489
No log	7.7308	402	0.7193	0.7303	0.7193	0.8481
No log	7.7692	404	0.7387	0.7181	0.7387	0.8595
No log	7.8077	406	0.7719	0.7056	0.7719	0.8786
No log	7.8462	408	0.8362	0.6763	0.8362	0.9145
No log	7.8846	410	0.8836	0.6671	0.8836	0.9400
No log	7.9231	412	0.9089	0.6430	0.9089	0.9534
No log	7.9615	414	0.9009	0.6505	0.9009	0.9492
No log	8.0	416	0.8783	0.6604	0.8783	0.9372
No log	8.0385	418	0.8417	0.6697	0.8417	0.9174
No log	8.0769	420	0.8112	0.6916	0.8112	0.9007
No log	8.1154	422	0.7958	0.6916	0.7958	0.8921
No log	8.1538	424	0.8071	0.6780	0.8071	0.8984
No log	8.1923	426	0.8192	0.6780	0.8192	0.9051
No log	8.2308	428	0.8286	0.6763	0.8286	0.9103
No log	8.2692	430	0.8502	0.6671	0.8502	0.9221
No log	8.3077	432	0.8754	0.6444	0.8754	0.9356
No log	8.3462	434	0.8933	0.6444	0.8933	0.9451
No log	8.3846	436	0.8947	0.6430	0.8947	0.9459
No log	8.4231	438	0.8774	0.6444	0.8774	0.9367
No log	8.4615	440	0.8484	0.6629	0.8484	0.9211
No log	8.5	442	0.8155	0.6730	0.8155	0.9030
No log	8.5385	444	0.7996	0.6633	0.7996	0.8942
No log	8.5769	446	0.7961	0.6790	0.7961	0.8922
No log	8.6154	448	0.8009	0.6678	0.8009	0.8949
No log	8.6538	450	0.8093	0.6688	0.8093	0.8996
No log	8.6923	452	0.8181	0.6688	0.8181	0.9045
No log	8.7308	454	0.8227	0.6688	0.8227	0.9070
No log	8.7692	456	0.8384	0.6706	0.8384	0.9157
No log	8.8077	458	0.8413	0.6706	0.8413	0.9172
No log	8.8462	460	0.8521	0.6706	0.8521	0.9231
No log	8.8846	462	0.8636	0.6723	0.8636	0.9293
No log	8.9231	464	0.8825	0.6697	0.8825	0.9394
No log	8.9615	466	0.8883	0.6697	0.8883	0.9425
No log	9.0	468	0.8905	0.6697	0.8905	0.9437
No log	9.0385	470	0.8884	0.6690	0.8884	0.9425
No log	9.0769	472	0.8742	0.6697	0.8742	0.9350
No log	9.1154	474	0.8596	0.6713	0.8596	0.9272
No log	9.1538	476	0.8552	0.6713	0.8552	0.9248
No log	9.1923	478	0.8553	0.6713	0.8553	0.9248
No log	9.2308	480	0.8697	0.6713	0.8697	0.9326
No log	9.2692	482	0.8917	0.6706	0.8917	0.9443
No log	9.3077	484	0.9080	0.6690	0.9080	0.9529
No log	9.3462	486	0.9205	0.6437	0.9205	0.9594
No log	9.3846	488	0.9306	0.6367	0.9306	0.9647
No log	9.4231	490	0.9410	0.6297	0.9410	0.9700
No log	9.4615	492	0.9556	0.6254	0.9556	0.9775
No log	9.5	494	0.9558	0.6254	0.9558	0.9777
No log	9.5385	496	0.9512	0.6254	0.9512	0.9753
No log	9.5769	498	0.9487	0.6254	0.9487	0.9740
0.4352	9.6154	500	0.9447	0.6254	0.9447	0.9720
0.4352	9.6538	502	0.9394	0.6268	0.9394	0.9692
0.4352	9.6923	504	0.9366	0.6268	0.9366	0.9678
0.4352	9.7308	506	0.9342	0.6402	0.9342	0.9665
0.4352	9.7692	508	0.9277	0.6471	0.9277	0.9632
0.4352	9.8077	510	0.9215	0.6540	0.9215	0.9599
0.4352	9.8462	512	0.9163	0.6513	0.9163	0.9572
0.4352	9.8846	514	0.9122	0.6513	0.9122	0.9551
0.4352	9.9231	516	0.9082	0.6513	0.9082	0.9530
0.4352	9.9615	518	0.9055	0.6513	0.9055	0.9516
0.4352	10.0	520	0.9048	0.6513	0.9048	0.9512

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1