ArabicNewSplits6_FineTuningAraBERTFreeze_run2_AugV5_k3_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7086
• Qwk: 0.5519
• Mse: 0.7086
• Rmse: 0.8418

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	6.2981	-0.0278	6.2981	2.5096
No log	0.4444	4	4.1832	-0.0186	4.1832	2.0453
No log	0.6667	6	2.9329	0.0280	2.9329	1.7126
No log	0.8889	8	2.0277	0.0206	2.0277	1.4240
No log	1.1111	10	1.4269	0.0487	1.4269	1.1945
No log	1.3333	12	1.0821	0.0019	1.0821	1.0402
No log	1.5556	14	0.8628	0.0780	0.8628	0.9289
No log	1.7778	16	0.7456	0.1024	0.7456	0.8635
No log	2.0	18	0.7041	0.2202	0.7041	0.8391
No log	2.2222	20	0.6886	0.3222	0.6886	0.8298
No log	2.4444	22	0.6670	0.3275	0.6670	0.8167
No log	2.6667	24	0.6683	0.2868	0.6683	0.8175
No log	2.8889	26	0.6716	0.3300	0.6716	0.8195
No log	3.1111	28	0.6855	0.2793	0.6855	0.8279
No log	3.3333	30	0.7255	0.1261	0.7255	0.8518
No log	3.5556	32	0.7460	0.1275	0.7460	0.8637
No log	3.7778	34	0.7474	0.1275	0.7474	0.8645
No log	4.0	36	0.7115	0.1940	0.7115	0.8435
No log	4.2222	38	0.6778	0.2014	0.6778	0.8233
No log	4.4444	40	0.6493	0.3440	0.6493	0.8058
No log	4.6667	42	0.6235	0.4167	0.6235	0.7896
No log	4.8889	44	0.6027	0.4046	0.6027	0.7763
No log	5.1111	46	0.5842	0.4070	0.5842	0.7643
No log	5.3333	48	0.5800	0.4344	0.5800	0.7616
No log	5.5556	50	0.5842	0.4316	0.5842	0.7643
No log	5.7778	52	0.5808	0.4344	0.5808	0.7621
No log	6.0	54	0.5580	0.4457	0.5580	0.7470
No log	6.2222	56	0.5453	0.4611	0.5453	0.7384
No log	6.4444	58	0.5396	0.4584	0.5396	0.7346
No log	6.6667	60	0.5368	0.4606	0.5368	0.7327
No log	6.8889	62	0.5362	0.4734	0.5362	0.7322
No log	7.1111	64	0.5348	0.4841	0.5348	0.7313
No log	7.3333	66	0.5272	0.4972	0.5272	0.7261
No log	7.5556	68	0.5259	0.4667	0.5259	0.7252
No log	7.7778	70	0.5359	0.4623	0.5359	0.7321
No log	8.0	72	0.5390	0.4285	0.5390	0.7342
No log	8.2222	74	0.5359	0.4400	0.5359	0.7321
No log	8.4444	76	0.5469	0.4343	0.5469	0.7396
No log	8.6667	78	0.5581	0.4316	0.5581	0.7470
No log	8.8889	80	0.5355	0.4692	0.5355	0.7318
No log	9.1111	82	0.5100	0.4720	0.5100	0.7141
No log	9.3333	84	0.4983	0.5158	0.4983	0.7059
No log	9.5556	86	0.5090	0.5526	0.5090	0.7134
No log	9.7778	88	0.5152	0.5507	0.5152	0.7178
No log	10.0	90	0.5035	0.5351	0.5035	0.7095
No log	10.2222	92	0.4946	0.5328	0.4946	0.7033
No log	10.4444	94	0.4996	0.5147	0.4996	0.7068
No log	10.6667	96	0.5382	0.5172	0.5382	0.7336
No log	10.8889	98	0.5595	0.4665	0.5595	0.7480
No log	11.1111	100	0.5408	0.4552	0.5408	0.7354
No log	11.3333	102	0.5048	0.4679	0.5048	0.7105
No log	11.5556	104	0.4863	0.4793	0.4863	0.6974
No log	11.7778	106	0.4946	0.4820	0.4946	0.7033
No log	12.0	108	0.4958	0.4820	0.4958	0.7041
No log	12.2222	110	0.4929	0.4715	0.4929	0.7021
No log	12.4444	112	0.4899	0.5049	0.4899	0.6999
No log	12.6667	114	0.5274	0.4776	0.5274	0.7262
No log	12.8889	116	0.5523	0.4647	0.5523	0.7432
No log	13.1111	118	0.5374	0.5241	0.5374	0.7331
No log	13.3333	120	0.5070	0.5432	0.5070	0.7120
No log	13.5556	122	0.5016	0.5177	0.5016	0.7082
No log	13.7778	124	0.5253	0.4996	0.5253	0.7248
No log	14.0	126	0.5690	0.4227	0.5690	0.7543
No log	14.2222	128	0.5855	0.4098	0.5855	0.7652
No log	14.4444	130	0.5693	0.4250	0.5693	0.7545
No log	14.6667	132	0.5379	0.5181	0.5379	0.7334
No log	14.8889	134	0.5211	0.5820	0.5211	0.7219
No log	15.1111	136	0.5255	0.5724	0.5255	0.7249
No log	15.3333	138	0.5614	0.5202	0.5614	0.7493
No log	15.5556	140	0.5684	0.5208	0.5684	0.7539
No log	15.7778	142	0.5417	0.5637	0.5417	0.7360
No log	16.0	144	0.5410	0.5677	0.5410	0.7355
No log	16.2222	146	0.5539	0.5671	0.5539	0.7442
No log	16.4444	148	0.5563	0.5580	0.5563	0.7459
No log	16.6667	150	0.5517	0.5659	0.5517	0.7427
No log	16.8889	152	0.5533	0.5782	0.5533	0.7439
No log	17.1111	154	0.5503	0.5803	0.5503	0.7418
No log	17.3333	156	0.5529	0.5773	0.5529	0.7436
No log	17.5556	158	0.5627	0.5869	0.5627	0.7501
No log	17.7778	160	0.5746	0.6129	0.5746	0.7580
No log	18.0	162	0.6119	0.5572	0.6119	0.7823
No log	18.2222	164	0.6480	0.5630	0.6480	0.8050
No log	18.4444	166	0.6406	0.5630	0.6406	0.8004
No log	18.6667	168	0.6177	0.5617	0.6177	0.7860
No log	18.8889	170	0.6029	0.5771	0.6029	0.7764
No log	19.1111	172	0.6060	0.5734	0.6060	0.7784
No log	19.3333	174	0.6064	0.5843	0.6064	0.7787
No log	19.5556	176	0.6136	0.5859	0.6136	0.7834
No log	19.7778	178	0.6240	0.5929	0.6240	0.7900
No log	20.0	180	0.6466	0.5809	0.6466	0.8041
No log	20.2222	182	0.6573	0.5592	0.6573	0.8108
No log	20.4444	184	0.6463	0.6069	0.6463	0.8039
No log	20.6667	186	0.6353	0.5948	0.6353	0.7970
No log	20.8889	188	0.6378	0.5519	0.6378	0.7986
No log	21.1111	190	0.6596	0.5866	0.6596	0.8122
No log	21.3333	192	0.7010	0.6021	0.7010	0.8372
No log	21.5556	194	0.7183	0.5952	0.7183	0.8475
No log	21.7778	196	0.6950	0.5922	0.6950	0.8337
No log	22.0	198	0.6663	0.5282	0.6663	0.8163
No log	22.2222	200	0.6581	0.6039	0.6581	0.8112
No log	22.4444	202	0.6574	0.5719	0.6574	0.8108
No log	22.6667	204	0.6768	0.4708	0.6768	0.8227
No log	22.8889	206	0.6839	0.4520	0.6839	0.8270
No log	23.1111	208	0.6791	0.4500	0.6791	0.8241
No log	23.3333	210	0.6646	0.5082	0.6646	0.8153
No log	23.5556	212	0.6495	0.5631	0.6495	0.8059
No log	23.7778	214	0.6285	0.5748	0.6285	0.7928
No log	24.0	216	0.6219	0.5770	0.6219	0.7886
No log	24.2222	218	0.6207	0.5569	0.6207	0.7879
No log	24.4444	220	0.6124	0.6088	0.6124	0.7825
No log	24.6667	222	0.6118	0.5958	0.6118	0.7822
No log	24.8889	224	0.6169	0.5790	0.6169	0.7854
No log	25.1111	226	0.6176	0.5816	0.6176	0.7859
No log	25.3333	228	0.6153	0.5802	0.6153	0.7844
No log	25.5556	230	0.5982	0.5825	0.5982	0.7735
No log	25.7778	232	0.5993	0.5802	0.5993	0.7742
No log	26.0	234	0.6162	0.5983	0.6162	0.7850
No log	26.2222	236	0.6307	0.5983	0.6307	0.7942
No log	26.4444	238	0.6476	0.5493	0.6476	0.8048
No log	26.6667	240	0.6671	0.5453	0.6671	0.8168
No log	26.8889	242	0.6868	0.5371	0.6868	0.8287
No log	27.1111	244	0.6951	0.5586	0.6951	0.8337
No log	27.3333	246	0.6979	0.5302	0.6979	0.8354
No log	27.5556	248	0.7149	0.5348	0.7149	0.8455
No log	27.7778	250	0.7202	0.5561	0.7202	0.8487
No log	28.0	252	0.7204	0.5642	0.7204	0.8488
No log	28.2222	254	0.7092	0.5693	0.7092	0.8421
No log	28.4444	256	0.7041	0.5758	0.7041	0.8391
No log	28.6667	258	0.6973	0.5335	0.6973	0.8351
No log	28.8889	260	0.6765	0.5423	0.6765	0.8225
No log	29.1111	262	0.6621	0.5375	0.6621	0.8137
No log	29.3333	264	0.6640	0.5473	0.6640	0.8149
No log	29.5556	266	0.6718	0.5402	0.6718	0.8196
No log	29.7778	268	0.6700	0.5402	0.6700	0.8185
No log	30.0	270	0.6832	0.5884	0.6832	0.8265
No log	30.2222	272	0.7049	0.5400	0.7049	0.8396
No log	30.4444	274	0.7078	0.5586	0.7078	0.8413
No log	30.6667	276	0.6859	0.5586	0.6859	0.8282
No log	30.8889	278	0.6427	0.5860	0.6427	0.8017
No log	31.1111	280	0.6344	0.5770	0.6344	0.7965
No log	31.3333	282	0.6403	0.5810	0.6403	0.8002
No log	31.5556	284	0.6439	0.5956	0.6439	0.8025
No log	31.7778	286	0.6618	0.5856	0.6618	0.8135
No log	32.0	288	0.6976	0.5858	0.6976	0.8353
No log	32.2222	290	0.7216	0.5654	0.7216	0.8495
No log	32.4444	292	0.7259	0.5761	0.7259	0.8520
No log	32.6667	294	0.7054	0.5393	0.7054	0.8399
No log	32.8889	296	0.6724	0.5230	0.6724	0.8200
No log	33.1111	298	0.6664	0.5487	0.6664	0.8163
No log	33.3333	300	0.6678	0.5225	0.6678	0.8172
No log	33.5556	302	0.6775	0.5428	0.6775	0.8231
No log	33.7778	304	0.6957	0.5532	0.6957	0.8341
No log	34.0	306	0.7013	0.5533	0.7013	0.8374
No log	34.2222	308	0.6862	0.5820	0.6862	0.8284
No log	34.4444	310	0.6738	0.5725	0.6738	0.8208
No log	34.6667	312	0.6705	0.5723	0.6705	0.8188
No log	34.8889	314	0.6651	0.5843	0.6651	0.8156
No log	35.1111	316	0.6529	0.5469	0.6529	0.8080
No log	35.3333	318	0.6571	0.5511	0.6571	0.8106
No log	35.5556	320	0.6618	0.5677	0.6618	0.8135
No log	35.7778	322	0.6684	0.5677	0.6684	0.8175
No log	36.0	324	0.6643	0.5678	0.6643	0.8151
No log	36.2222	326	0.6491	0.5793	0.6491	0.8057
No log	36.4444	328	0.6418	0.5509	0.6418	0.8011
No log	36.6667	330	0.6392	0.5816	0.6392	0.7995
No log	36.8889	332	0.6424	0.5995	0.6424	0.8015
No log	37.1111	334	0.6552	0.5928	0.6552	0.8095
No log	37.3333	336	0.6782	0.5589	0.6782	0.8235
No log	37.5556	338	0.6956	0.5643	0.6956	0.8341
No log	37.7778	340	0.7016	0.5238	0.7016	0.8376
No log	38.0	342	0.7023	0.5865	0.7023	0.8381
No log	38.2222	344	0.7138	0.5667	0.7138	0.8449
No log	38.4444	346	0.7112	0.5666	0.7112	0.8433
No log	38.6667	348	0.6971	0.5678	0.6971	0.8349
No log	38.8889	350	0.7173	0.5861	0.7173	0.8469
No log	39.1111	352	0.7432	0.5318	0.7432	0.8621
No log	39.3333	354	0.7534	0.5292	0.7534	0.8680
No log	39.5556	356	0.7770	0.5354	0.7770	0.8815
No log	39.7778	358	0.7842	0.5354	0.7842	0.8855
No log	40.0	360	0.7919	0.5208	0.7919	0.8899
No log	40.2222	362	0.7831	0.5032	0.7831	0.8850
No log	40.4444	364	0.7803	0.5307	0.7803	0.8833
No log	40.6667	366	0.7574	0.5498	0.7574	0.8703
No log	40.8889	368	0.7427	0.5805	0.7427	0.8618
No log	41.1111	370	0.7285	0.5805	0.7285	0.8535
No log	41.3333	372	0.7343	0.5272	0.7343	0.8569
No log	41.5556	374	0.7378	0.5481	0.7378	0.8589
No log	41.7778	376	0.7646	0.5570	0.7646	0.8744
No log	42.0	378	0.7731	0.5481	0.7731	0.8792
No log	42.2222	380	0.7596	0.5286	0.7596	0.8716
No log	42.4444	382	0.7280	0.5832	0.7280	0.8532
No log	42.6667	384	0.6852	0.5798	0.6852	0.8278
No log	42.8889	386	0.6634	0.5429	0.6634	0.8145
No log	43.1111	388	0.6595	0.5747	0.6595	0.8121
No log	43.3333	390	0.6633	0.5549	0.6633	0.8145
No log	43.5556	392	0.6921	0.5310	0.6921	0.8319
No log	43.7778	394	0.7375	0.5297	0.7375	0.8588
No log	44.0	396	0.7412	0.5584	0.7412	0.8610
No log	44.2222	398	0.7074	0.5832	0.7074	0.8411
No log	44.4444	400	0.6716	0.5589	0.6716	0.8195
No log	44.6667	402	0.6537	0.5803	0.6537	0.8085
No log	44.8889	404	0.6555	0.5816	0.6555	0.8097
No log	45.1111	406	0.6613	0.5683	0.6613	0.8132
No log	45.3333	408	0.6814	0.5521	0.6814	0.8255
No log	45.5556	410	0.7206	0.5572	0.7206	0.8489
No log	45.7778	412	0.7577	0.5530	0.7577	0.8704
No log	46.0	414	0.7512	0.5544	0.7512	0.8667
No log	46.2222	416	0.7088	0.5711	0.7088	0.8419
No log	46.4444	418	0.6803	0.6109	0.6803	0.8248
No log	46.6667	420	0.6690	0.6047	0.6690	0.8179
No log	46.8889	422	0.6666	0.5763	0.6666	0.8165
No log	47.1111	424	0.6763	0.5697	0.6763	0.8224
No log	47.3333	426	0.6906	0.5344	0.6906	0.8310
No log	47.5556	428	0.7093	0.5266	0.7093	0.8422
No log	47.7778	430	0.7060	0.5453	0.7060	0.8402
No log	48.0	432	0.6971	0.5707	0.6971	0.8349
No log	48.2222	434	0.6792	0.6034	0.6792	0.8242
No log	48.4444	436	0.6626	0.5766	0.6626	0.8140
No log	48.6667	438	0.6609	0.5589	0.6609	0.8130
No log	48.8889	440	0.6808	0.5560	0.6808	0.8251
No log	49.1111	442	0.7048	0.5453	0.7048	0.8395
No log	49.3333	444	0.7215	0.5438	0.7215	0.8494
No log	49.5556	446	0.7256	0.5155	0.7256	0.8518
No log	49.7778	448	0.7133	0.5161	0.7133	0.8446
No log	50.0	450	0.6941	0.5362	0.6941	0.8331
No log	50.2222	452	0.6633	0.5969	0.6633	0.8144
No log	50.4444	454	0.6468	0.5915	0.6468	0.8043
No log	50.6667	456	0.6494	0.5766	0.6494	0.8058
No log	50.8889	458	0.6684	0.5721	0.6684	0.8176
No log	51.1111	460	0.6779	0.5654	0.6779	0.8233
No log	51.3333	462	0.6859	0.5788	0.6859	0.8282
No log	51.5556	464	0.7029	0.5638	0.7029	0.8384
No log	51.7778	466	0.7111	0.5468	0.7111	0.8433
No log	52.0	468	0.7208	0.5432	0.7208	0.8490
No log	52.2222	470	0.7278	0.5432	0.7278	0.8531
No log	52.4444	472	0.7157	0.5432	0.7157	0.8460
No log	52.6667	474	0.7110	0.5638	0.7110	0.8432
No log	52.8889	476	0.7208	0.5639	0.7208	0.8490
No log	53.1111	478	0.7176	0.5750	0.7176	0.8471
No log	53.3333	480	0.6996	0.5818	0.6996	0.8364
No log	53.5556	482	0.6729	0.5828	0.6729	0.8203
No log	53.7778	484	0.6539	0.6011	0.6539	0.8086
No log	54.0	486	0.6517	0.5951	0.6517	0.8073
No log	54.2222	488	0.6641	0.5628	0.6641	0.8149
No log	54.4444	490	0.6913	0.5481	0.6913	0.8314
No log	54.6667	492	0.7140	0.5532	0.7140	0.8450
No log	54.8889	494	0.7185	0.5532	0.7185	0.8476
No log	55.1111	496	0.7085	0.5532	0.7085	0.8417
No log	55.3333	498	0.6892	0.5451	0.6892	0.8302
0.5581	55.5556	500	0.6787	0.5741	0.6787	0.8238
0.5581	55.7778	502	0.6663	0.5790	0.6663	0.8163
0.5581	56.0	504	0.6686	0.5790	0.6686	0.8177
0.5581	56.2222	506	0.6882	0.5725	0.6882	0.8296
0.5581	56.4444	508	0.7058	0.5802	0.7058	0.8401
0.5581	56.6667	510	0.7354	0.5674	0.7354	0.8575
0.5581	56.8889	512	0.7500	0.5726	0.7500	0.8660
0.5581	57.1111	514	0.7535	0.5741	0.7535	0.8680
0.5581	57.3333	516	0.7315	0.5739	0.7315	0.8553
0.5581	57.5556	518	0.7086	0.5519	0.7086	0.8418

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.1+cu121
• Datasets 3.2.0
• Tokenizers 0.19.1