ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run1_AugV5_k4_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.5563
• Qwk: 0.5621
• Mse: 0.5563
• Rmse: 0.7458

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0909	2	4.4329	-0.0257	4.4329	2.1054
No log	0.1818	4	2.4160	0.0644	2.4160	1.5543
No log	0.2727	6	1.3010	0.0599	1.3010	1.1406
No log	0.3636	8	0.9209	-0.0292	0.9209	0.9597
No log	0.4545	10	0.8272	0.2123	0.8272	0.9095
No log	0.5455	12	0.8722	0.1489	0.8722	0.9339
No log	0.6364	14	0.8930	0.2122	0.8930	0.9450
No log	0.7273	16	1.1076	0.1234	1.1076	1.0524
No log	0.8182	18	1.7759	0.1297	1.7759	1.3326
No log	0.9091	20	1.3380	0.0911	1.3380	1.1567
No log	1.0	22	1.1075	0.1457	1.1075	1.0524
No log	1.0909	24	0.9828	0.1939	0.9828	0.9914
No log	1.1818	26	0.9523	0.2280	0.9523	0.9758
No log	1.2727	28	0.8543	0.3712	0.8543	0.9243
No log	1.3636	30	0.7417	0.3161	0.7417	0.8612
No log	1.4545	32	0.6715	0.4228	0.6715	0.8195
No log	1.5455	34	0.6002	0.3557	0.6002	0.7747
No log	1.6364	36	0.7368	0.4376	0.7368	0.8584
No log	1.7273	38	1.3934	0.2394	1.3934	1.1804
No log	1.8182	40	1.6414	0.2127	1.6414	1.2812
No log	1.9091	42	1.0605	0.3770	1.0605	1.0298
No log	2.0	44	0.6818	0.4843	0.6818	0.8257
No log	2.0909	46	0.6846	0.4782	0.6846	0.8274
No log	2.1818	48	0.8409	0.4674	0.8409	0.9170
No log	2.2727	50	1.5306	0.2278	1.5306	1.2372
No log	2.3636	52	1.6862	0.2223	1.6862	1.2985
No log	2.4545	54	1.2419	0.2839	1.2419	1.1144
No log	2.5455	56	0.7252	0.4827	0.7252	0.8516
No log	2.6364	58	0.5824	0.5374	0.5824	0.7631
No log	2.7273	60	0.5726	0.4967	0.5726	0.7567
No log	2.8182	62	0.6148	0.4046	0.6148	0.7841
No log	2.9091	64	0.5647	0.4281	0.5647	0.7515
No log	3.0	66	0.6063	0.4664	0.6063	0.7786
No log	3.0909	68	0.6184	0.4464	0.6184	0.7864
No log	3.1818	70	0.5852	0.4757	0.5852	0.7650
No log	3.2727	72	0.5830	0.4986	0.5830	0.7636
No log	3.3636	74	0.6446	0.5374	0.6446	0.8029
No log	3.4545	76	1.0975	0.3781	1.0975	1.0476
No log	3.5455	78	1.6779	0.2481	1.6779	1.2953
No log	3.6364	80	1.5628	0.2715	1.5628	1.2501
No log	3.7273	82	0.9683	0.5178	0.9683	0.9840
No log	3.8182	84	0.6687	0.5452	0.6687	0.8177
No log	3.9091	86	0.6493	0.5388	0.6493	0.8058
No log	4.0	88	0.6927	0.5033	0.6927	0.8323
No log	4.0909	90	1.0329	0.4309	1.0329	1.0163
No log	4.1818	92	1.1256	0.3913	1.1256	1.0610
No log	4.2727	94	0.8836	0.4652	0.8836	0.9400
No log	4.3636	96	0.7179	0.4158	0.7179	0.8473
No log	4.4545	98	0.7712	0.3870	0.7712	0.8782
No log	4.5455	100	0.7552	0.3955	0.7552	0.8690
No log	4.6364	102	0.6942	0.5579	0.6942	0.8332
No log	4.7273	104	0.7319	0.5457	0.7319	0.8555
No log	4.8182	106	0.7567	0.4436	0.7567	0.8699
No log	4.9091	108	0.7129	0.4348	0.7129	0.8443
No log	5.0	110	0.6146	0.5234	0.6146	0.7840
No log	5.0909	112	0.6398	0.5189	0.6398	0.7999
No log	5.1818	114	0.6487	0.5112	0.6487	0.8054
No log	5.2727	116	0.5790	0.5595	0.5790	0.7609
No log	5.3636	118	0.6602	0.5002	0.6602	0.8125
No log	5.4545	120	0.9113	0.4555	0.9113	0.9546
No log	5.5455	122	1.2125	0.3212	1.2125	1.1012
No log	5.6364	124	0.9865	0.4138	0.9865	0.9932
No log	5.7273	126	0.6282	0.5390	0.6282	0.7926
No log	5.8182	128	0.5632	0.5665	0.5632	0.7504
No log	5.9091	130	0.5743	0.5677	0.5743	0.7578
No log	6.0	132	0.5997	0.5609	0.5997	0.7744
No log	6.0909	134	0.6025	0.5342	0.6025	0.7762
No log	6.1818	136	0.5981	0.5255	0.5981	0.7734
No log	6.2727	138	0.5508	0.5360	0.5508	0.7422
No log	6.3636	140	0.5394	0.5421	0.5394	0.7344
No log	6.4545	142	0.5732	0.5622	0.5732	0.7571
No log	6.5455	144	0.5888	0.5928	0.5888	0.7674
No log	6.6364	146	0.6325	0.5246	0.6325	0.7953
No log	6.7273	148	0.7501	0.5326	0.7501	0.8661
No log	6.8182	150	0.9598	0.5392	0.9598	0.9797
No log	6.9091	152	0.9433	0.5387	0.9433	0.9713
No log	7.0	154	0.7155	0.5481	0.7155	0.8459
No log	7.0909	156	0.7836	0.5536	0.7836	0.8852
No log	7.1818	158	0.8762	0.4933	0.8762	0.9361
No log	7.2727	160	0.7555	0.5193	0.7555	0.8692
No log	7.3636	162	0.6543	0.5455	0.6543	0.8089
No log	7.4545	164	0.6509	0.5280	0.6509	0.8068
No log	7.5455	166	0.6583	0.5406	0.6583	0.8114
No log	7.6364	168	0.6027	0.5513	0.6027	0.7763
No log	7.7273	170	0.6297	0.5226	0.6297	0.7936
No log	7.8182	172	0.6259	0.5431	0.6259	0.7911
No log	7.9091	174	0.6199	0.5623	0.6199	0.7873
No log	8.0	176	0.6146	0.5466	0.6146	0.7840
No log	8.0909	178	0.6837	0.5888	0.6837	0.8269
No log	8.1818	180	0.6769	0.5769	0.6769	0.8227
No log	8.2727	182	0.6369	0.5501	0.6369	0.7981
No log	8.3636	184	0.6209	0.5663	0.6209	0.7879
No log	8.4545	186	0.6072	0.5447	0.6072	0.7793
No log	8.5455	188	0.6372	0.5216	0.6372	0.7982
No log	8.6364	190	0.7517	0.5001	0.7517	0.8670
No log	8.7273	192	0.7205	0.4948	0.7205	0.8488
No log	8.8182	194	0.5833	0.5607	0.5833	0.7637
No log	8.9091	196	0.5879	0.5604	0.5879	0.7667
No log	9.0	198	0.6052	0.5903	0.6052	0.7779
No log	9.0909	200	0.5987	0.5856	0.5987	0.7738
No log	9.1818	202	0.5946	0.5389	0.5946	0.7711
No log	9.2727	204	0.5943	0.5836	0.5943	0.7709
No log	9.3636	206	0.6349	0.5600	0.6349	0.7968
No log	9.4545	208	0.6237	0.5956	0.6237	0.7897
No log	9.5455	210	0.5856	0.6023	0.5856	0.7652
No log	9.6364	212	0.5829	0.5509	0.5829	0.7635
No log	9.7273	214	0.6084	0.5261	0.6084	0.7800
No log	9.8182	216	0.6156	0.5385	0.6156	0.7846
No log	9.9091	218	0.5930	0.5836	0.5930	0.7700
No log	10.0	220	0.5795	0.6035	0.5795	0.7613
No log	10.0909	222	0.5925	0.5269	0.5925	0.7697
No log	10.1818	224	0.6645	0.5727	0.6645	0.8152
No log	10.2727	226	0.6584	0.5727	0.6584	0.8114
No log	10.3636	228	0.6142	0.5630	0.6142	0.7837
No log	10.4545	230	0.5725	0.5564	0.5725	0.7566
No log	10.5455	232	0.6028	0.5305	0.6028	0.7764
No log	10.6364	234	0.5823	0.5690	0.5823	0.7631
No log	10.7273	236	0.5819	0.5706	0.5819	0.7628
No log	10.8182	238	0.5912	0.6006	0.5912	0.7689
No log	10.9091	240	0.5876	0.6132	0.5876	0.7666
No log	11.0	242	0.5773	0.6066	0.5773	0.7598
No log	11.0909	244	0.5780	0.6023	0.5780	0.7603
No log	11.1818	246	0.5842	0.6075	0.5842	0.7643
No log	11.2727	248	0.5685	0.6135	0.5685	0.7540
No log	11.3636	250	0.6985	0.5387	0.6985	0.8357
No log	11.4545	252	0.8999	0.4954	0.8999	0.9486
No log	11.5455	254	0.8112	0.4941	0.8112	0.9007
No log	11.6364	256	0.5840	0.5708	0.5840	0.7642
No log	11.7273	258	0.5212	0.5585	0.5212	0.7219
No log	11.8182	260	0.5817	0.4921	0.5817	0.7627
No log	11.9091	262	0.5466	0.5675	0.5466	0.7393
No log	12.0	264	0.5123	0.5741	0.5123	0.7157
No log	12.0909	266	0.5510	0.5170	0.5510	0.7423
No log	12.1818	268	0.5544	0.5106	0.5544	0.7446
No log	12.2727	270	0.5363	0.5716	0.5363	0.7323
No log	12.3636	272	0.5962	0.6099	0.5962	0.7721
No log	12.4545	274	0.6299	0.5837	0.6299	0.7936
No log	12.5455	276	0.5800	0.5654	0.5800	0.7616
No log	12.6364	278	0.5693	0.5969	0.5693	0.7545
No log	12.7273	280	0.6177	0.5737	0.6177	0.7860
No log	12.8182	282	0.6068	0.5737	0.6068	0.7790
No log	12.9091	284	0.5795	0.5821	0.5795	0.7613
No log	13.0	286	0.5647	0.5565	0.5647	0.7515
No log	13.0909	288	0.6294	0.5462	0.6294	0.7934
No log	13.1818	290	0.6997	0.5347	0.6997	0.8365
No log	13.2727	292	0.6743	0.5456	0.6743	0.8212
No log	13.3636	294	0.6046	0.5250	0.6046	0.7776
No log	13.4545	296	0.5547	0.5830	0.5547	0.7448
No log	13.5455	298	0.5623	0.5762	0.5623	0.7499
No log	13.6364	300	0.5845	0.5601	0.5845	0.7645
No log	13.7273	302	0.6096	0.5635	0.6096	0.7808
No log	13.8182	304	0.6005	0.5734	0.6005	0.7749
No log	13.9091	306	0.5818	0.5568	0.5818	0.7628
No log	14.0	308	0.5719	0.5508	0.5719	0.7562
No log	14.0909	310	0.5669	0.5504	0.5669	0.7529
No log	14.1818	312	0.5772	0.5565	0.5772	0.7597
No log	14.2727	314	0.5895	0.5812	0.5895	0.7678
No log	14.3636	316	0.6012	0.5895	0.6012	0.7754
No log	14.4545	318	0.6115	0.5915	0.6115	0.7820
No log	14.5455	320	0.6102	0.5701	0.6102	0.7811
No log	14.6364	322	0.6219	0.5398	0.6219	0.7886
No log	14.7273	324	0.6082	0.5485	0.6082	0.7799
No log	14.8182	326	0.5903	0.5753	0.5903	0.7683
No log	14.9091	328	0.5854	0.5734	0.5854	0.7651
No log	15.0	330	0.5981	0.5598	0.5981	0.7734
No log	15.0909	332	0.6314	0.5009	0.6314	0.7946
No log	15.1818	334	0.5897	0.5338	0.5897	0.7679
No log	15.2727	336	0.5657	0.5653	0.5657	0.7521
No log	15.3636	338	0.6695	0.5600	0.6695	0.8182
No log	15.4545	340	0.6956	0.5520	0.6956	0.8340
No log	15.5455	342	0.6104	0.5829	0.6104	0.7813
No log	15.6364	344	0.5503	0.5581	0.5503	0.7418
No log	15.7273	346	0.5743	0.5142	0.5743	0.7578
No log	15.8182	348	0.5650	0.5180	0.5650	0.7516
No log	15.9091	350	0.5530	0.5402	0.5530	0.7437
No log	16.0	352	0.5491	0.5500	0.5491	0.7410
No log	16.0909	354	0.5509	0.5103	0.5509	0.7422
No log	16.1818	356	0.5587	0.5251	0.5587	0.7474
No log	16.2727	358	0.5593	0.5144	0.5593	0.7479
No log	16.3636	360	0.5671	0.5301	0.5671	0.7531
No log	16.4545	362	0.5882	0.5616	0.5882	0.7669
No log	16.5455	364	0.5909	0.5437	0.5909	0.7687
No log	16.6364	366	0.5788	0.5349	0.5788	0.7608
No log	16.7273	368	0.5861	0.53	0.5861	0.7656
No log	16.8182	370	0.6036	0.5784	0.6036	0.7769
No log	16.9091	372	0.6142	0.5779	0.6142	0.7837
No log	17.0	374	0.6193	0.5529	0.6193	0.7870
No log	17.0909	376	0.5970	0.5376	0.5970	0.7727
No log	17.1818	378	0.5704	0.5162	0.5704	0.7552
No log	17.2727	380	0.5879	0.5326	0.5879	0.7667
No log	17.3636	382	0.5972	0.5211	0.5972	0.7728
No log	17.4545	384	0.6033	0.5348	0.6033	0.7767
No log	17.5455	386	0.6255	0.5339	0.6255	0.7909
No log	17.6364	388	0.6598	0.5541	0.6598	0.8123
No log	17.7273	390	0.6999	0.5175	0.6999	0.8366
No log	17.8182	392	0.6909	0.5350	0.6909	0.8312
No log	17.9091	394	0.6822	0.5721	0.6822	0.8260
No log	18.0	396	0.7163	0.5485	0.7163	0.8464
No log	18.0909	398	0.6930	0.5670	0.6930	0.8325
No log	18.1818	400	0.6742	0.5544	0.6742	0.8211
No log	18.2727	402	0.7010	0.5451	0.7010	0.8372
No log	18.3636	404	0.7248	0.5231	0.7248	0.8514
No log	18.4545	406	0.6805	0.5769	0.6805	0.8249
No log	18.5455	408	0.6171	0.5327	0.6171	0.7856
No log	18.6364	410	0.5981	0.4978	0.5981	0.7734
No log	18.7273	412	0.6046	0.5179	0.6046	0.7775
No log	18.8182	414	0.5917	0.4799	0.5917	0.7692
No log	18.9091	416	0.6036	0.5763	0.6036	0.7769
No log	19.0	418	0.6005	0.5844	0.6005	0.7749
No log	19.0909	420	0.6130	0.5779	0.6130	0.7829
No log	19.1818	422	0.6009	0.5933	0.6009	0.7752
No log	19.2727	424	0.5995	0.5172	0.5995	0.7743
No log	19.3636	426	0.6345	0.5491	0.6345	0.7966
No log	19.4545	428	0.7006	0.5381	0.7006	0.8370
No log	19.5455	430	0.7260	0.5736	0.7260	0.8520
No log	19.6364	432	0.6673	0.5446	0.6673	0.8169
No log	19.7273	434	0.6006	0.5628	0.6006	0.7750
No log	19.8182	436	0.5799	0.5247	0.5799	0.7615
No log	19.9091	438	0.5620	0.5592	0.5620	0.7497
No log	20.0	440	0.5758	0.5785	0.5758	0.7588
No log	20.0909	442	0.6483	0.5353	0.6483	0.8052
No log	20.1818	444	0.7372	0.4737	0.7372	0.8586
No log	20.2727	446	0.7393	0.5285	0.7393	0.8598
No log	20.3636	448	0.6578	0.5883	0.6578	0.8110
No log	20.4545	450	0.5862	0.5596	0.5862	0.7657
No log	20.5455	452	0.5706	0.5447	0.5706	0.7554
No log	20.6364	454	0.5684	0.5634	0.5684	0.7539
No log	20.7273	456	0.5569	0.5421	0.5569	0.7462
No log	20.8182	458	0.5431	0.5820	0.5431	0.7370
No log	20.9091	460	0.5417	0.5670	0.5417	0.7360
No log	21.0	462	0.5322	0.5565	0.5322	0.7295
No log	21.0909	464	0.5319	0.5877	0.5319	0.7293
No log	21.1818	466	0.5334	0.5877	0.5334	0.7304
No log	21.2727	468	0.5320	0.5683	0.5320	0.7294
No log	21.3636	470	0.5342	0.5884	0.5342	0.7309
No log	21.4545	472	0.5360	0.5521	0.5360	0.7321
No log	21.5455	474	0.5420	0.5515	0.5420	0.7362
No log	21.6364	476	0.5431	0.5705	0.5431	0.7370
No log	21.7273	478	0.5450	0.5875	0.5450	0.7382
No log	21.8182	480	0.5568	0.6052	0.5568	0.7462
No log	21.9091	482	0.5773	0.5832	0.5773	0.7598
No log	22.0	484	0.5791	0.5832	0.5791	0.7610
No log	22.0909	486	0.5688	0.6016	0.5688	0.7542
No log	22.1818	488	0.5693	0.6189	0.5693	0.7545
No log	22.2727	490	0.5725	0.5811	0.5725	0.7566
No log	22.3636	492	0.5673	0.5596	0.5673	0.7532
No log	22.4545	494	0.5662	0.6306	0.5662	0.7525
No log	22.5455	496	0.6093	0.5621	0.6093	0.7806
No log	22.6364	498	0.6552	0.5749	0.6552	0.8094
0.3221	22.7273	500	0.6356	0.5769	0.6356	0.7972
0.3221	22.8182	502	0.5823	0.5641	0.5823	0.7631
0.3221	22.9091	504	0.5432	0.5484	0.5432	0.7370
0.3221	23.0	506	0.5535	0.5856	0.5535	0.7440
0.3221	23.0909	508	0.5521	0.5856	0.5521	0.7431
0.3221	23.1818	510	0.5493	0.5520	0.5493	0.7412
0.3221	23.2727	512	0.5778	0.6146	0.5778	0.7601
0.3221	23.3636	514	0.6364	0.5718	0.6364	0.7977
0.3221	23.4545	516	0.6479	0.5677	0.6479	0.8049
0.3221	23.5455	518	0.5976	0.5779	0.5976	0.7730
0.3221	23.6364	520	0.5484	0.5575	0.5484	0.7405
0.3221	23.7273	522	0.5551	0.5609	0.5551	0.7451
0.3221	23.8182	524	0.5716	0.5104	0.5716	0.7561
0.3221	23.9091	526	0.5723	0.5236	0.5723	0.7565
0.3221	24.0	528	0.5563	0.5621	0.5563	0.7458

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1