ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run1_AugV5_k13_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6775
• Qwk: 0.6627
• Mse: 0.6775
• Rmse: 0.8231

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0317	2	5.4233	-0.0462	5.4233	2.3288
No log	0.0635	4	3.2372	0.0085	3.2372	1.7992
No log	0.0952	6	3.1171	-0.1456	3.1171	1.7655
No log	0.1270	8	2.1183	-0.0701	2.1183	1.4554
No log	0.1587	10	1.2899	0.1353	1.2899	1.1357
No log	0.1905	12	1.2330	0.1757	1.2330	1.1104
No log	0.2222	14	1.6825	-0.0297	1.6825	1.2971
No log	0.2540	16	1.8692	0.0263	1.8692	1.3672
No log	0.2857	18	2.1344	0.0247	2.1344	1.4610
No log	0.3175	20	1.8537	0.0538	1.8537	1.3615
No log	0.3492	22	1.4342	0.1632	1.4342	1.1976
No log	0.3810	24	1.3570	0.1648	1.3570	1.1649
No log	0.4127	26	1.4601	0.1999	1.4601	1.2083
No log	0.4444	28	1.8417	0.1556	1.8417	1.3571
No log	0.4762	30	2.6565	0.0849	2.6565	1.6299
No log	0.5079	32	2.9066	0.0745	2.9066	1.7049
No log	0.5397	34	2.1636	0.1214	2.1636	1.4709
No log	0.5714	36	1.7651	0.2260	1.7651	1.3286
No log	0.6032	38	1.5836	0.2757	1.5836	1.2584
No log	0.6349	40	1.6321	0.2672	1.6321	1.2775
No log	0.6667	42	1.8467	0.2468	1.8467	1.3589
No log	0.6984	44	1.8112	0.2586	1.8112	1.3458
No log	0.7302	46	1.5796	0.2859	1.5796	1.2568
No log	0.7619	48	1.3782	0.3037	1.3782	1.1740
No log	0.7937	50	1.1022	0.4263	1.1022	1.0498
No log	0.8254	52	1.1465	0.3690	1.1465	1.0707
No log	0.8571	54	1.5987	0.2764	1.5987	1.2644
No log	0.8889	56	2.0762	0.2517	2.0762	1.4409
No log	0.9206	58	1.9229	0.2478	1.9229	1.3867
No log	0.9524	60	1.7262	0.2756	1.7262	1.3138
No log	0.9841	62	1.1766	0.3179	1.1766	1.0847
No log	1.0159	64	0.8413	0.5260	0.8413	0.9172
No log	1.0476	66	0.8237	0.5414	0.8237	0.9076
No log	1.0794	68	0.8163	0.5115	0.8163	0.9035
No log	1.1111	70	0.9136	0.4340	0.9136	0.9558
No log	1.1429	72	0.9469	0.4492	0.9469	0.9731
No log	1.1746	74	0.7958	0.5717	0.7958	0.8921
No log	1.2063	76	0.7919	0.5069	0.7919	0.8899
No log	1.2381	78	0.9441	0.5336	0.9441	0.9717
No log	1.2698	80	1.4857	0.3181	1.4857	1.2189
No log	1.3016	82	1.7723	0.2673	1.7723	1.3313
No log	1.3333	84	1.7737	0.3148	1.7737	1.3318
No log	1.3651	86	1.1300	0.5641	1.1300	1.0630
No log	1.3968	88	0.8125	0.6157	0.8125	0.9014
No log	1.4286	90	0.8727	0.5939	0.8727	0.9342
No log	1.4603	92	0.7803	0.6453	0.7803	0.8834
No log	1.4921	94	0.7927	0.6621	0.7927	0.8903
No log	1.5238	96	0.8559	0.5875	0.8559	0.9251
No log	1.5556	98	0.9533	0.4998	0.9533	0.9764
No log	1.5873	100	0.8976	0.6289	0.8976	0.9474
No log	1.6190	102	0.7258	0.6445	0.7258	0.8519
No log	1.6508	104	0.8636	0.5654	0.8636	0.9293
No log	1.6825	106	1.0368	0.4762	1.0368	1.0182
No log	1.7143	108	0.9031	0.5416	0.9031	0.9503
No log	1.7460	110	0.7610	0.5817	0.7610	0.8724
No log	1.7778	112	0.7453	0.6299	0.7453	0.8633
No log	1.8095	114	0.7463	0.6383	0.7463	0.8639
No log	1.8413	116	0.9946	0.4875	0.9946	0.9973
No log	1.8730	118	1.6035	0.3611	1.6035	1.2663
No log	1.9048	120	1.8432	0.3424	1.8432	1.3577
No log	1.9365	122	1.6758	0.3930	1.6758	1.2945
No log	1.9683	124	1.8618	0.3664	1.8618	1.3645
No log	2.0	126	1.6690	0.4083	1.6690	1.2919
No log	2.0317	128	1.1627	0.5268	1.1627	1.0783
No log	2.0635	130	0.8657	0.5870	0.8657	0.9304
No log	2.0952	132	0.7385	0.6543	0.7385	0.8594
No log	2.1270	134	0.6703	0.6728	0.6703	0.8187
No log	2.1587	136	0.6566	0.6742	0.6566	0.8103
No log	2.1905	138	0.6584	0.6976	0.6584	0.8114
No log	2.2222	140	0.6312	0.7026	0.6312	0.7945
No log	2.2540	142	0.6886	0.6683	0.6886	0.8298
No log	2.2857	144	0.6946	0.6616	0.6946	0.8334
No log	2.3175	146	0.7566	0.6395	0.7566	0.8698
No log	2.3492	148	0.6731	0.6836	0.6731	0.8204
No log	2.3810	150	0.6242	0.7165	0.6242	0.7900
No log	2.4127	152	0.6296	0.7155	0.6296	0.7935
No log	2.4444	154	0.6322	0.7195	0.6322	0.7951
No log	2.4762	156	0.7094	0.7083	0.7094	0.8423
No log	2.5079	158	0.7901	0.6707	0.7901	0.8889
No log	2.5397	160	0.7317	0.6946	0.7317	0.8554
No log	2.5714	162	0.7478	0.6591	0.7478	0.8648
No log	2.6032	164	0.7328	0.7083	0.7328	0.8560
No log	2.6349	166	0.7402	0.6891	0.7402	0.8603
No log	2.6667	168	0.8277	0.6119	0.8277	0.9098
No log	2.6984	170	0.7814	0.6239	0.7814	0.8839
No log	2.7302	172	0.6681	0.7195	0.6681	0.8174
No log	2.7619	174	0.7196	0.6520	0.7196	0.8483
No log	2.7937	176	0.6855	0.6964	0.6855	0.8280
No log	2.8254	178	0.7164	0.7350	0.7164	0.8464
No log	2.8571	180	0.8450	0.6152	0.8450	0.9192
No log	2.8889	182	0.7825	0.6578	0.7825	0.8846
No log	2.9206	184	0.7027	0.7139	0.7027	0.8382
No log	2.9524	186	0.6924	0.6892	0.6924	0.8321
No log	2.9841	188	0.7177	0.7029	0.7177	0.8472
No log	3.0159	190	0.9044	0.6043	0.9044	0.9510
No log	3.0476	192	0.9196	0.5850	0.9196	0.9590
No log	3.0794	194	0.9375	0.6000	0.9375	0.9682
No log	3.1111	196	0.7624	0.6399	0.7624	0.8732
No log	3.1429	198	0.6763	0.6899	0.6763	0.8224
No log	3.1746	200	0.7364	0.6755	0.7364	0.8581
No log	3.2063	202	0.6550	0.7321	0.6550	0.8093
No log	3.2381	204	0.7354	0.6418	0.7354	0.8576
No log	3.2698	206	0.7535	0.6268	0.7535	0.8680
No log	3.3016	208	0.6505	0.7516	0.6505	0.8065
No log	3.3333	210	0.8433	0.6045	0.8433	0.9183
No log	3.3651	212	1.0983	0.5122	1.0983	1.0480
No log	3.3968	214	1.0645	0.5311	1.0645	1.0317
No log	3.4286	216	0.8142	0.5957	0.8142	0.9023
No log	3.4603	218	0.6793	0.6440	0.6793	0.8242
No log	3.4921	220	0.6705	0.6575	0.6705	0.8188
No log	3.5238	222	0.7945	0.6477	0.7945	0.8913
No log	3.5556	224	0.8893	0.6292	0.8893	0.9430
No log	3.5873	226	0.7639	0.6492	0.7639	0.8740
No log	3.6190	228	0.6588	0.7212	0.6588	0.8117
No log	3.6508	230	0.6482	0.7259	0.6482	0.8051
No log	3.6825	232	0.6695	0.7206	0.6695	0.8182
No log	3.7143	234	0.6763	0.7230	0.6763	0.8224
No log	3.7460	236	0.6611	0.7169	0.6611	0.8131
No log	3.7778	238	0.6602	0.7193	0.6602	0.8125
No log	3.8095	240	0.6752	0.7160	0.6752	0.8217
No log	3.8413	242	0.7779	0.6839	0.7779	0.8820
No log	3.8730	244	0.8884	0.6751	0.8884	0.9426
No log	3.9048	246	0.9211	0.6380	0.9211	0.9597
No log	3.9365	248	0.8886	0.6706	0.8886	0.9427
No log	3.9683	250	0.7951	0.6877	0.7951	0.8917
No log	4.0	252	0.7333	0.6994	0.7333	0.8564
No log	4.0317	254	0.7168	0.6671	0.7168	0.8467
No log	4.0635	256	0.7246	0.6337	0.7246	0.8512
No log	4.0952	258	0.7250	0.6371	0.7250	0.8515
No log	4.1270	260	0.7072	0.6748	0.7072	0.8409
No log	4.1587	262	0.7169	0.7014	0.7169	0.8467
No log	4.1905	264	0.7212	0.7010	0.7212	0.8492
No log	4.2222	266	0.7337	0.6975	0.7337	0.8566
No log	4.2540	268	0.7880	0.6617	0.7880	0.8877
No log	4.2857	270	0.9792	0.6448	0.9792	0.9896
No log	4.3175	272	0.9667	0.6420	0.9667	0.9832
No log	4.3492	274	0.8545	0.6419	0.8545	0.9244
No log	4.3810	276	0.7539	0.6834	0.7539	0.8683
No log	4.4127	278	0.7761	0.6505	0.7761	0.8810
No log	4.4444	280	0.7763	0.6505	0.7763	0.8811
No log	4.4762	282	0.8576	0.6524	0.8576	0.9260
No log	4.5079	284	0.8469	0.6479	0.8469	0.9202
No log	4.5397	286	0.7693	0.7035	0.7693	0.8771
No log	4.5714	288	0.7389	0.6997	0.7389	0.8596
No log	4.6032	290	0.7228	0.6893	0.7228	0.8502
No log	4.6349	292	0.6904	0.6821	0.6904	0.8309
No log	4.6667	294	0.6705	0.7004	0.6705	0.8188
No log	4.6984	296	0.6911	0.6663	0.6911	0.8313
No log	4.7302	298	0.6628	0.6652	0.6628	0.8141
No log	4.7619	300	0.6394	0.7002	0.6394	0.7997
No log	4.7937	302	0.6970	0.6764	0.6970	0.8349
No log	4.8254	304	0.7550	0.6614	0.7550	0.8689
No log	4.8571	306	0.7260	0.6573	0.7260	0.8521
No log	4.8889	308	0.6616	0.6903	0.6616	0.8134
No log	4.9206	310	0.6773	0.6877	0.6773	0.8230
No log	4.9524	312	0.7000	0.6785	0.7000	0.8367
No log	4.9841	314	0.6591	0.7145	0.6591	0.8118
No log	5.0159	316	0.6292	0.6995	0.6292	0.7932
No log	5.0476	318	0.6306	0.7048	0.6306	0.7941
No log	5.0794	320	0.6446	0.6421	0.6446	0.8028
No log	5.1111	322	0.6347	0.6953	0.6347	0.7967
No log	5.1429	324	0.6685	0.6827	0.6685	0.8176
No log	5.1746	326	0.8871	0.6458	0.8871	0.9419
No log	5.2063	328	1.0620	0.6480	1.0620	1.0305
No log	5.2381	330	1.1047	0.6113	1.1047	1.0510
No log	5.2698	332	0.9042	0.6382	0.9042	0.9509
No log	5.3016	334	0.7530	0.6819	0.7530	0.8678
No log	5.3333	336	0.7378	0.6852	0.7378	0.8590
No log	5.3651	338	0.7954	0.6288	0.7954	0.8919
No log	5.3968	340	0.7930	0.6288	0.7930	0.8905
No log	5.4286	342	0.7380	0.6405	0.7380	0.8591
No log	5.4603	344	0.6965	0.6577	0.6965	0.8345
No log	5.4921	346	0.6469	0.7012	0.6469	0.8043
No log	5.5238	348	0.7189	0.6606	0.7189	0.8479
No log	5.5556	350	0.7455	0.6519	0.7455	0.8634
No log	5.5873	352	0.6820	0.6759	0.6820	0.8259
No log	5.6190	354	0.6820	0.6415	0.6820	0.8259
No log	5.6508	356	0.6751	0.6465	0.6751	0.8216
No log	5.6825	358	0.7216	0.6561	0.7216	0.8495
No log	5.7143	360	0.7030	0.6507	0.7030	0.8385
No log	5.7460	362	0.6550	0.6770	0.6550	0.8093
No log	5.7778	364	0.6687	0.6968	0.6687	0.8178
No log	5.8095	366	0.6593	0.7024	0.6593	0.8120
No log	5.8413	368	0.6603	0.6877	0.6603	0.8126
No log	5.8730	370	0.6565	0.6928	0.6565	0.8103
No log	5.9048	372	0.6589	0.7093	0.6589	0.8117
No log	5.9365	374	0.7040	0.6503	0.7040	0.8391
No log	5.9683	376	0.6702	0.6576	0.6702	0.8186
No log	6.0	378	0.6438	0.7094	0.6438	0.8024
No log	6.0317	380	0.6568	0.6718	0.6568	0.8104
No log	6.0635	382	0.6900	0.6675	0.6900	0.8307
No log	6.0952	384	0.6462	0.6858	0.6462	0.8038
No log	6.1270	386	0.6477	0.6950	0.6477	0.8048
No log	6.1587	388	0.8063	0.5887	0.8063	0.8980
No log	6.1905	390	0.8156	0.5796	0.8156	0.9031
No log	6.2222	392	0.6939	0.6593	0.6939	0.8330
No log	6.2540	394	0.6395	0.7134	0.6395	0.7997
No log	6.2857	396	0.7075	0.6741	0.7075	0.8411
No log	6.3175	398	0.7084	0.7135	0.7084	0.8416
No log	6.3492	400	0.7015	0.7235	0.7015	0.8376
No log	6.3810	402	0.6600	0.6941	0.6600	0.8124
No log	6.4127	404	0.6564	0.7018	0.6564	0.8102
No log	6.4444	406	0.6637	0.6830	0.6637	0.8147
No log	6.4762	408	0.6530	0.6582	0.6530	0.8081
No log	6.5079	410	0.6934	0.6770	0.6934	0.8327
No log	6.5397	412	0.6924	0.6673	0.6924	0.8321
No log	6.5714	414	0.6533	0.6730	0.6533	0.8083
No log	6.6032	416	0.6535	0.6952	0.6535	0.8084
No log	6.6349	418	0.6614	0.6582	0.6614	0.8132
No log	6.6667	420	0.6615	0.6389	0.6615	0.8133
No log	6.6984	422	0.6885	0.6375	0.6885	0.8297
No log	6.7302	424	0.6892	0.5862	0.6892	0.8302
No log	6.7619	426	0.6774	0.6357	0.6774	0.8230
No log	6.7937	428	0.7012	0.6438	0.7012	0.8374
No log	6.8254	430	0.7716	0.6014	0.7716	0.8784
No log	6.8571	432	0.7268	0.6573	0.7268	0.8525
No log	6.8889	434	0.6703	0.7267	0.6703	0.8187
No log	6.9206	436	0.7113	0.7117	0.7113	0.8434
No log	6.9524	438	0.7049	0.7134	0.7049	0.8396
No log	6.9841	440	0.6751	0.6837	0.6751	0.8217
No log	7.0159	442	0.6585	0.6807	0.6585	0.8115
No log	7.0476	444	0.6647	0.6639	0.6647	0.8153
No log	7.0794	446	0.6780	0.6161	0.6780	0.8234
No log	7.1111	448	0.7142	0.6314	0.7142	0.8451
No log	7.1429	450	0.7558	0.6318	0.7558	0.8694
No log	7.1746	452	0.7133	0.6296	0.7133	0.8446
No log	7.2063	454	0.6545	0.6750	0.6545	0.8090
No log	7.2381	456	0.6441	0.6807	0.6441	0.8026
No log	7.2698	458	0.6413	0.6915	0.6413	0.8008
No log	7.3016	460	0.6632	0.6614	0.6632	0.8143
No log	7.3333	462	0.6829	0.6460	0.6829	0.8264
No log	7.3651	464	0.6903	0.6313	0.6903	0.8309
No log	7.3968	466	0.6455	0.6732	0.6455	0.8034
No log	7.4286	468	0.6403	0.6690	0.6403	0.8002
No log	7.4603	470	0.6451	0.6641	0.6451	0.8032
No log	7.4921	472	0.6706	0.6247	0.6706	0.8189
No log	7.5238	474	0.6575	0.6400	0.6575	0.8108
No log	7.5556	476	0.6594	0.6523	0.6594	0.8121
No log	7.5873	478	0.7128	0.6242	0.7128	0.8442
No log	7.6190	480	0.7149	0.6242	0.7149	0.8455
No log	7.6508	482	0.6774	0.6582	0.6774	0.8230
No log	7.6825	484	0.6987	0.6553	0.6987	0.8359
No log	7.7143	486	0.7568	0.6260	0.7568	0.8699
No log	7.7460	488	0.7522	0.6345	0.7522	0.8673
No log	7.7778	490	0.7139	0.6426	0.7139	0.8449
No log	7.8095	492	0.6633	0.6797	0.6633	0.8144
No log	7.8413	494	0.6637	0.7137	0.6637	0.8147
No log	7.8730	496	0.6692	0.7181	0.6692	0.8181
No log	7.9048	498	0.7206	0.6555	0.7206	0.8489
0.4103	7.9365	500	0.7347	0.6747	0.7347	0.8572
0.4103	7.9683	502	0.7249	0.6730	0.7249	0.8514
0.4103	8.0	504	0.6441	0.6798	0.6441	0.8026
0.4103	8.0317	506	0.6079	0.7060	0.6079	0.7797
0.4103	8.0635	508	0.6685	0.6712	0.6685	0.8176
0.4103	8.0952	510	0.6957	0.6535	0.6957	0.8341
0.4103	8.1270	512	0.6350	0.7413	0.6350	0.7969
0.4103	8.1587	514	0.5761	0.7351	0.5761	0.7590
0.4103	8.1905	516	0.6348	0.6820	0.6348	0.7967
0.4103	8.2222	518	0.6922	0.6767	0.6922	0.8320
0.4103	8.2540	520	0.6539	0.6700	0.6539	0.8087
0.4103	8.2857	522	0.6494	0.6654	0.6494	0.8059
0.4103	8.3175	524	0.6886	0.6672	0.6886	0.8298
0.4103	8.3492	526	0.6833	0.6672	0.6833	0.8266
0.4103	8.3810	528	0.6775	0.6627	0.6775	0.8231

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1