ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run1_AugV5_k14_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8612
• Qwk: 0.7089
• Mse: 0.8612
• Rmse: 0.9280

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0299	2	6.9552	0.0179	6.9552	2.6373
No log	0.0597	4	4.7609	0.0392	4.7609	2.1819
No log	0.0896	6	5.0457	-0.0965	5.0457	2.2463
No log	0.1194	8	4.0098	-0.1159	4.0098	2.0024
No log	0.1493	10	2.2017	0.1221	2.2017	1.4838
No log	0.1791	12	1.9001	0.1681	1.9001	1.3784
No log	0.2090	14	2.0248	0.1905	2.0248	1.4229
No log	0.2388	16	2.4160	0.0140	2.4160	1.5543
No log	0.2687	18	2.7653	0.0268	2.7653	1.6629
No log	0.2985	20	2.8548	0.0	2.8548	1.6896
No log	0.3284	22	2.7044	0.0	2.7044	1.6445
No log	0.3582	24	2.8093	-0.0134	2.8093	1.6761
No log	0.3881	26	2.5729	0.0	2.5729	1.6040
No log	0.4179	28	2.3539	0.0423	2.3539	1.5343
No log	0.4478	30	2.0392	0.2105	2.0392	1.4280
No log	0.4776	32	1.9704	0.2290	1.9704	1.4037
No log	0.5075	34	2.0451	0.2424	2.0451	1.4301
No log	0.5373	36	2.1202	0.2628	2.1202	1.4561
No log	0.5672	38	2.1466	0.2319	2.1466	1.4651
No log	0.5970	40	2.0161	0.2815	2.0161	1.4199
No log	0.6269	42	1.9297	0.3134	1.9297	1.3891
No log	0.6567	44	1.7629	0.3511	1.7629	1.3278
No log	0.6866	46	1.6448	0.4127	1.6448	1.2825
No log	0.7164	48	1.6364	0.4032	1.6364	1.2792
No log	0.7463	50	1.7931	0.3333	1.7931	1.3391
No log	0.7761	52	2.2018	0.1702	2.2018	1.4838
No log	0.8060	54	2.4093	0.2013	2.4093	1.5522
No log	0.8358	56	2.4219	0.2125	2.4219	1.5562
No log	0.8657	58	2.0278	0.2411	2.0278	1.4240
No log	0.8955	60	1.5631	0.4	1.5631	1.2502
No log	0.9254	62	1.4849	0.4127	1.4849	1.2185
No log	0.9552	64	1.4008	0.4409	1.4008	1.1836
No log	0.9851	66	1.4460	0.4127	1.4460	1.2025
No log	1.0149	68	1.4705	0.4127	1.4705	1.2127
No log	1.0448	70	1.6530	0.4062	1.6530	1.2857
No log	1.0746	72	2.0236	0.2059	2.0236	1.4225
No log	1.1045	74	2.1939	0.1644	2.1939	1.4812
No log	1.1343	76	2.2279	0.2166	2.2279	1.4926
No log	1.1642	78	2.3570	0.2273	2.3570	1.5353
No log	1.1940	80	2.1533	0.2635	2.1533	1.4674
No log	1.2239	82	2.0023	0.3129	2.0023	1.4150
No log	1.2537	84	1.8285	0.3521	1.8285	1.3522
No log	1.2836	86	2.0498	0.2692	2.0498	1.4317
No log	1.3134	88	2.5210	0.2697	2.5210	1.5878
No log	1.3433	90	2.6873	0.2979	2.6873	1.6393
No log	1.3731	92	2.3557	0.2955	2.3557	1.5348
No log	1.4030	94	1.9014	0.3165	1.9014	1.3789
No log	1.4328	96	1.4337	0.4776	1.4337	1.1974
No log	1.4627	98	1.2039	0.5197	1.2039	1.0972
No log	1.4925	100	1.1130	0.5538	1.1130	1.0550
No log	1.5224	102	1.1109	0.5426	1.1109	1.0540
No log	1.5522	104	1.2412	0.5352	1.2412	1.1141
No log	1.5821	106	1.4489	0.5122	1.4489	1.2037
No log	1.6119	108	1.5898	0.48	1.5898	1.2609
No log	1.6418	110	1.7126	0.4556	1.7126	1.3087
No log	1.6716	112	1.6615	0.5057	1.6615	1.2890
No log	1.7015	114	1.4637	0.5	1.4637	1.2098
No log	1.7313	116	1.2762	0.4444	1.2762	1.1297
No log	1.7612	118	1.1770	0.48	1.1770	1.0849
No log	1.7910	120	1.0236	0.5512	1.0236	1.0117
No log	1.8209	122	1.0296	0.5954	1.0296	1.0147
No log	1.8507	124	1.2429	0.5065	1.2429	1.1149
No log	1.8806	126	1.4809	0.5059	1.4809	1.2169
No log	1.9104	128	1.5095	0.4971	1.5095	1.2286
No log	1.9403	130	1.2503	0.5786	1.2503	1.1181
No log	1.9701	132	1.0800	0.625	1.0800	1.0392
No log	2.0	134	1.0347	0.6087	1.0347	1.0172
No log	2.0299	136	0.9745	0.5692	0.9745	0.9872
No log	2.0597	138	0.9533	0.6667	0.9533	0.9764
No log	2.0896	140	0.9738	0.6565	0.9738	0.9868
No log	2.1194	142	0.9102	0.6667	0.9102	0.9540
No log	2.1493	144	0.9016	0.6418	0.9016	0.9495
No log	2.1791	146	0.9403	0.5942	0.9403	0.9697
No log	2.2090	148	0.9656	0.6338	0.9656	0.9826
No log	2.2388	150	1.0604	0.6143	1.0604	1.0298
No log	2.2687	152	1.1622	0.5714	1.1622	1.0781
No log	2.2985	154	1.3636	0.5325	1.3636	1.1677
No log	2.3284	156	1.4373	0.5238	1.4373	1.1989
No log	2.3582	158	1.3683	0.55	1.3683	1.1697
No log	2.3881	160	1.0703	0.6503	1.0703	1.0345
No log	2.4179	162	0.8520	0.6667	0.8520	0.9230
No log	2.4478	164	0.7955	0.7260	0.7955	0.8919
No log	2.4776	166	0.7616	0.7172	0.7616	0.8727
No log	2.5075	168	0.8465	0.6617	0.8465	0.9200
No log	2.5373	170	0.9319	0.6260	0.9319	0.9654
No log	2.5672	172	0.9427	0.6294	0.9427	0.9709
No log	2.5970	174	1.2686	0.5698	1.2686	1.1263
No log	2.6269	176	1.3585	0.5934	1.3585	1.1656
No log	2.6567	178	1.1497	0.6444	1.1497	1.0723
No log	2.6866	180	0.8600	0.6928	0.8600	0.9273
No log	2.7164	182	0.7765	0.7042	0.7765	0.8812
No log	2.7463	184	0.7910	0.6765	0.7910	0.8894
No log	2.7761	186	0.8219	0.6767	0.8219	0.9066
No log	2.8060	188	0.8525	0.6565	0.8525	0.9233
No log	2.8358	190	0.8367	0.7153	0.8367	0.9147
No log	2.8657	192	0.8690	0.6567	0.8690	0.9322
No log	2.8955	194	0.9679	0.625	0.9679	0.9838
No log	2.9254	196	0.9990	0.6094	0.9990	0.9995
No log	2.9552	198	1.0360	0.5942	1.0360	1.0179
No log	2.9851	200	1.1386	0.5767	1.1386	1.0671
No log	3.0149	202	1.0724	0.6182	1.0724	1.0356
No log	3.0448	204	0.9591	0.6709	0.9591	0.9793
No log	3.0746	206	0.8716	0.6815	0.8716	0.9336
No log	3.1045	208	0.8688	0.6767	0.8688	0.9321
No log	3.1343	210	0.8749	0.6963	0.8749	0.9354
No log	3.1642	212	0.8434	0.6061	0.8434	0.9184
No log	3.1940	214	0.8129	0.6331	0.8129	0.9016
No log	3.2239	216	0.7728	0.7190	0.7728	0.8791
No log	3.2537	218	0.7129	0.7190	0.7129	0.8443
No log	3.2836	220	0.6780	0.775	0.6780	0.8234
No log	3.3134	222	0.7293	0.7619	0.7293	0.8540
No log	3.3433	224	0.7614	0.7337	0.7614	0.8726
No log	3.3731	226	0.7669	0.7470	0.7669	0.8758
No log	3.4030	228	0.7467	0.7	0.7467	0.8641
No log	3.4328	230	0.7759	0.7190	0.7759	0.8809
No log	3.4627	232	0.7900	0.7285	0.7900	0.8888
No log	3.4925	234	0.7731	0.7273	0.7731	0.8792
No log	3.5224	236	0.7446	0.7516	0.7446	0.8629
No log	3.5522	238	0.7574	0.7170	0.7574	0.8703
No log	3.5821	240	0.7126	0.7226	0.7126	0.8442
No log	3.6119	242	0.7000	0.7376	0.7000	0.8366
No log	3.6418	244	0.7307	0.7007	0.7307	0.8548
No log	3.6716	246	0.7432	0.7194	0.7432	0.8621
No log	3.7015	248	0.7749	0.7324	0.7749	0.8803
No log	3.7313	250	0.7735	0.7075	0.7735	0.8795
No log	3.7612	252	0.8036	0.7059	0.8036	0.8964
No log	3.7910	254	0.8683	0.6624	0.8683	0.9318
No log	3.8209	256	0.8625	0.6486	0.8625	0.9287
No log	3.8507	258	0.8433	0.6809	0.8433	0.9183
No log	3.8806	260	0.8128	0.6906	0.8128	0.9015
No log	3.9104	262	0.8003	0.6849	0.8003	0.8946
No log	3.9403	264	0.8277	0.6667	0.8277	0.9098
No log	3.9701	266	0.8487	0.6797	0.8487	0.9213
No log	4.0	268	0.8806	0.6584	0.8806	0.9384
No log	4.0299	270	0.7972	0.7261	0.7972	0.8928
No log	4.0597	272	0.7235	0.7297	0.7235	0.8506
No log	4.0896	274	0.8180	0.6763	0.8180	0.9045
No log	4.1194	276	0.9335	0.6377	0.9335	0.9662
No log	4.1493	278	0.8946	0.6619	0.8946	0.9458
No log	4.1791	280	0.7994	0.6763	0.7994	0.8941
No log	4.2090	282	0.7456	0.7595	0.7456	0.8635
No log	4.2388	284	0.8533	0.7108	0.8533	0.9238
No log	4.2687	286	0.9036	0.6627	0.9036	0.9506
No log	4.2985	288	0.8380	0.7152	0.8380	0.9154
No log	4.3284	290	0.7723	0.6974	0.7723	0.8788
No log	4.3582	292	0.7832	0.6714	0.7832	0.8850
No log	4.3881	294	0.7996	0.6667	0.7996	0.8942
No log	4.4179	296	0.8087	0.6619	0.8087	0.8993
No log	4.4478	298	0.8249	0.6944	0.8249	0.9083
No log	4.4776	300	0.8380	0.7075	0.8380	0.9154
No log	4.5075	302	0.8525	0.7075	0.8525	0.9233
No log	4.5373	304	0.7893	0.7162	0.7893	0.8884
No log	4.5672	306	0.7311	0.6939	0.7311	0.8551
No log	4.5970	308	0.7150	0.6939	0.7150	0.8456
No log	4.6269	310	0.7098	0.7403	0.7098	0.8425
No log	4.6567	312	0.8189	0.6988	0.8189	0.9049
No log	4.6866	314	0.8925	0.6585	0.8925	0.9447
No log	4.7164	316	0.8004	0.7073	0.8004	0.8946
No log	4.7463	318	0.7104	0.7273	0.7104	0.8428
No log	4.7761	320	0.7376	0.7	0.7376	0.8588
No log	4.8060	322	0.7591	0.6812	0.7591	0.8713
No log	4.8358	324	0.7681	0.6846	0.7681	0.8764
No log	4.8657	326	0.7809	0.7152	0.7809	0.8837
No log	4.8955	328	0.7556	0.7152	0.7556	0.8692
No log	4.9254	330	0.7168	0.7468	0.7168	0.8466
No log	4.9552	332	0.7047	0.7625	0.7047	0.8394
No log	4.9851	334	0.7304	0.7619	0.7304	0.8546
No log	5.0149	336	0.8320	0.7326	0.8320	0.9121
No log	5.0448	338	0.9499	0.7097	0.9499	0.9746
No log	5.0746	340	0.9154	0.7314	0.9154	0.9568
No log	5.1045	342	0.8193	0.7337	0.8193	0.9052
No log	5.1343	344	0.7610	0.7515	0.7610	0.8724
No log	5.1642	346	0.7259	0.7516	0.7259	0.8520
No log	5.1940	348	0.7074	0.7465	0.7074	0.8410
No log	5.2239	350	0.7449	0.7286	0.7449	0.8631
No log	5.2537	352	0.7529	0.6715	0.7529	0.8677
No log	5.2836	354	0.7527	0.7417	0.7527	0.8676
No log	5.3134	356	0.8001	0.7229	0.8001	0.8945
No log	5.3433	358	0.8208	0.7283	0.8208	0.9060
No log	5.3731	360	0.7562	0.7412	0.7562	0.8696
No log	5.4030	362	0.6826	0.7730	0.6826	0.8262
No log	5.4328	364	0.6778	0.7389	0.6778	0.8233
No log	5.4627	366	0.6770	0.7439	0.6770	0.8228
No log	5.4925	368	0.7209	0.7727	0.7209	0.8491
No log	5.5224	370	0.8102	0.7458	0.8102	0.9001
No log	5.5522	372	0.8288	0.7356	0.8288	0.9104
No log	5.5821	374	0.8016	0.7456	0.8016	0.8953
No log	5.6119	376	0.7812	0.6962	0.7812	0.8839
No log	5.6418	378	0.7885	0.6839	0.7885	0.8880
No log	5.6716	380	0.8178	0.7561	0.8178	0.9043
No log	5.7015	382	0.8929	0.6988	0.8929	0.9449
No log	5.7313	384	0.9277	0.6788	0.9277	0.9632
No log	5.7612	386	0.8710	0.6867	0.8710	0.9333
No log	5.7910	388	0.8191	0.7453	0.8191	0.9050
No log	5.8209	390	0.7933	0.7417	0.7933	0.8907
No log	5.8507	392	0.7809	0.7467	0.7809	0.8837
No log	5.8806	394	0.8082	0.7625	0.8082	0.8990
No log	5.9104	396	0.8308	0.7407	0.8308	0.9115
No log	5.9403	398	0.8561	0.7125	0.8561	0.9253
No log	5.9701	400	0.8834	0.7125	0.8834	0.9399
No log	6.0	402	0.8639	0.7006	0.8639	0.9294
No log	6.0299	404	0.8035	0.7105	0.8035	0.8964
No log	6.0597	406	0.8166	0.7143	0.8166	0.9037
No log	6.0896	408	0.7948	0.7320	0.7948	0.8915
No log	6.1194	410	0.7898	0.7170	0.7898	0.8887
No log	6.1493	412	0.7990	0.7125	0.7990	0.8938
No log	6.1791	414	0.7537	0.7329	0.7537	0.8682
No log	6.2090	416	0.6756	0.8075	0.6756	0.8219
No log	6.2388	418	0.6431	0.7613	0.6431	0.8019
No log	6.2687	420	0.6484	0.7260	0.6484	0.8052
No log	6.2985	422	0.6550	0.7826	0.6550	0.8093
No log	6.3284	424	0.6779	0.7875	0.6779	0.8233
No log	6.3582	426	0.6972	0.7875	0.6972	0.8350
No log	6.3881	428	0.7414	0.7875	0.7414	0.8610
No log	6.4179	430	0.8032	0.7073	0.8032	0.8962
No log	6.4478	432	0.7777	0.7273	0.7777	0.8819
No log	6.4776	434	0.7221	0.7349	0.7221	0.8498
No log	6.5075	436	0.7312	0.7654	0.7312	0.8551
No log	6.5373	438	0.7527	0.7389	0.7527	0.8676
No log	6.5672	440	0.7651	0.725	0.7651	0.8747
No log	6.5970	442	0.7962	0.7425	0.7962	0.8923
No log	6.6269	444	0.8252	0.7485	0.8252	0.9084
No log	6.6567	446	0.7925	0.7456	0.7925	0.8903
No log	6.6866	448	0.8081	0.7613	0.8081	0.8990
No log	6.7164	450	0.8619	0.7042	0.8619	0.9284
No log	6.7463	452	0.9691	0.6187	0.9691	0.9844
No log	6.7761	454	0.9221	0.6667	0.9221	0.9602
No log	6.8060	456	0.8356	0.7083	0.8356	0.9141
No log	6.8358	458	0.8412	0.7133	0.8412	0.9172
No log	6.8657	460	0.8660	0.6536	0.8660	0.9306
No log	6.8955	462	0.9018	0.6531	0.9018	0.9496
No log	6.9254	464	0.8600	0.6483	0.8600	0.9274
No log	6.9552	466	0.7699	0.6917	0.7699	0.8774
No log	6.9851	468	0.7455	0.7111	0.7455	0.8634
No log	7.0149	470	0.7692	0.7206	0.7692	0.8770
No log	7.0448	472	0.7753	0.6866	0.7753	0.8805
No log	7.0746	474	0.8143	0.6357	0.8143	0.9024
No log	7.1045	476	0.9011	0.5891	0.9011	0.9493
No log	7.1343	478	0.9080	0.6197	0.9080	0.9529
No log	7.1642	480	0.8139	0.7105	0.8139	0.9022
No log	7.1940	482	0.7428	0.7436	0.7428	0.8619
No log	7.2239	484	0.7119	0.7702	0.7119	0.8437
No log	7.2537	486	0.7013	0.7702	0.7013	0.8375
No log	7.2836	488	0.7262	0.7861	0.7262	0.8522
No log	7.3134	490	0.7936	0.8	0.7936	0.8908
No log	7.3433	492	0.8843	0.7232	0.8843	0.9403
No log	7.3731	494	0.8324	0.7356	0.8324	0.9124
No log	7.4030	496	0.7187	0.8049	0.7187	0.8477
No log	7.4328	498	0.6634	0.7643	0.6634	0.8145
0.4784	7.4627	500	0.6643	0.7285	0.6643	0.8150
0.4784	7.4925	502	0.6615	0.7682	0.6615	0.8133
0.4784	7.5224	504	0.6845	0.7974	0.6845	0.8274
0.4784	7.5522	506	0.7191	0.7755	0.7191	0.8480
0.4784	7.5821	508	0.7649	0.7755	0.7649	0.8746
0.4784	7.6119	510	0.7686	0.7671	0.7686	0.8767
0.4784	7.6418	512	0.7734	0.7517	0.7734	0.8794
0.4784	7.6716	514	0.7341	0.7792	0.7341	0.8568
0.4784	7.7015	516	0.7272	0.7654	0.7272	0.8527
0.4784	7.7313	518	0.6472	0.7950	0.6472	0.8045
0.4784	7.7612	520	0.5870	0.8079	0.5870	0.7662
0.4784	7.7910	522	0.5894	0.7974	0.5894	0.7677
0.4784	7.8209	524	0.6132	0.8	0.6132	0.7830
0.4784	7.8507	526	0.6370	0.7904	0.6370	0.7981
0.4784	7.8806	528	0.6343	0.7975	0.6343	0.7965
0.4784	7.9104	530	0.6596	0.7703	0.6596	0.8121
0.4784	7.9403	532	0.6953	0.7353	0.6953	0.8338
0.4784	7.9701	534	0.7389	0.7353	0.7389	0.8596
0.4784	8.0	536	0.7629	0.7353	0.7629	0.8735
0.4784	8.0299	538	0.7701	0.7353	0.7701	0.8776
0.4784	8.0597	540	0.7459	0.7465	0.7459	0.8636
0.4784	8.0896	542	0.7210	0.7465	0.7210	0.8491
0.4784	8.1194	544	0.6963	0.7465	0.6963	0.8344
0.4784	8.1493	546	0.6747	0.7586	0.6747	0.8214
0.4784	8.1791	548	0.6804	0.7586	0.6804	0.8249
0.4784	8.2090	550	0.6825	0.7534	0.6825	0.8261
0.4784	8.2388	552	0.7151	0.7643	0.7151	0.8456
0.4784	8.2687	554	0.7910	0.7647	0.7910	0.8894
0.4784	8.2985	556	0.8175	0.7381	0.8175	0.9042
0.4784	8.3284	558	0.7925	0.7284	0.7925	0.8902
0.4784	8.3582	560	0.7387	0.7755	0.7387	0.8595
0.4784	8.3881	562	0.7299	0.7133	0.7299	0.8543
0.4784	8.4179	564	0.7705	0.7034	0.7705	0.8778
0.4784	8.4478	566	0.7707	0.6712	0.7707	0.8779
0.4784	8.4776	568	0.7753	0.6944	0.7753	0.8805
0.4784	8.5075	570	0.8612	0.7089	0.8612	0.9280

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1