ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k12_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6993
• Qwk: 0.7398
• Mse: 0.6993
• Rmse: 0.8362

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0408	2	2.5530	0.0241	2.5530	1.5978
No log	0.0816	4	1.7122	0.1315	1.7122	1.3085
No log	0.1224	6	1.4403	0.1288	1.4403	1.2001
No log	0.1633	8	1.4918	0.2191	1.4918	1.2214
No log	0.2041	10	1.6262	0.3106	1.6262	1.2752
No log	0.2449	12	1.7446	0.2837	1.7446	1.3208
No log	0.2857	14	1.4824	0.3067	1.4824	1.2175
No log	0.3265	16	1.3366	0.2558	1.3366	1.1561
No log	0.3673	18	1.2768	0.2331	1.2768	1.1300
No log	0.4082	20	1.2133	0.2656	1.2133	1.1015
No log	0.4490	22	1.3448	0.3960	1.3448	1.1597
No log	0.4898	24	1.5828	0.3521	1.5828	1.2581
No log	0.5306	26	1.4877	0.3782	1.4877	1.2197
No log	0.5714	28	1.1295	0.4153	1.1295	1.0628
No log	0.6122	30	1.0025	0.4677	1.0025	1.0013
No log	0.6531	32	0.9638	0.4635	0.9638	0.9817
No log	0.6939	34	1.0488	0.5134	1.0488	1.0241
No log	0.7347	36	1.3325	0.4379	1.3325	1.1544
No log	0.7755	38	1.4481	0.4455	1.4481	1.2034
No log	0.8163	40	1.2559	0.4458	1.2559	1.1207
No log	0.8571	42	1.1635	0.4635	1.1635	1.0787
No log	0.8980	44	0.9712	0.5441	0.9712	0.9855
No log	0.9388	46	1.0012	0.4902	1.0012	1.0006
No log	0.9796	48	1.0707	0.4449	1.0707	1.0348
No log	1.0204	50	0.9701	0.4479	0.9701	0.9849
No log	1.0612	52	0.8743	0.6131	0.8743	0.9351
No log	1.1020	54	0.9150	0.5860	0.9150	0.9565
No log	1.1429	56	0.8530	0.6170	0.8530	0.9236
No log	1.1837	58	0.8415	0.5719	0.8415	0.9173
No log	1.2245	60	0.8788	0.6302	0.8788	0.9374
No log	1.2653	62	1.0960	0.5310	1.0960	1.0469
No log	1.3061	64	1.1518	0.5171	1.1518	1.0732
No log	1.3469	66	1.0160	0.5351	1.0160	1.0080
No log	1.3878	68	1.0410	0.4902	1.0410	1.0203
No log	1.4286	70	1.1137	0.4959	1.1137	1.0553
No log	1.4694	72	1.1361	0.5333	1.1361	1.0659
No log	1.5102	74	1.0816	0.5440	1.0816	1.0400
No log	1.5510	76	1.1601	0.5334	1.1601	1.0771
No log	1.5918	78	1.3027	0.5569	1.3027	1.1414
No log	1.6327	80	1.4065	0.5375	1.4065	1.1859
No log	1.6735	82	1.1431	0.5858	1.1431	1.0692
No log	1.7143	84	1.0633	0.6037	1.0633	1.0312
No log	1.7551	86	1.2824	0.5609	1.2824	1.1324
No log	1.7959	88	1.3044	0.5393	1.3044	1.1421
No log	1.8367	90	1.1822	0.5786	1.1822	1.0873
No log	1.8776	92	1.0356	0.6084	1.0356	1.0177
No log	1.9184	94	0.8949	0.6380	0.8949	0.9460
No log	1.9592	96	0.8302	0.6537	0.8302	0.9111
No log	2.0	98	0.7841	0.6572	0.7841	0.8855
No log	2.0408	100	0.7823	0.6739	0.7823	0.8845
No log	2.0816	102	0.8426	0.6852	0.8426	0.9180
No log	2.1224	104	0.7973	0.6997	0.7973	0.8929
No log	2.1633	106	0.7744	0.6886	0.7744	0.8800
No log	2.2041	108	0.7551	0.6613	0.7551	0.8690
No log	2.2449	110	0.7259	0.6459	0.7259	0.8520
No log	2.2857	112	0.7491	0.6274	0.7491	0.8655
No log	2.3265	114	0.7905	0.6416	0.7905	0.8891
No log	2.3673	116	0.8162	0.6575	0.8162	0.9034
No log	2.4082	118	0.9155	0.6408	0.9155	0.9568
No log	2.4490	120	0.9770	0.6212	0.9770	0.9884
No log	2.4898	122	1.1366	0.6082	1.1366	1.0661
No log	2.5306	124	1.0530	0.6305	1.0530	1.0261
No log	2.5714	126	0.8680	0.6498	0.8680	0.9317
No log	2.6122	128	0.7763	0.6835	0.7763	0.8811
No log	2.6531	130	0.8289	0.6586	0.8289	0.9104
No log	2.6939	132	0.9500	0.6628	0.9500	0.9747
No log	2.7347	134	0.8942	0.6482	0.8942	0.9456
No log	2.7755	136	0.8639	0.6761	0.8639	0.9295
No log	2.8163	138	0.7877	0.6591	0.7877	0.8875
No log	2.8571	140	0.7437	0.6468	0.7437	0.8624
No log	2.8980	142	0.7386	0.6571	0.7386	0.8594
No log	2.9388	144	0.8349	0.6560	0.8349	0.9137
No log	2.9796	146	1.0508	0.6480	1.0508	1.0251
No log	3.0204	148	1.1526	0.6184	1.1526	1.0736
No log	3.0612	150	1.0335	0.6552	1.0335	1.0166
No log	3.1020	152	0.8875	0.6598	0.8875	0.9421
No log	3.1429	154	0.8896	0.6458	0.8896	0.9432
No log	3.1837	156	1.1000	0.6217	1.1000	1.0488
No log	3.2245	158	1.2054	0.5813	1.2054	1.0979
No log	3.2653	160	1.0546	0.6104	1.0546	1.0269
No log	3.3061	162	0.8829	0.6582	0.8829	0.9396
No log	3.3469	164	0.8972	0.6670	0.8972	0.9472
No log	3.3878	166	1.0172	0.6638	1.0172	1.0086
No log	3.4286	168	1.0022	0.6496	1.0022	1.0011
No log	3.4694	170	0.8183	0.6911	0.8183	0.9046
No log	3.5102	172	0.7060	0.6805	0.7060	0.8403
No log	3.5510	174	0.7010	0.6785	0.7010	0.8372
No log	3.5918	176	0.7246	0.6960	0.7246	0.8512
No log	3.6327	178	0.7923	0.7000	0.7923	0.8901
No log	3.6735	180	0.8740	0.6741	0.8740	0.9349
No log	3.7143	182	0.8615	0.6741	0.8615	0.9281
No log	3.7551	184	0.7587	0.7118	0.7587	0.8710
No log	3.7959	186	0.7111	0.6750	0.7111	0.8433
No log	3.8367	188	0.6997	0.6407	0.6997	0.8365
No log	3.8776	190	0.7000	0.6577	0.7000	0.8366
No log	3.9184	192	0.7728	0.6984	0.7728	0.8791
No log	3.9592	194	0.9976	0.6585	0.9976	0.9988
No log	4.0	196	1.0481	0.6463	1.0481	1.0238
No log	4.0408	198	0.8918	0.7037	0.8918	0.9443
No log	4.0816	200	0.7035	0.7093	0.7035	0.8388
No log	4.1224	202	0.6720	0.6833	0.6720	0.8198
No log	4.1633	204	0.6797	0.6956	0.6797	0.8244
No log	4.2041	206	0.7548	0.7057	0.7548	0.8688
No log	4.2449	208	0.8752	0.6976	0.8752	0.9355
No log	4.2857	210	0.9205	0.6835	0.9205	0.9594
No log	4.3265	212	0.8031	0.6990	0.8031	0.8961
No log	4.3673	214	0.6966	0.7034	0.6966	0.8346
No log	4.4082	216	0.6679	0.6969	0.6679	0.8173
No log	4.4490	218	0.6732	0.6969	0.6732	0.8205
No log	4.4898	220	0.7189	0.7125	0.7189	0.8479
No log	4.5306	222	0.7725	0.7171	0.7725	0.8789
No log	4.5714	224	0.7797	0.7026	0.7797	0.8830
No log	4.6122	226	0.7120	0.7186	0.7120	0.8438
No log	4.6531	228	0.6996	0.7240	0.6996	0.8364
No log	4.6939	230	0.7234	0.7226	0.7234	0.8506
No log	4.7347	232	0.7478	0.7081	0.7478	0.8648
No log	4.7755	234	0.7891	0.7144	0.7891	0.8883
No log	4.8163	236	0.7675	0.7151	0.7675	0.8761
No log	4.8571	238	0.7827	0.7151	0.7827	0.8847
No log	4.8980	240	0.8127	0.7096	0.8127	0.9015
No log	4.9388	242	0.8811	0.7140	0.8811	0.9386
No log	4.9796	244	0.8411	0.7166	0.8411	0.9171
No log	5.0204	246	0.8051	0.7128	0.8051	0.8973
No log	5.0612	248	0.7632	0.7164	0.7632	0.8736
No log	5.1020	250	0.7044	0.7294	0.7044	0.8393
No log	5.1429	252	0.6686	0.6983	0.6686	0.8177
No log	5.1837	254	0.6732	0.7130	0.6732	0.8205
No log	5.2245	256	0.7371	0.7057	0.7371	0.8585
No log	5.2653	258	0.8531	0.7166	0.8531	0.9236
No log	5.3061	260	0.9255	0.6919	0.9255	0.9620
No log	5.3469	262	0.8789	0.7030	0.8789	0.9375
No log	5.3878	264	0.7570	0.7274	0.7570	0.8701
No log	5.4286	266	0.6790	0.7171	0.6790	0.8240
No log	5.4694	268	0.6630	0.7240	0.6630	0.8142
No log	5.5102	270	0.6985	0.7256	0.6985	0.8358
No log	5.5510	272	0.8088	0.7268	0.8088	0.8993
No log	5.5918	274	0.9105	0.7027	0.9105	0.9542
No log	5.6327	276	0.8956	0.7027	0.8956	0.9464
No log	5.6735	278	0.7932	0.7310	0.7932	0.8906
No log	5.7143	280	0.6968	0.7435	0.6968	0.8348
No log	5.7551	282	0.6708	0.7330	0.6708	0.8190
No log	5.7959	284	0.6888	0.7345	0.6888	0.8299
No log	5.8367	286	0.7215	0.7287	0.7215	0.8494
No log	5.8776	288	0.7343	0.7345	0.7343	0.8569
No log	5.9184	290	0.7391	0.7287	0.7391	0.8597
No log	5.9592	292	0.7717	0.7202	0.7717	0.8785
No log	6.0	294	0.8044	0.7274	0.8044	0.8969
No log	6.0408	296	0.7975	0.7274	0.7975	0.8930
No log	6.0816	298	0.7348	0.7325	0.7348	0.8572
No log	6.1224	300	0.6772	0.7088	0.6772	0.8229
No log	6.1633	302	0.6596	0.7213	0.6596	0.8122
No log	6.2041	304	0.6679	0.7168	0.6679	0.8172
No log	6.2449	306	0.7214	0.7272	0.7214	0.8494
No log	6.2857	308	0.7682	0.7399	0.7682	0.8765
No log	6.3265	310	0.7876	0.7399	0.7876	0.8875
No log	6.3673	312	0.7693	0.7350	0.7693	0.8771
No log	6.4082	314	0.7274	0.7618	0.7274	0.8529
No log	6.4490	316	0.7098	0.7485	0.7098	0.8425
No log	6.4898	318	0.7131	0.7543	0.7131	0.8445
No log	6.5306	320	0.7246	0.7419	0.7246	0.8512
No log	6.5714	322	0.7145	0.7316	0.7145	0.8453
No log	6.6122	324	0.7042	0.7114	0.7042	0.8392
No log	6.6531	326	0.6941	0.7157	0.6941	0.8331
No log	6.6939	328	0.6683	0.7047	0.6683	0.8175
No log	6.7347	330	0.6606	0.7069	0.6606	0.8128
No log	6.7755	332	0.6660	0.7069	0.6660	0.8161
No log	6.8163	334	0.6716	0.7139	0.6716	0.8195
No log	6.8571	336	0.6787	0.7139	0.6787	0.8238
No log	6.8980	338	0.6870	0.7269	0.6870	0.8289
No log	6.9388	340	0.7009	0.7382	0.7009	0.8372
No log	6.9796	342	0.6896	0.7224	0.6896	0.8304
No log	7.0204	344	0.6922	0.7360	0.6922	0.8320
No log	7.0612	346	0.7053	0.7434	0.7053	0.8398
No log	7.1020	348	0.6832	0.7316	0.6832	0.8265
No log	7.1429	350	0.6644	0.7229	0.6644	0.8151
No log	7.1837	352	0.6616	0.6993	0.6616	0.8134
No log	7.2245	354	0.6637	0.7059	0.6637	0.8147
No log	7.2653	356	0.6729	0.7340	0.6729	0.8203
No log	7.3061	358	0.7020	0.7346	0.7020	0.8378
No log	7.3469	360	0.7316	0.7360	0.7316	0.8553
No log	7.3878	362	0.7373	0.7419	0.7373	0.8587
No log	7.4286	364	0.7112	0.7485	0.7112	0.8433
No log	7.4694	366	0.6803	0.7270	0.6803	0.8248
No log	7.5102	368	0.6682	0.7323	0.6682	0.8175
No log	7.5510	370	0.6669	0.7261	0.6669	0.8166
No log	7.5918	372	0.6832	0.7331	0.6832	0.8266
No log	7.6327	374	0.7111	0.7523	0.7111	0.8433
No log	7.6735	376	0.7709	0.7245	0.7709	0.8780
No log	7.7143	378	0.8021	0.7103	0.8021	0.8956
No log	7.7551	380	0.7852	0.7103	0.7852	0.8861
No log	7.7959	382	0.7349	0.7476	0.7349	0.8573
No log	7.8367	384	0.6830	0.7360	0.6830	0.8265
No log	7.8776	386	0.6640	0.7269	0.6640	0.8149
No log	7.9184	388	0.6685	0.7352	0.6685	0.8176
No log	7.9592	390	0.6886	0.7277	0.6886	0.8298
No log	8.0	392	0.7201	0.7439	0.7201	0.8486
No log	8.0408	394	0.7479	0.7331	0.7479	0.8648
No log	8.0816	396	0.7663	0.7382	0.7663	0.8754
No log	8.1224	398	0.7510	0.7404	0.7510	0.8666
No log	8.1633	400	0.7207	0.7353	0.7207	0.8489
No log	8.2041	402	0.6912	0.7429	0.6912	0.8314
No log	8.2449	404	0.6827	0.7316	0.6827	0.8263
No log	8.2857	406	0.6882	0.7471	0.6882	0.8296
No log	8.3265	408	0.6923	0.7471	0.6923	0.8321
No log	8.3673	410	0.7033	0.7448	0.7033	0.8387
No log	8.4082	412	0.7162	0.7360	0.7162	0.8463
No log	8.4490	414	0.7332	0.7353	0.7332	0.8563
No log	8.4898	416	0.7344	0.7353	0.7344	0.8570
No log	8.5306	418	0.7184	0.7360	0.7184	0.8476
No log	8.5714	420	0.6986	0.7485	0.6986	0.8358
No log	8.6122	422	0.6768	0.7419	0.6768	0.8227
No log	8.6531	424	0.6586	0.7300	0.6586	0.8116
No log	8.6939	426	0.6532	0.7300	0.6532	0.8082
No log	8.7347	428	0.6612	0.7360	0.6612	0.8131
No log	8.7755	430	0.6795	0.7450	0.6795	0.8243
No log	8.8163	432	0.6965	0.7485	0.6965	0.8345
No log	8.8571	434	0.7231	0.7398	0.7231	0.8503
No log	8.8980	436	0.7436	0.7166	0.7436	0.8623
No log	8.9388	438	0.7634	0.7080	0.7634	0.8737
No log	8.9796	440	0.7677	0.7080	0.7677	0.8762
No log	9.0204	442	0.7637	0.7080	0.7637	0.8739
No log	9.0612	444	0.7597	0.7180	0.7597	0.8716
No log	9.1020	446	0.7516	0.7180	0.7516	0.8669
No log	9.1429	448	0.7370	0.7222	0.7370	0.8585
No log	9.1837	450	0.7203	0.7435	0.7203	0.8487
No log	9.2245	452	0.7085	0.7435	0.7085	0.8417
No log	9.2653	454	0.6943	0.7398	0.6943	0.8332
No log	9.3061	456	0.6860	0.7509	0.6860	0.8282
No log	9.3469	458	0.6832	0.7509	0.6832	0.8266
No log	9.3878	460	0.6873	0.7509	0.6873	0.8290
No log	9.4286	462	0.6939	0.7398	0.6939	0.8330
No log	9.4694	464	0.7038	0.7398	0.7038	0.8389
No log	9.5102	466	0.7104	0.7398	0.7104	0.8429
No log	9.5510	468	0.7166	0.7435	0.7166	0.8465
No log	9.5918	470	0.7208	0.7435	0.7208	0.8490
No log	9.6327	472	0.7221	0.7435	0.7221	0.8498
No log	9.6735	474	0.7206	0.7435	0.7206	0.8489
No log	9.7143	476	0.7192	0.7391	0.7192	0.8481
No log	9.7551	478	0.7156	0.7435	0.7156	0.8459
No log	9.7959	480	0.7098	0.7435	0.7098	0.8425
No log	9.8367	482	0.7046	0.7435	0.7046	0.8394
No log	9.8776	484	0.7020	0.7398	0.7020	0.8378
No log	9.9184	486	0.7006	0.7398	0.7006	0.8370
No log	9.9592	488	0.6995	0.7398	0.6995	0.8363
No log	10.0	490	0.6993	0.7398	0.6993	0.8362

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1