ArabicNewSplits6_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k9_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9228
• Qwk: 0.6529
• Mse: 0.9228
• Rmse: 0.9606

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0392	2	5.2693	0.0100	5.2693	2.2955
No log	0.0784	4	2.9439	0.0858	2.9439	1.7158
No log	0.1176	6	1.6015	0.1299	1.6015	1.2655
No log	0.1569	8	1.3402	0.1972	1.3402	1.1577
No log	0.1961	10	1.2674	0.1344	1.2674	1.1258
No log	0.2353	12	1.2368	0.1788	1.2368	1.1121
No log	0.2745	14	1.2198	0.1301	1.2198	1.1045
No log	0.3137	16	1.2117	0.2010	1.2117	1.1008
No log	0.3529	18	1.2848	0.1116	1.2848	1.1335
No log	0.3922	20	1.4385	-0.0261	1.4385	1.1994
No log	0.4314	22	1.4912	-0.0038	1.4912	1.2211
No log	0.4706	24	1.5153	0.0956	1.5153	1.2310
No log	0.5098	26	1.3940	0.1372	1.3940	1.1807
No log	0.5490	28	1.2453	0.2210	1.2453	1.1159
No log	0.5882	30	1.1686	0.3183	1.1686	1.0810
No log	0.6275	32	1.0806	0.3798	1.0806	1.0395
No log	0.6667	34	1.0000	0.4493	1.0000	1.0000
No log	0.7059	36	0.9128	0.4106	0.9128	0.9554
No log	0.7451	38	1.1460	0.3367	1.1460	1.0705
No log	0.7843	40	1.5011	0.2309	1.5011	1.2252
No log	0.8235	42	1.5198	0.2537	1.5198	1.2328
No log	0.8627	44	1.4495	0.3116	1.4495	1.2039
No log	0.9020	46	1.1382	0.4279	1.1382	1.0669
No log	0.9412	48	0.8592	0.5260	0.8592	0.9269
No log	0.9804	50	0.7885	0.6066	0.7885	0.8880
No log	1.0196	52	0.7820	0.6193	0.7820	0.8843
No log	1.0588	54	0.7342	0.5875	0.7342	0.8569
No log	1.0980	56	0.9697	0.5092	0.9697	0.9847
No log	1.1373	58	1.2669	0.3551	1.2669	1.1255
No log	1.1765	60	1.2940	0.3664	1.2940	1.1375
No log	1.2157	62	1.1999	0.4598	1.1999	1.0954
No log	1.2549	64	0.9086	0.5335	0.9086	0.9532
No log	1.2941	66	0.7388	0.5898	0.7388	0.8595
No log	1.3333	68	0.7318	0.6141	0.7318	0.8554
No log	1.3725	70	0.7703	0.5932	0.7703	0.8777
No log	1.4118	72	0.7286	0.6016	0.7286	0.8536
No log	1.4510	74	0.7944	0.5644	0.7944	0.8913
No log	1.4902	76	0.8304	0.5419	0.8304	0.9113
No log	1.5294	78	0.7405	0.6186	0.7405	0.8605
No log	1.5686	80	0.7514	0.6408	0.7514	0.8669
No log	1.6078	82	0.7511	0.6518	0.7511	0.8666
No log	1.6471	84	0.7731	0.6886	0.7731	0.8792
No log	1.6863	86	0.7438	0.6739	0.7438	0.8625
No log	1.7255	88	0.7608	0.6774	0.7608	0.8723
No log	1.7647	90	0.8408	0.6552	0.8408	0.9170
No log	1.8039	92	0.9229	0.6399	0.9229	0.9607
No log	1.8431	94	0.9151	0.6164	0.9151	0.9566
No log	1.8824	96	0.8797	0.6178	0.8797	0.9379
No log	1.9216	98	0.8129	0.6514	0.8129	0.9016
No log	1.9608	100	0.8348	0.6239	0.8348	0.9137
No log	2.0	102	0.9788	0.5876	0.9788	0.9893
No log	2.0392	104	1.0137	0.5943	1.0137	1.0068
No log	2.0784	106	0.9798	0.5993	0.9798	0.9898
No log	2.1176	108	0.8424	0.6558	0.8424	0.9178
No log	2.1569	110	0.7634	0.6594	0.7634	0.8737
No log	2.1961	112	0.7508	0.6714	0.7508	0.8665
No log	2.2353	114	0.7227	0.6630	0.7227	0.8501
No log	2.2745	116	0.6990	0.6589	0.6990	0.8361
No log	2.3137	118	0.7550	0.6807	0.7550	0.8689
No log	2.3529	120	0.7538	0.6629	0.7538	0.8682
No log	2.3922	122	0.6780	0.6349	0.6780	0.8234
No log	2.4314	124	0.8196	0.6510	0.8196	0.9053
No log	2.4706	126	1.1450	0.5721	1.1450	1.0701
No log	2.5098	128	1.3869	0.5443	1.3869	1.1777
No log	2.5490	130	1.3949	0.5347	1.3949	1.1811
No log	2.5882	132	1.1857	0.5634	1.1857	1.0889
No log	2.6275	134	0.9737	0.6376	0.9737	0.9867
No log	2.6667	136	0.7542	0.7242	0.7542	0.8684
No log	2.7059	138	0.7308	0.6845	0.7308	0.8549
No log	2.7451	140	0.7702	0.6784	0.7702	0.8776
No log	2.7843	142	0.7625	0.6870	0.7625	0.8732
No log	2.8235	144	0.8198	0.6741	0.8198	0.9054
No log	2.8627	146	0.8548	0.6729	0.8548	0.9245
No log	2.9020	148	1.0149	0.6083	1.0149	1.0074
No log	2.9412	150	1.0122	0.6136	1.0122	1.0061
No log	2.9804	152	0.8276	0.6583	0.8276	0.9097
No log	3.0196	154	0.7144	0.6982	0.7144	0.8452
No log	3.0588	156	0.7279	0.7240	0.7279	0.8531
No log	3.0980	158	0.8148	0.6879	0.8148	0.9027
No log	3.1373	160	0.8606	0.6560	0.8606	0.9277
No log	3.1765	162	0.9378	0.6588	0.9378	0.9684
No log	3.2157	164	0.8376	0.6991	0.8376	0.9152
No log	3.2549	166	0.6630	0.6786	0.6630	0.8143
No log	3.2941	168	0.7146	0.7017	0.7146	0.8454
No log	3.3333	170	0.8197	0.6853	0.8197	0.9054
No log	3.3725	172	0.6690	0.6848	0.6690	0.8179
No log	3.4118	174	0.6983	0.7057	0.6983	0.8356
No log	3.4510	176	1.0291	0.6190	1.0291	1.0144
No log	3.4902	178	1.2818	0.5849	1.2818	1.1322
No log	3.5294	180	1.1877	0.5503	1.1877	1.0898
No log	3.5686	182	1.0240	0.5845	1.0240	1.0119
No log	3.6078	184	0.9082	0.6072	0.9082	0.9530
No log	3.6471	186	0.8273	0.6361	0.8273	0.9096
No log	3.6863	188	0.8197	0.6623	0.8197	0.9054
No log	3.7255	190	0.7524	0.6965	0.7524	0.8674
No log	3.7647	192	0.6512	0.6782	0.6512	0.8070
No log	3.8039	194	0.6627	0.6797	0.6627	0.8141
No log	3.8431	196	0.7710	0.6478	0.7710	0.8781
No log	3.8824	198	0.8531	0.6184	0.8531	0.9236
No log	3.9216	200	0.7336	0.6505	0.7336	0.8565
No log	3.9608	202	0.6178	0.6912	0.6178	0.7860
No log	4.0	204	0.8398	0.6779	0.8398	0.9164
No log	4.0392	206	1.4327	0.5546	1.4327	1.1969
No log	4.0784	208	1.9892	0.4953	1.9892	1.4104
No log	4.1176	210	2.1176	0.4808	2.1176	1.4552
No log	4.1569	212	1.8336	0.4625	1.8336	1.3541
No log	4.1961	214	1.3249	0.5146	1.3249	1.1511
No log	4.2353	216	1.0512	0.5929	1.0512	1.0253
No log	4.2745	218	0.9933	0.5923	0.9933	0.9967
No log	4.3137	220	1.0261	0.6192	1.0261	1.0130
No log	4.3529	222	1.0048	0.6306	1.0048	1.0024
No log	4.3922	224	0.8898	0.6782	0.8898	0.9433
No log	4.4314	226	0.8215	0.6759	0.8215	0.9064
No log	4.4706	228	0.7246	0.6967	0.7246	0.8513
No log	4.5098	230	0.6656	0.7261	0.6656	0.8158
No log	4.5490	232	0.6558	0.7008	0.6558	0.8098
No log	4.5882	234	0.6558	0.6815	0.6558	0.8098
No log	4.6275	236	0.6594	0.7124	0.6594	0.8120
No log	4.6667	238	0.7783	0.6730	0.7783	0.8822
No log	4.7059	240	0.9603	0.6585	0.9603	0.9800
No log	4.7451	242	0.9779	0.6350	0.9779	0.9889
No log	4.7843	244	0.8680	0.6289	0.8680	0.9317
No log	4.8235	246	0.7684	0.6753	0.7684	0.8766
No log	4.8627	248	0.7072	0.6656	0.7072	0.8410
No log	4.9020	250	0.7045	0.6656	0.7045	0.8394
No log	4.9412	252	0.7376	0.6795	0.7376	0.8589
No log	4.9804	254	0.7966	0.6554	0.7966	0.8925
No log	5.0196	256	0.8817	0.6543	0.8817	0.9390
No log	5.0588	258	0.8869	0.6490	0.8869	0.9417
No log	5.0980	260	0.8334	0.6426	0.8334	0.9129
No log	5.1373	262	0.7460	0.6808	0.7460	0.8637
No log	5.1765	264	0.7023	0.6970	0.7023	0.8381
No log	5.2157	266	0.6911	0.7019	0.6911	0.8313
No log	5.2549	268	0.6996	0.6826	0.6996	0.8364
No log	5.2941	270	0.7513	0.6772	0.7513	0.8668
No log	5.3333	272	0.8148	0.6420	0.8148	0.9027
No log	5.3725	274	0.9292	0.5880	0.9292	0.9639
No log	5.4118	276	1.1175	0.5552	1.1175	1.0571
No log	5.4510	278	1.2331	0.5435	1.2331	1.1104
No log	5.4902	280	1.2875	0.5356	1.2875	1.1347
No log	5.5294	282	1.2489	0.5484	1.2489	1.1175
No log	5.5686	284	1.1186	0.5433	1.1186	1.0576
No log	5.6078	286	0.9907	0.5897	0.9907	0.9953
No log	5.6471	288	0.9550	0.6016	0.9550	0.9772
No log	5.6863	290	1.0078	0.5861	1.0078	1.0039
No log	5.7255	292	1.0688	0.5604	1.0688	1.0338
No log	5.7647	294	1.1604	0.5688	1.1604	1.0772
No log	5.8039	296	1.1540	0.5781	1.1540	1.0742
No log	5.8431	298	1.0838	0.6091	1.0838	1.0411
No log	5.8824	300	0.9469	0.6517	0.9469	0.9731
No log	5.9216	302	0.8553	0.6775	0.8553	0.9248
No log	5.9608	304	0.8057	0.6720	0.8057	0.8976
No log	6.0	306	0.8043	0.6720	0.8043	0.8968
No log	6.0392	308	0.8368	0.6775	0.8368	0.9148
No log	6.0784	310	0.8971	0.6693	0.8971	0.9471
No log	6.1176	312	0.9305	0.6371	0.9305	0.9646
No log	6.1569	314	0.9967	0.6059	0.9967	0.9983
No log	6.1961	316	0.9577	0.6100	0.9577	0.9786
No log	6.2353	318	0.8445	0.6494	0.8445	0.9190
No log	6.2745	320	0.7803	0.7018	0.7803	0.8834
No log	6.3137	322	0.7467	0.6837	0.7467	0.8641
No log	6.3529	324	0.7468	0.6857	0.7468	0.8642
No log	6.3922	326	0.7858	0.7014	0.7858	0.8865
No log	6.4314	328	0.8388	0.6608	0.8388	0.9159
No log	6.4706	330	0.9374	0.6243	0.9374	0.9682
No log	6.5098	332	1.0642	0.6195	1.0642	1.0316
No log	6.5490	334	1.2071	0.5907	1.2071	1.0987
No log	6.5882	336	1.2619	0.5850	1.2619	1.1233
No log	6.6275	338	1.2154	0.6006	1.2154	1.1024
No log	6.6667	340	1.1265	0.6332	1.1265	1.0613
No log	6.7059	342	1.0255	0.6534	1.0255	1.0127
No log	6.7451	344	0.9201	0.6621	0.9201	0.9592
No log	6.7843	346	0.8707	0.6633	0.8707	0.9331
No log	6.8235	348	0.8630	0.6682	0.8630	0.9290
No log	6.8627	350	0.8606	0.6599	0.8606	0.9277
No log	6.9020	352	0.9055	0.6452	0.9055	0.9516
No log	6.9412	354	0.9699	0.6187	0.9699	0.9848
No log	6.9804	356	1.0379	0.6094	1.0379	1.0188
No log	7.0196	358	1.0362	0.6224	1.0362	1.0179
No log	7.0588	360	1.0019	0.6274	1.0019	1.0010
No log	7.0980	362	1.0123	0.6288	1.0123	1.0061
No log	7.1373	364	1.0710	0.6264	1.0710	1.0349
No log	7.1765	366	1.1258	0.6052	1.1258	1.0610
No log	7.2157	368	1.1234	0.5986	1.1234	1.0599
No log	7.2549	370	1.1245	0.5986	1.1245	1.0604
No log	7.2941	372	1.0579	0.6106	1.0579	1.0286
No log	7.3333	374	1.0211	0.6210	1.0211	1.0105
No log	7.3725	376	1.0396	0.6019	1.0396	1.0196
No log	7.4118	378	1.0740	0.5898	1.0740	1.0363
No log	7.4510	380	1.0993	0.5788	1.0993	1.0485
No log	7.4902	382	1.0765	0.5788	1.0765	1.0375
No log	7.5294	384	1.0532	0.5788	1.0532	1.0262
No log	7.5686	386	1.0578	0.5908	1.0578	1.0285
No log	7.6078	388	1.0392	0.6	1.0392	1.0194
No log	7.6471	390	1.0196	0.6117	1.0196	1.0098
No log	7.6863	392	0.9685	0.6180	0.9685	0.9841
No log	7.7255	394	0.9299	0.6508	0.9299	0.9643
No log	7.7647	396	0.9020	0.6583	0.9020	0.9497
No log	7.8039	398	0.8722	0.6638	0.8722	0.9339
No log	7.8431	400	0.8544	0.6830	0.8544	0.9244
No log	7.8824	402	0.8758	0.6678	0.8758	0.9358
No log	7.9216	404	0.9001	0.6710	0.9001	0.9487
No log	7.9608	406	0.9092	0.6732	0.9092	0.9535
No log	8.0	408	0.9076	0.6645	0.9076	0.9527
No log	8.0392	410	0.8698	0.6642	0.8698	0.9326
No log	8.0784	412	0.8462	0.6682	0.8462	0.9199
No log	8.1176	414	0.8456	0.6642	0.8456	0.9196
No log	8.1569	416	0.8415	0.6558	0.8415	0.9173
No log	8.1961	418	0.8539	0.6558	0.8539	0.9241
No log	8.2353	420	0.8506	0.6566	0.8506	0.9223
No log	8.2745	422	0.8456	0.6566	0.8456	0.9196
No log	8.3137	424	0.8747	0.6638	0.8747	0.9353
No log	8.3529	426	0.8862	0.6623	0.8862	0.9414
No log	8.3922	428	0.8922	0.6593	0.8922	0.9445
No log	8.4314	430	0.9187	0.6554	0.9187	0.9585
No log	8.4706	432	0.9171	0.6611	0.9171	0.9576
No log	8.5098	434	0.9042	0.6688	0.9042	0.9509
No log	8.5490	436	0.8864	0.6665	0.8864	0.9415
No log	8.5882	438	0.8769	0.6689	0.8769	0.9364
No log	8.6275	440	0.8738	0.6576	0.8738	0.9348
No log	8.6667	442	0.8877	0.6562	0.8877	0.9422
No log	8.7059	444	0.9118	0.6497	0.9118	0.9549
No log	8.7451	446	0.9427	0.6580	0.9427	0.9709
No log	8.7843	448	0.9833	0.6369	0.9833	0.9916
No log	8.8235	450	1.0097	0.6369	1.0097	1.0048
No log	8.8627	452	1.0437	0.6292	1.0437	1.0216
No log	8.9020	454	1.0620	0.6210	1.0620	1.0305
No log	8.9412	456	1.0682	0.6210	1.0682	1.0335
No log	8.9804	458	1.0616	0.6210	1.0616	1.0303
No log	9.0196	460	1.0426	0.6369	1.0426	1.0211
No log	9.0588	462	1.0109	0.6407	1.0109	1.0054
No log	9.0980	464	0.9954	0.6420	0.9954	0.9977
No log	9.1373	466	0.9770	0.6420	0.9770	0.9884
No log	9.1765	468	0.9634	0.6420	0.9634	0.9815
No log	9.2157	470	0.9516	0.6504	0.9516	0.9755
No log	9.2549	472	0.9474	0.6447	0.9474	0.9734
No log	9.2941	474	0.9604	0.6447	0.9604	0.9800
No log	9.3333	476	0.9693	0.6363	0.9693	0.9845
No log	9.3725	478	0.9737	0.6324	0.9737	0.9868
No log	9.4118	480	0.9721	0.6311	0.9721	0.9860
No log	9.4510	482	0.9672	0.6396	0.9672	0.9835
No log	9.4902	484	0.9645	0.6396	0.9645	0.9821
No log	9.5294	486	0.9608	0.6436	0.9608	0.9802
No log	9.5686	488	0.9504	0.6500	0.9504	0.9749
No log	9.6078	490	0.9343	0.6417	0.9343	0.9666
No log	9.6471	492	0.9210	0.6529	0.9210	0.9597
No log	9.6863	494	0.9110	0.6529	0.9110	0.9545
No log	9.7255	496	0.9083	0.6529	0.9083	0.9531
No log	9.7647	498	0.9113	0.6529	0.9113	0.9546
0.456	9.8039	500	0.9143	0.6529	0.9143	0.9562
0.456	9.8431	502	0.9162	0.6529	0.9162	0.9572
0.456	9.8824	504	0.9186	0.6529	0.9186	0.9584
0.456	9.9216	506	0.9200	0.6529	0.9200	0.9592
0.456	9.9608	508	0.9221	0.6529	0.9221	0.9602
0.456	10.0	510	0.9228	0.6529	0.9228	0.9606

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1