ArabicNewSplits4_WithDuplicationsForScore5_FineTuningAraBERT_run3_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8979
• Qwk: 0.6586
• Mse: 0.8979
• Rmse: 0.9476

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0370	2	5.1593	0.0114	5.1593	2.2714
No log	0.0741	4	3.4414	0.0730	3.4414	1.8551
No log	0.1111	6	1.9220	0.1261	1.9220	1.3864
No log	0.1481	8	1.5165	0.1067	1.5165	1.2314
No log	0.1852	10	1.5287	0.0960	1.5287	1.2364
No log	0.2222	12	1.5110	0.0289	1.5110	1.2292
No log	0.2593	14	1.3850	0.1487	1.3850	1.1769
No log	0.2963	16	1.3470	0.1919	1.3470	1.1606
No log	0.3333	18	1.3067	0.2231	1.3067	1.1431
No log	0.3704	20	1.2469	0.1208	1.2469	1.1166
No log	0.4074	22	1.1881	0.1218	1.1881	1.0900
No log	0.4444	24	1.1698	0.2560	1.1698	1.0816
No log	0.4815	26	1.1690	0.3015	1.1690	1.0812
No log	0.5185	28	1.1397	0.3397	1.1397	1.0676
No log	0.5556	30	1.0448	0.3535	1.0448	1.0222
No log	0.5926	32	1.1355	0.2768	1.1355	1.0656
No log	0.6296	34	1.1399	0.2691	1.1399	1.0677
No log	0.6667	36	1.0517	0.2879	1.0517	1.0255
No log	0.7037	38	0.9951	0.3606	0.9951	0.9975
No log	0.7407	40	1.0538	0.3514	1.0538	1.0265
No log	0.7778	42	1.0415	0.3781	1.0415	1.0206
No log	0.8148	44	0.9454	0.3661	0.9454	0.9723
No log	0.8519	46	0.9058	0.4059	0.9058	0.9518
No log	0.8889	48	0.8965	0.4330	0.8965	0.9468
No log	0.9259	50	0.9570	0.3833	0.9570	0.9783
No log	0.9630	52	1.0179	0.4442	1.0179	1.0089
No log	1.0	54	0.9944	0.4896	0.9944	0.9972
No log	1.0370	56	1.0429	0.4447	1.0429	1.0212
No log	1.0741	58	1.1039	0.4544	1.1039	1.0507
No log	1.1111	60	0.9746	0.5905	0.9746	0.9872
No log	1.1481	62	0.8545	0.6366	0.8545	0.9244
No log	1.1852	64	0.8594	0.6220	0.8594	0.9270
No log	1.2222	66	0.9587	0.6031	0.9587	0.9791
No log	1.2593	68	1.0301	0.5635	1.0301	1.0149
No log	1.2963	70	1.0923	0.5305	1.0923	1.0451
No log	1.3333	72	1.0358	0.4947	1.0358	1.0177
No log	1.3704	74	0.9422	0.5348	0.9422	0.9707
No log	1.4074	76	0.7948	0.6372	0.7948	0.8915
No log	1.4444	78	0.7447	0.6595	0.7447	0.8629
No log	1.4815	80	0.7408	0.6671	0.7408	0.8607
No log	1.5185	82	0.7742	0.7183	0.7742	0.8799
No log	1.5556	84	0.9921	0.6205	0.9921	0.9960
No log	1.5926	86	1.1764	0.5363	1.1764	1.0846
No log	1.6296	88	1.1315	0.5781	1.1315	1.0637
No log	1.6667	90	1.0430	0.6139	1.0430	1.0213
No log	1.7037	92	0.9874	0.6187	0.9874	0.9937
No log	1.7407	94	0.8788	0.6664	0.8788	0.9375
No log	1.7778	96	0.8608	0.6724	0.8608	0.9278
No log	1.8148	98	0.8883	0.6535	0.8883	0.9425
No log	1.8519	100	1.0698	0.6060	1.0698	1.0343
No log	1.8889	102	1.2617	0.5460	1.2617	1.1232
No log	1.9259	104	1.2696	0.5507	1.2696	1.1267
No log	1.9630	106	1.1076	0.5360	1.1076	1.0524
No log	2.0	108	0.9298	0.5488	0.9298	0.9643
No log	2.0370	110	0.8238	0.6057	0.8238	0.9077
No log	2.0741	112	0.8396	0.6007	0.8396	0.9163
No log	2.1111	114	1.0847	0.5763	1.0847	1.0415
No log	2.1481	116	1.5107	0.4877	1.5107	1.2291
No log	2.1852	118	1.6043	0.4541	1.6043	1.2666
No log	2.2222	120	1.5238	0.4665	1.5238	1.2344
No log	2.2593	122	1.2722	0.5361	1.2722	1.1279
No log	2.2963	124	1.0712	0.6042	1.0712	1.0350
No log	2.3333	126	1.0092	0.6297	1.0092	1.0046
No log	2.3704	128	1.0684	0.6309	1.0684	1.0336
No log	2.4074	130	1.1735	0.6112	1.1735	1.0833
No log	2.4444	132	1.3815	0.5458	1.3815	1.1754
No log	2.4815	134	1.6820	0.4714	1.6820	1.2969
No log	2.5185	136	1.7962	0.4631	1.7962	1.3402
No log	2.5556	138	1.5078	0.5120	1.5078	1.2279
No log	2.5926	140	1.1672	0.5576	1.1672	1.0804
No log	2.6296	142	0.8460	0.6320	0.8460	0.9198
No log	2.6667	144	0.7350	0.6587	0.7350	0.8573
No log	2.7037	146	0.7559	0.6457	0.7559	0.8695
No log	2.7407	148	0.9208	0.5935	0.9208	0.9596
No log	2.7778	150	1.2189	0.5309	1.2189	1.1040
No log	2.8148	152	1.2647	0.5350	1.2647	1.1246
No log	2.8519	154	1.1663	0.5616	1.1663	1.0800
No log	2.8889	156	1.1368	0.5491	1.1368	1.0662
No log	2.9259	158	1.0152	0.5801	1.0152	1.0075
No log	2.9630	160	0.9671	0.5914	0.9671	0.9834
No log	3.0	162	1.0739	0.5910	1.0739	1.0363
No log	3.0370	164	1.2439	0.5927	1.2439	1.1153
No log	3.0741	166	1.0610	0.6263	1.0610	1.0300
No log	3.1111	168	0.8762	0.6664	0.8762	0.9360
No log	3.1481	170	0.8189	0.6762	0.8189	0.9049
No log	3.1852	172	0.8826	0.6414	0.8826	0.9395
No log	3.2222	174	0.8430	0.6757	0.8430	0.9181
No log	3.2593	176	0.8069	0.6520	0.8069	0.8982
No log	3.2963	178	0.8031	0.6096	0.8031	0.8962
No log	3.3333	180	0.8967	0.6011	0.8967	0.9469
No log	3.3704	182	0.8965	0.6226	0.8965	0.9468
No log	3.4074	184	0.8605	0.6373	0.8605	0.9276
No log	3.4444	186	0.7882	0.6714	0.7882	0.8878
No log	3.4815	188	0.8229	0.6577	0.8229	0.9071
No log	3.5185	190	0.7705	0.6589	0.7705	0.8778
No log	3.5556	192	0.7668	0.6725	0.7668	0.8757
No log	3.5926	194	0.8468	0.6482	0.8468	0.9202
No log	3.6296	196	0.9769	0.5852	0.9769	0.9884
No log	3.6667	198	1.2445	0.5344	1.2445	1.1156
No log	3.7037	200	1.3034	0.5104	1.3034	1.1417
No log	3.7407	202	1.1842	0.5489	1.1842	1.0882
No log	3.7778	204	0.9846	0.5738	0.9846	0.9923
No log	3.8148	206	0.9141	0.5878	0.9141	0.9561
No log	3.8519	208	0.9379	0.5798	0.9379	0.9685
No log	3.8889	210	1.0630	0.5681	1.0630	1.0310
No log	3.9259	212	1.2634	0.5688	1.2634	1.1240
No log	3.9630	214	1.4365	0.5167	1.4365	1.1985
No log	4.0	216	1.4753	0.5167	1.4753	1.2146
No log	4.0370	218	1.3447	0.5430	1.3447	1.1596
No log	4.0741	220	1.0778	0.5918	1.0778	1.0382
No log	4.1111	222	0.9594	0.6049	0.9594	0.9795
No log	4.1481	224	0.9988	0.5921	0.9988	0.9994
No log	4.1852	226	1.0871	0.5585	1.0871	1.0427
No log	4.2222	228	1.1451	0.5541	1.1451	1.0701
No log	4.2593	230	1.2250	0.5406	1.2250	1.1068
No log	4.2963	232	1.2741	0.5198	1.2741	1.1288
No log	4.3333	234	1.1267	0.5523	1.1267	1.0615
No log	4.3704	236	0.9369	0.6012	0.9369	0.9679
No log	4.4074	238	0.8152	0.6147	0.8152	0.9029
No log	4.4444	240	0.8037	0.6090	0.8037	0.8965
No log	4.4815	242	0.8379	0.6164	0.8379	0.9153
No log	4.5185	244	0.9806	0.5886	0.9806	0.9902
No log	4.5556	246	1.0669	0.6058	1.0669	1.0329
No log	4.5926	248	1.1034	0.5966	1.1034	1.0504
No log	4.6296	250	1.0211	0.5906	1.0211	1.0105
No log	4.6667	252	1.0380	0.5862	1.0380	1.0188
No log	4.7037	254	1.0342	0.5791	1.0342	1.0170
No log	4.7407	256	0.9404	0.5911	0.9404	0.9697
No log	4.7778	258	0.8208	0.6216	0.8208	0.9060
No log	4.8148	260	0.8143	0.6261	0.8143	0.9024
No log	4.8519	262	0.7920	0.6470	0.7920	0.8899
No log	4.8889	264	0.8236	0.6503	0.8236	0.9075
No log	4.9259	266	0.8161	0.6503	0.8161	0.9034
No log	4.9630	268	0.8546	0.6447	0.8546	0.9244
No log	5.0	270	0.8581	0.6447	0.8581	0.9263
No log	5.0370	272	0.8352	0.6646	0.8352	0.9139
No log	5.0741	274	0.8346	0.6720	0.8346	0.9136
No log	5.1111	276	0.8783	0.6714	0.8783	0.9372
No log	5.1481	278	0.8771	0.6714	0.8771	0.9366
No log	5.1852	280	0.8366	0.6730	0.8366	0.9146
No log	5.2222	282	0.8334	0.6721	0.8334	0.9129
No log	5.2593	284	0.8664	0.6515	0.8664	0.9308
No log	5.2963	286	0.9735	0.6409	0.9735	0.9867
No log	5.3333	288	0.9745	0.6505	0.9745	0.9872
No log	5.3704	290	0.8705	0.6414	0.8705	0.9330
No log	5.4074	292	0.8338	0.6705	0.8338	0.9131
No log	5.4444	294	0.8890	0.6674	0.8890	0.9429
No log	5.4815	296	0.9946	0.6294	0.9946	0.9973
No log	5.5185	298	1.1058	0.5961	1.1058	1.0516
No log	5.5556	300	1.1354	0.5880	1.1354	1.0655
No log	5.5926	302	1.0864	0.5871	1.0864	1.0423
No log	5.6296	304	0.9513	0.5979	0.9513	0.9754
No log	5.6667	306	0.8871	0.6040	0.8871	0.9418
No log	5.7037	308	0.9125	0.5850	0.9125	0.9552
No log	5.7407	310	1.0277	0.5831	1.0277	1.0138
No log	5.7778	312	1.0827	0.5734	1.0827	1.0405
No log	5.8148	314	1.0207	0.5805	1.0207	1.0103
No log	5.8519	316	0.8905	0.6580	0.8905	0.9437
No log	5.8889	318	0.8729	0.6604	0.8729	0.9343
No log	5.9259	320	0.9043	0.6686	0.9043	0.9509
No log	5.9630	322	0.9982	0.6307	0.9982	0.9991
No log	6.0	324	1.1529	0.5935	1.1529	1.0737
No log	6.0370	326	1.1617	0.6056	1.1617	1.0778
No log	6.0741	328	1.0643	0.6276	1.0643	1.0316
No log	6.1111	330	0.9191	0.6565	0.9191	0.9587
No log	6.1481	332	0.8833	0.6336	0.8833	0.9398
No log	6.1852	334	0.9002	0.6300	0.9002	0.9488
No log	6.2222	336	0.9881	0.6184	0.9881	0.9940
No log	6.2593	338	1.0782	0.6028	1.0782	1.0384
No log	6.2963	340	1.0881	0.5935	1.0881	1.0431
No log	6.3333	342	1.0336	0.5814	1.0336	1.0167
No log	6.3704	344	0.9344	0.6383	0.9344	0.9666
No log	6.4074	346	0.9361	0.6376	0.9361	0.9675
No log	6.4444	348	1.0212	0.6240	1.0212	1.0105
No log	6.4815	350	1.1265	0.5861	1.1265	1.0614
No log	6.5185	352	1.1130	0.6019	1.1130	1.0550
No log	6.5556	354	1.0418	0.6251	1.0418	1.0207
No log	6.5926	356	0.9442	0.6540	0.9442	0.9717
No log	6.6296	358	0.9170	0.6555	0.9170	0.9576
No log	6.6667	360	0.8643	0.6576	0.8643	0.9297
No log	6.7037	362	0.9090	0.6447	0.9090	0.9534
No log	6.7407	364	0.9902	0.6243	0.9902	0.9951
No log	6.7778	366	1.0271	0.6375	1.0271	1.0134
No log	6.8148	368	1.0857	0.6343	1.0857	1.0420
No log	6.8519	370	1.0330	0.6551	1.0330	1.0164
No log	6.8889	372	0.9151	0.6721	0.9151	0.9566
No log	6.9259	374	0.8561	0.6853	0.8561	0.9253
No log	6.9630	376	0.7993	0.6790	0.7993	0.8940
No log	7.0	378	0.7910	0.6790	0.7910	0.8894
No log	7.0370	380	0.8248	0.6876	0.8248	0.9082
No log	7.0741	382	0.8493	0.6827	0.8493	0.9216
No log	7.1111	384	0.9048	0.6625	0.9048	0.9512
No log	7.1481	386	0.9987	0.6570	0.9987	0.9994
No log	7.1852	388	1.0262	0.6570	1.0262	1.0130
No log	7.2222	390	0.9868	0.6570	0.9868	0.9934
No log	7.2593	392	0.9089	0.6681	0.9089	0.9534
No log	7.2963	394	0.8754	0.6836	0.8754	0.9356
No log	7.3333	396	0.8475	0.6808	0.8475	0.9206
No log	7.3704	398	0.8055	0.6892	0.8055	0.8975
No log	7.4074	400	0.7971	0.6750	0.7971	0.8928
No log	7.4444	402	0.8360	0.6653	0.8360	0.9143
No log	7.4815	404	0.8257	0.6660	0.8257	0.9087
No log	7.5185	406	0.7976	0.6650	0.7976	0.8931
No log	7.5556	408	0.8212	0.6660	0.8212	0.9062
No log	7.5926	410	0.8183	0.6660	0.8183	0.9046
No log	7.6296	412	0.8052	0.6660	0.8052	0.8973
No log	7.6667	414	0.8577	0.6442	0.8577	0.9261
No log	7.7037	416	0.9159	0.6404	0.9159	0.9570
No log	7.7407	418	0.9681	0.6415	0.9681	0.9839
No log	7.7778	420	0.9642	0.6501	0.9642	0.9819
No log	7.8148	422	0.8964	0.6486	0.8964	0.9468
No log	7.8519	424	0.8126	0.6558	0.8126	0.9014
No log	7.8889	426	0.7670	0.6667	0.7670	0.8758
No log	7.9259	428	0.7558	0.6604	0.7558	0.8693
No log	7.9630	430	0.7961	0.6660	0.7961	0.8922
No log	8.0	432	0.8578	0.6665	0.8578	0.9262
No log	8.0370	434	0.9345	0.6686	0.9345	0.9667
No log	8.0741	436	1.0035	0.6316	1.0035	1.0017
No log	8.1111	438	1.0073	0.6316	1.0073	1.0036
No log	8.1481	440	0.9580	0.6380	0.9580	0.9788
No log	8.1852	442	0.9057	0.6615	0.9057	0.9517
No log	8.2222	444	0.8917	0.6683	0.8917	0.9443
No log	8.2593	446	0.8898	0.6531	0.8898	0.9433
No log	8.2963	448	0.8970	0.6591	0.8970	0.9471
No log	8.3333	450	0.8957	0.6474	0.8957	0.9464
No log	8.3704	452	0.8950	0.6371	0.8950	0.9461
No log	8.4074	454	0.8721	0.6330	0.8721	0.9339
No log	8.4444	456	0.8925	0.6364	0.8925	0.9447
No log	8.4815	458	0.9150	0.6364	0.9150	0.9566
No log	8.5185	460	0.9381	0.6364	0.9381	0.9686
No log	8.5556	462	0.9656	0.6376	0.9656	0.9827
No log	8.5926	464	1.0067	0.6389	1.0067	1.0034
No log	8.6296	466	1.0215	0.6387	1.0215	1.0107
No log	8.6667	468	0.9996	0.6454	0.9996	0.9998
No log	8.7037	470	0.9868	0.6454	0.9868	0.9934
No log	8.7407	472	0.9537	0.6508	0.9537	0.9766
No log	8.7778	474	0.9456	0.6508	0.9456	0.9724
No log	8.8148	476	0.9325	0.6508	0.9325	0.9657
No log	8.8519	478	0.9158	0.6698	0.9158	0.9570
No log	8.8889	480	0.8888	0.6698	0.8888	0.9427
No log	8.9259	482	0.8630	0.6476	0.8630	0.9290
No log	8.9630	484	0.8431	0.6599	0.8431	0.9182
No log	9.0	486	0.8434	0.6599	0.8434	0.9183
No log	9.0370	488	0.8648	0.6560	0.8648	0.9299
No log	9.0741	490	0.8834	0.6714	0.8834	0.9399
No log	9.1111	492	0.9160	0.6594	0.9160	0.9571
No log	9.1481	494	0.9334	0.6594	0.9334	0.9661
No log	9.1852	496	0.9518	0.6594	0.9518	0.9756
No log	9.2222	498	0.9511	0.6594	0.9511	0.9752
0.4627	9.2593	500	0.9390	0.6594	0.9390	0.9690
0.4627	9.2963	502	0.9202	0.6594	0.9202	0.9593
0.4627	9.3333	504	0.8939	0.6594	0.8939	0.9455
0.4627	9.3704	506	0.8703	0.6656	0.8703	0.9329
0.4627	9.4074	508	0.8431	0.6593	0.8431	0.9182
0.4627	9.4444	510	0.8285	0.6593	0.8285	0.9102
0.4627	9.4815	512	0.8283	0.6660	0.8283	0.9101
0.4627	9.5185	514	0.8340	0.6593	0.8340	0.9133
0.4627	9.5556	516	0.8439	0.6593	0.8439	0.9187
0.4627	9.5926	518	0.8578	0.6662	0.8578	0.9262
0.4627	9.6296	520	0.8749	0.6543	0.8749	0.9354
0.4627	9.6667	522	0.8849	0.6586	0.8849	0.9407
0.4627	9.7037	524	0.8901	0.6586	0.8901	0.9434
0.4627	9.7407	526	0.8908	0.6586	0.8908	0.9438
0.4627	9.7778	528	0.8947	0.6586	0.8947	0.9459
0.4627	9.8148	530	0.8992	0.6586	0.8992	0.9483
0.4627	9.8519	532	0.9008	0.6586	0.9008	0.9491
0.4627	9.8889	534	0.9002	0.6586	0.9002	0.9488
0.4627	9.9259	536	0.8986	0.6586	0.8986	0.9479
0.4627	9.9630	538	0.8979	0.6586	0.8979	0.9476
0.4627	10.0	540	0.8979	0.6586	0.8979	0.9476

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1