ArabicNewSplits7_OSS_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k2_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8039
• Qwk: 0.0733
• Mse: 0.8039
• Rmse: 0.8966

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1818	2	3.8182	-0.0057	3.8182	1.9540
No log	0.3636	4	2.1665	-0.0113	2.1665	1.4719
No log	0.5455	6	1.2268	-0.1006	1.2268	1.1076
No log	0.7273	8	1.1890	-0.2267	1.1890	1.0904
No log	0.9091	10	1.6618	0.0099	1.6618	1.2891
No log	1.0909	12	1.0950	-0.0526	1.0950	1.0464
No log	1.2727	14	0.9234	-0.0054	0.9234	0.9610
No log	1.4545	16	1.1295	-0.0575	1.1295	1.0628
No log	1.6364	18	0.9431	-0.0545	0.9431	0.9711
No log	1.8182	20	0.9354	0.0873	0.9354	0.9672
No log	2.0	22	0.7522	0.0549	0.7522	0.8673
No log	2.1818	24	0.6899	0.0506	0.6899	0.8306
No log	2.3636	26	0.7254	0.0964	0.7254	0.8517
No log	2.5455	28	0.9549	0.0089	0.9549	0.9772
No log	2.7273	30	1.1681	-0.0411	1.1681	1.0808
No log	2.9091	32	0.9962	0.0067	0.9962	0.9981
No log	3.0909	34	0.9082	0.0676	0.9082	0.9530
No log	3.2727	36	0.7542	0.1202	0.7542	0.8684
No log	3.4545	38	0.7095	0.1828	0.7095	0.8423
No log	3.6364	40	0.8252	0.0793	0.8252	0.9084
No log	3.8182	42	1.4047	0.0399	1.4047	1.1852
No log	4.0	44	1.6579	0.0860	1.6579	1.2876
No log	4.1818	46	1.1316	0.0634	1.1316	1.0638
No log	4.3636	48	0.7934	0.1387	0.7934	0.8908
No log	4.5455	50	0.8034	0.0959	0.8034	0.8963
No log	4.7273	52	0.9573	0.0320	0.9573	0.9784
No log	4.9091	54	1.1354	0.0465	1.1354	1.0655
No log	5.0909	56	0.9694	-0.0008	0.9694	0.9846
No log	5.2727	58	0.8132	0.1093	0.8132	0.9018
No log	5.4545	60	0.9315	0.0168	0.9315	0.9651
No log	5.6364	62	1.2793	0.0199	1.2793	1.1311
No log	5.8182	64	1.1765	0.0724	1.1765	1.0847
No log	6.0	66	1.1762	0.0984	1.1762	1.0845
No log	6.1818	68	1.1571	0.0607	1.1571	1.0757
No log	6.3636	70	1.2191	0.0822	1.2191	1.1041
No log	6.5455	72	1.1494	0.0345	1.1494	1.0721
No log	6.7273	74	1.0458	0.0804	1.0458	1.0226
No log	6.9091	76	1.1860	0.0146	1.1860	1.0890
No log	7.0909	78	1.6663	-0.0795	1.6663	1.2908
No log	7.2727	80	1.3540	-0.0460	1.3540	1.1636
No log	7.4545	82	1.0129	0.0455	1.0129	1.0064
No log	7.6364	84	1.1207	0.0685	1.1207	1.0586
No log	7.8182	86	1.1000	0.0449	1.1000	1.0488
No log	8.0	88	1.3497	0.0178	1.3497	1.1618
No log	8.1818	90	1.4280	0.0092	1.4280	1.1950
No log	8.3636	92	1.1528	0.2510	1.1528	1.0737
No log	8.5455	94	1.1588	0.1626	1.1588	1.0765
No log	8.7273	96	1.0285	0.0834	1.0285	1.0142
No log	8.9091	98	1.0387	0.0313	1.0387	1.0192
No log	9.0909	100	1.0323	0.0596	1.0323	1.0160
No log	9.2727	102	0.9915	-0.0233	0.9915	0.9957
No log	9.4545	104	1.0705	0.0449	1.0705	1.0346
No log	9.6364	106	1.0746	0.0110	1.0746	1.0366
No log	9.8182	108	1.0471	0.0563	1.0471	1.0233
No log	10.0	110	1.0485	0.1567	1.0485	1.0240
No log	10.1818	112	1.0310	0.1575	1.0310	1.0154
No log	10.3636	114	1.0742	0.0956	1.0742	1.0364
No log	10.5455	116	1.1091	0.1254	1.1091	1.0531
No log	10.7273	118	1.0878	0.0960	1.0878	1.0430
No log	10.9091	120	1.0114	0.0839	1.0114	1.0057
No log	11.0909	122	0.9483	0.1531	0.9483	0.9738
No log	11.2727	124	0.9024	0.0768	0.9024	0.9500
No log	11.4545	126	1.0277	0.0114	1.0277	1.0137
No log	11.6364	128	0.9992	0.0810	0.9992	0.9996
No log	11.8182	130	1.0601	0.1561	1.0601	1.0296
No log	12.0	132	1.1128	0.0105	1.1128	1.0549
No log	12.1818	134	1.0994	0.1538	1.0994	1.0485
No log	12.3636	136	1.1696	0.0435	1.1696	1.0815
No log	12.5455	138	1.0559	0.0081	1.0559	1.0276
No log	12.7273	140	0.9234	-0.1102	0.9234	0.9609
No log	12.9091	142	1.2156	-0.0902	1.2156	1.1026
No log	13.0909	144	1.0777	-0.0163	1.0777	1.0381
No log	13.2727	146	0.8255	0.0660	0.8255	0.9086
No log	13.4545	148	1.0631	0.0516	1.0631	1.0311
No log	13.6364	150	1.0975	0.0816	1.0975	1.0476
No log	13.8182	152	0.8437	0.0916	0.8437	0.9185
No log	14.0	154	0.9171	0.0748	0.9171	0.9577
No log	14.1818	156	1.0348	0.0182	1.0348	1.0172
No log	14.3636	158	0.8612	0.0888	0.8612	0.9280
No log	14.5455	160	0.9390	0.0627	0.9390	0.9690
No log	14.7273	162	1.0140	0.0758	1.0140	1.0070
No log	14.9091	164	0.9463	0.1017	0.9463	0.9728
No log	15.0909	166	1.1093	0.0327	1.1093	1.0532
No log	15.2727	168	1.0799	0.0418	1.0799	1.0392
No log	15.4545	170	1.0214	0.1857	1.0214	1.0106
No log	15.6364	172	1.0692	0.0331	1.0692	1.0340
No log	15.8182	174	1.0666	0.0344	1.0666	1.0327
No log	16.0	176	0.9335	0.1379	0.9335	0.9662
No log	16.1818	178	1.1248	0.0556	1.1248	1.0606
No log	16.3636	180	1.0653	0.0250	1.0653	1.0321
No log	16.5455	182	0.8507	0.0295	0.8507	0.9223
No log	16.7273	184	0.8441	0.0905	0.8441	0.9188
No log	16.9091	186	0.8305	0.0488	0.8305	0.9113
No log	17.0909	188	0.8401	0.1365	0.8401	0.9165
No log	17.2727	190	0.9449	-0.0031	0.9449	0.9721
No log	17.4545	192	0.9215	0.0149	0.9215	0.9599
No log	17.6364	194	0.9759	-0.0753	0.9759	0.9879
No log	17.8182	196	1.0489	0.0083	1.0489	1.0241
No log	18.0	198	1.0115	0.0651	1.0115	1.0057
No log	18.1818	200	1.0039	0.0445	1.0039	1.0019
No log	18.3636	202	1.0640	0.0715	1.0640	1.0315
No log	18.5455	204	0.9268	0.0534	0.9268	0.9627
No log	18.7273	206	0.8813	0.1203	0.8813	0.9388
No log	18.9091	208	0.8433	0.1215	0.8433	0.9183
No log	19.0909	210	0.8222	0.0959	0.8222	0.9068
No log	19.2727	212	0.9579	0.0333	0.9579	0.9787
No log	19.4545	214	1.0267	0.0207	1.0267	1.0133
No log	19.6364	216	0.8913	0.0015	0.8913	0.9441
No log	19.8182	218	0.8394	0.0407	0.8394	0.9162
No log	20.0	220	0.8183	0.0393	0.8183	0.9046
No log	20.1818	222	0.8231	0.0909	0.8231	0.9072
No log	20.3636	224	0.8792	0.0676	0.8792	0.9377
No log	20.5455	226	0.8473	0.0490	0.8473	0.9205
No log	20.7273	228	0.8391	0.1093	0.8391	0.9160
No log	20.9091	230	0.9347	0.0296	0.9347	0.9668
No log	21.0909	232	1.1327	0.0808	1.1327	1.0643
No log	21.2727	234	1.0211	0.0454	1.0211	1.0105
No log	21.4545	236	0.8518	0.0047	0.8518	0.9230
No log	21.6364	238	0.9355	0.0350	0.9355	0.9672
No log	21.8182	240	1.0616	0.0134	1.0616	1.0303
No log	22.0	242	0.9378	0.0277	0.9378	0.9684
No log	22.1818	244	0.8227	0.1139	0.8227	0.9070
No log	22.3636	246	0.8421	0.0026	0.8421	0.9177
No log	22.5455	248	0.8616	0.0	0.8616	0.9282
No log	22.7273	250	0.8494	0.0725	0.8494	0.9216
No log	22.9091	252	0.9254	0.1882	0.9254	0.9620
No log	23.0909	254	0.8950	0.1636	0.8950	0.9460
No log	23.2727	256	0.8913	-0.0148	0.8913	0.9441
No log	23.4545	258	0.9705	-0.0322	0.9705	0.9851
No log	23.6364	260	0.8844	-0.0173	0.8844	0.9404
No log	23.8182	262	0.8549	0.1829	0.8549	0.9246
No log	24.0	264	0.9648	0.0988	0.9648	0.9822
No log	24.1818	266	0.9645	0.0988	0.9645	0.9821
No log	24.3636	268	0.8143	0.1138	0.8143	0.9024
No log	24.5455	270	0.7868	0.0851	0.7868	0.8870
No log	24.7273	272	0.7874	0.0851	0.7874	0.8874
No log	24.9091	274	0.8364	0.2131	0.8364	0.9145
No log	25.0909	276	0.9797	0.1025	0.9797	0.9898
No log	25.2727	278	0.9025	0.0684	0.9025	0.9500
No log	25.4545	280	0.7708	0.2024	0.7708	0.8780
No log	25.6364	282	0.8018	0.0581	0.8018	0.8954
No log	25.8182	284	0.7834	0.0172	0.7834	0.8851
No log	26.0	286	0.7887	0.1553	0.7887	0.8881
No log	26.1818	288	0.8355	0.0490	0.8355	0.9141
No log	26.3636	290	0.8818	0.0871	0.8818	0.9391
No log	26.5455	292	0.9096	0.1235	0.9096	0.9537
No log	26.7273	294	0.8912	0.1010	0.8912	0.9440
No log	26.9091	296	0.8827	0.1359	0.8827	0.9395
No log	27.0909	298	0.8565	0.0927	0.8565	0.9255
No log	27.2727	300	0.8101	0.1617	0.8101	0.9001
No log	27.4545	302	0.8226	-0.0508	0.8226	0.9070
No log	27.6364	304	0.7962	-0.0195	0.7962	0.8923
No log	27.8182	306	0.7384	0.0414	0.7384	0.8593
No log	28.0	308	0.7673	0.2424	0.7673	0.8760
No log	28.1818	310	0.8479	0.1064	0.8479	0.9208
No log	28.3636	312	0.8654	0.0642	0.8654	0.9302
No log	28.5455	314	0.7962	0.1239	0.7962	0.8923
No log	28.7273	316	0.8384	0.0628	0.8384	0.9156
No log	28.9091	318	0.9280	-0.0059	0.9280	0.9634
No log	29.0909	320	0.9291	0.1168	0.9291	0.9639
No log	29.2727	322	0.9030	0.1325	0.9030	0.9502
No log	29.4545	324	0.9481	0.0432	0.9481	0.9737
No log	29.6364	326	0.9221	0.0826	0.9221	0.9603
No log	29.8182	328	0.8852	0.1225	0.8852	0.9408
No log	30.0	330	0.8454	0.1225	0.8454	0.9195
No log	30.1818	332	0.8230	0.1713	0.8230	0.9072
No log	30.3636	334	0.8130	0.1823	0.8130	0.9017
No log	30.5455	336	0.8166	0.0959	0.8166	0.9036
No log	30.7273	338	0.7965	0.1823	0.7965	0.8925
No log	30.9091	340	0.7849	0.0679	0.7849	0.8859
No log	31.0909	342	0.7814	0.0283	0.7814	0.8840
No log	31.2727	344	0.7904	0.1431	0.7904	0.8891
No log	31.4545	346	0.7821	0.0611	0.7821	0.8844
No log	31.6364	348	0.7649	0.0749	0.7649	0.8746
No log	31.8182	350	0.7647	0.0393	0.7647	0.8745
No log	32.0	352	0.7670	0.0503	0.7670	0.8758
No log	32.1818	354	0.7526	0.0709	0.7526	0.8675
No log	32.3636	356	0.7735	0.0622	0.7735	0.8795
No log	32.5455	358	0.7775	0.1049	0.7775	0.8817
No log	32.7273	360	0.7723	0.0670	0.7723	0.8788
No log	32.9091	362	0.7742	0.0277	0.7742	0.8799
No log	33.0909	364	0.7784	0.0277	0.7784	0.8823
No log	33.2727	366	0.7893	0.0327	0.7893	0.8884
No log	33.4545	368	0.8067	0.0361	0.8067	0.8981
No log	33.6364	370	0.8210	0.0277	0.8210	0.9061
No log	33.8182	372	0.8466	0.1094	0.8466	0.9201
No log	34.0	374	0.8547	0.1138	0.8547	0.9245
No log	34.1818	376	0.8502	0.1218	0.8502	0.9221
No log	34.3636	378	0.8357	0.0833	0.8357	0.9142
No log	34.5455	380	0.8268	0.0581	0.8268	0.9093
No log	34.7273	382	0.7943	0.0874	0.7943	0.8912
No log	34.9091	384	0.7709	0.0303	0.7709	0.8780
No log	35.0909	386	0.7866	0.0680	0.7866	0.8869
No log	35.2727	388	0.7614	0.0768	0.7614	0.8726
No log	35.4545	390	0.7533	0.0303	0.7533	0.8679
No log	35.6364	392	0.7607	0.0828	0.7607	0.8722
No log	35.8182	394	0.7747	0.1282	0.7747	0.8801
No log	36.0	396	0.7928	0.1232	0.7928	0.8904
No log	36.1818	398	0.8453	0.1359	0.8453	0.9194
No log	36.3636	400	0.8587	0.2085	0.8587	0.9267
No log	36.5455	402	0.8246	0.1813	0.8246	0.9080
No log	36.7273	404	0.8182	0.0816	0.8182	0.9046
No log	36.9091	406	0.7965	0.0816	0.7965	0.8925
No log	37.0909	408	0.7917	0.0106	0.7917	0.8898
No log	37.2727	410	0.7583	0.0481	0.7583	0.8708
No log	37.4545	412	0.7517	0.0791	0.7517	0.8670
No log	37.6364	414	0.7623	0.1143	0.7623	0.8731
No log	37.8182	416	0.8120	0.1387	0.8120	0.9011
No log	38.0	418	0.8388	0.1646	0.8388	0.9159
No log	38.1818	420	0.7922	0.1049	0.7922	0.8900
No log	38.3636	422	0.7645	0.0810	0.7645	0.8743
No log	38.5455	424	0.7703	0.0165	0.7703	0.8777
No log	38.7273	426	0.7714	0.0110	0.7714	0.8783
No log	38.9091	428	0.7745	0.0426	0.7745	0.8800
No log	39.0909	430	0.8140	0.0639	0.8140	0.9022
No log	39.2727	432	0.8254	0.1095	0.8254	0.9085
No log	39.4545	434	0.8160	0.0049	0.8160	0.9033
No log	39.6364	436	0.8225	-0.0295	0.8225	0.9069
No log	39.8182	438	0.8097	0.0327	0.8097	0.8998
No log	40.0	440	0.8266	0.0562	0.8266	0.9092
No log	40.1818	442	0.8169	0.1003	0.8169	0.9038
No log	40.3636	444	0.8023	0.1529	0.8023	0.8957
No log	40.5455	446	0.7980	0.1049	0.7980	0.8933
No log	40.7273	448	0.8150	0.0959	0.8150	0.9028
No log	40.9091	450	0.8449	0.0456	0.8449	0.9192
No log	41.0909	452	0.8740	0.1553	0.8740	0.9349
No log	41.2727	454	0.8017	0.0867	0.8017	0.8954
No log	41.4545	456	0.7527	0.1144	0.7527	0.8676
No log	41.6364	458	0.7603	0.1646	0.7603	0.8719
No log	41.8182	460	0.7723	0.1550	0.7723	0.8788
No log	42.0	462	0.7980	0.0146	0.7980	0.8933
No log	42.1818	464	0.8131	0.0959	0.8131	0.9017
No log	42.3636	466	0.8462	0.0504	0.8462	0.9199
No log	42.5455	468	0.7984	0.0146	0.7984	0.8935
No log	42.7273	470	0.7615	0.0732	0.7615	0.8726
No log	42.9091	472	0.7589	0.1272	0.7589	0.8712
No log	43.0909	474	0.7566	0.1321	0.7566	0.8698
No log	43.2727	476	0.7470	0.0776	0.7470	0.8643
No log	43.4545	478	0.7907	0.1899	0.7907	0.8892
No log	43.6364	480	0.8241	0.1150	0.8241	0.9078
No log	43.8182	482	0.8298	0.0831	0.8298	0.9109
No log	44.0	484	0.7976	0.1003	0.7976	0.8931
No log	44.1818	486	0.7839	0.0846	0.7839	0.8854
No log	44.3636	488	0.7908	0.1189	0.7908	0.8893
No log	44.5455	490	0.8034	0.1518	0.8034	0.8963
No log	44.7273	492	0.8068	0.1324	0.8068	0.8982
No log	44.9091	494	0.7956	0.1617	0.7956	0.8920
No log	45.0909	496	0.7952	0.0798	0.7952	0.8917
No log	45.2727	498	0.7967	0.1644	0.7967	0.8926
0.2667	45.4545	500	0.8099	0.0961	0.8099	0.9000
0.2667	45.6364	502	0.8685	0.1879	0.8685	0.9320
0.2667	45.8182	504	0.8669	0.1605	0.8669	0.9311
0.2667	46.0	506	0.8058	0.1243	0.8058	0.8977
0.2667	46.1818	508	0.7820	0.1001	0.7820	0.8843
0.2667	46.3636	510	0.7726	0.1144	0.7726	0.8790
0.2667	46.5455	512	0.7746	0.0650	0.7746	0.8801
0.2667	46.7273	514	0.7868	0.0650	0.7868	0.8870
0.2667	46.9091	516	0.8016	0.1431	0.8016	0.8953
0.2667	47.0909	518	0.7913	0.1431	0.7913	0.8896
0.2667	47.2727	520	0.7765	0.0611	0.7765	0.8812
0.2667	47.4545	522	0.7721	0.0611	0.7721	0.8787
0.2667	47.6364	524	0.7887	0.1336	0.7887	0.8881
0.2667	47.8182	526	0.7839	0.1336	0.7839	0.8854
0.2667	48.0	528	0.7652	0.1836	0.7652	0.8747
0.2667	48.1818	530	0.7421	0.2349	0.7421	0.8615
0.2667	48.3636	532	0.7459	0.1836	0.7459	0.8637
0.2667	48.5455	534	0.7677	0.2208	0.7677	0.8762
0.2667	48.7273	536	0.7582	0.2208	0.7582	0.8707
0.2667	48.9091	538	0.7205	0.1758	0.7205	0.8488
0.2667	49.0909	540	0.7090	0.0909	0.7090	0.8420
0.2667	49.2727	542	0.7114	0.0395	0.7114	0.8434
0.2667	49.4545	544	0.7181	0.1318	0.7181	0.8474
0.2667	49.6364	546	0.7322	0.1259	0.7322	0.8557
0.2667	49.8182	548	0.7425	0.1249	0.7425	0.8617
0.2667	50.0	550	0.7553	0.0783	0.7553	0.8691
0.2667	50.1818	552	0.7642	0.0798	0.7642	0.8742
0.2667	50.3636	554	0.7597	0.0783	0.7597	0.8716
0.2667	50.5455	556	0.7629	0.1146	0.7629	0.8734
0.2667	50.7273	558	0.7673	0.2349	0.7673	0.8759
0.2667	50.9091	560	0.7541	0.1965	0.7541	0.8684
0.2667	51.0909	562	0.7402	0.1148	0.7402	0.8603
0.2667	51.2727	564	0.7277	0.1259	0.7277	0.8530
0.2667	51.4545	566	0.7226	0.1259	0.7226	0.8501
0.2667	51.6364	568	0.7304	0.0303	0.7304	0.8546
0.2667	51.8182	570	0.7520	0.0357	0.7520	0.8672
0.2667	52.0	572	0.7779	0.1187	0.7779	0.8820
0.2667	52.1818	574	0.7940	0.1184	0.7940	0.8911
0.2667	52.3636	576	0.8132	0.1713	0.8132	0.9018
0.2667	52.5455	578	0.8148	0.1713	0.8148	0.9027
0.2667	52.7273	580	0.8037	0.1713	0.8037	0.8965
0.2667	52.9091	582	0.7930	0.1277	0.7930	0.8905
0.2667	53.0909	584	0.7691	0.1192	0.7691	0.8770
0.2667	53.2727	586	0.7642	0.1192	0.7642	0.8742
0.2667	53.4545	588	0.7671	0.0660	0.7671	0.8758
0.2667	53.6364	590	0.7715	0.0660	0.7715	0.8784
0.2667	53.8182	592	0.7766	0.0660	0.7766	0.8812
0.2667	54.0	594	0.7870	0.0709	0.7870	0.8871
0.2667	54.1818	596	0.8039	0.0733	0.8039	0.8966

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1