ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k2_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1517
• Qwk: 0.2334
• Mse: 1.1517
• Rmse: 1.0732

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1818	2	4.8718	-0.0104	4.8718	2.2072
No log	0.3636	4	2.8092	-0.0140	2.8092	1.6761
No log	0.5455	6	2.0513	-0.0433	2.0513	1.4322
No log	0.7273	8	1.4013	-0.0261	1.4013	1.1838
No log	0.9091	10	1.2048	0.1244	1.2048	1.0976
No log	1.0909	12	1.1520	0.1417	1.1520	1.0733
No log	1.2727	14	1.1586	0.1314	1.1586	1.0764
No log	1.4545	16	1.4394	0.0182	1.4394	1.1998
No log	1.6364	18	1.5466	-0.0218	1.5466	1.2436
No log	1.8182	20	1.4408	0.0445	1.4408	1.2004
No log	2.0	22	1.3297	0.1054	1.3297	1.1531
No log	2.1818	24	1.3753	0.0010	1.3753	1.1727
No log	2.3636	26	1.2859	0.2038	1.2859	1.1340
No log	2.5455	28	1.4440	0.1545	1.4440	1.2016
No log	2.7273	30	1.4084	0.1059	1.4084	1.1868
No log	2.9091	32	1.2056	0.2065	1.2056	1.0980
No log	3.0909	34	1.4394	0.2153	1.4394	1.1998
No log	3.2727	36	1.7504	0.2564	1.7504	1.3230
No log	3.4545	38	1.7449	0.2564	1.7449	1.3210
No log	3.6364	40	1.5556	0.1758	1.5556	1.2473
No log	3.8182	42	1.2226	0.2206	1.2226	1.1057
No log	4.0	44	1.2129	0.1480	1.2129	1.1013
No log	4.1818	46	1.2342	0.1239	1.2342	1.1109
No log	4.3636	48	1.4021	0.2650	1.4021	1.1841
No log	4.5455	50	1.6113	0.0748	1.6113	1.2694
No log	4.7273	52	1.4594	0.2069	1.4594	1.2081
No log	4.9091	54	1.2487	0.2293	1.2487	1.1174
No log	5.0909	56	1.3014	0.1379	1.3014	1.1408
No log	5.2727	58	1.2362	0.1882	1.2362	1.1118
No log	5.4545	60	1.2040	0.2623	1.2040	1.0973
No log	5.6364	62	1.3563	0.2069	1.3563	1.1646
No log	5.8182	64	1.5850	0.2260	1.5850	1.2590
No log	6.0	66	1.4663	0.2468	1.4663	1.2109
No log	6.1818	68	1.1856	0.1969	1.1856	1.0889
No log	6.3636	70	1.1706	0.2200	1.1706	1.0820
No log	6.5455	72	1.2161	0.0880	1.2161	1.1028
No log	6.7273	74	1.4178	0.2359	1.4178	1.1907
No log	6.9091	76	1.3725	0.2731	1.3725	1.1715
No log	7.0909	78	1.1483	0.2402	1.1483	1.0716
No log	7.2727	80	1.1154	0.3097	1.1154	1.0561
No log	7.4545	82	1.0888	0.3560	1.0888	1.0435
No log	7.6364	84	1.1115	0.2444	1.1115	1.0543
No log	7.8182	86	1.4188	0.2820	1.4188	1.1911
No log	8.0	88	1.9395	0.1999	1.9395	1.3927
No log	8.1818	90	1.8457	0.2675	1.8457	1.3586
No log	8.3636	92	1.2832	0.2055	1.2832	1.1328
No log	8.5455	94	1.0899	0.3115	1.0899	1.0440
No log	8.7273	96	1.0761	0.2997	1.0761	1.0374
No log	8.9091	98	1.2457	0.2807	1.2457	1.1161
No log	9.0909	100	1.7417	0.2735	1.7417	1.3198
No log	9.2727	102	1.7795	0.2419	1.7795	1.3340
No log	9.4545	104	1.5457	0.2542	1.5457	1.2433
No log	9.6364	106	1.2678	0.1935	1.2678	1.1260
No log	9.8182	108	1.1952	0.1536	1.1952	1.0932
No log	10.0	110	1.1321	0.1696	1.1321	1.0640
No log	10.1818	112	1.2710	0.1646	1.2710	1.1274
No log	10.3636	114	1.6083	0.2569	1.6083	1.2682
No log	10.5455	116	1.6746	0.2782	1.6746	1.2941
No log	10.7273	118	1.4890	0.2574	1.4890	1.2202
No log	10.9091	120	1.1395	0.1692	1.1395	1.0675
No log	11.0909	122	0.9948	0.3278	0.9948	0.9974
No log	11.2727	124	1.0056	0.2969	1.0056	1.0028
No log	11.4545	126	1.1491	0.1692	1.1491	1.0720
No log	11.6364	128	1.4453	0.2144	1.4453	1.2022
No log	11.8182	130	1.5243	0.2455	1.5243	1.2346
No log	12.0	132	1.3708	0.2181	1.3708	1.1708
No log	12.1818	134	1.1937	0.2586	1.1937	1.0926
No log	12.3636	136	1.1275	0.1896	1.1275	1.0618
No log	12.5455	138	1.1055	0.1596	1.1055	1.0514
No log	12.7273	140	1.1850	0.2586	1.1850	1.0886
No log	12.9091	142	1.1817	0.2317	1.1817	1.0870
No log	13.0909	144	1.2303	0.2844	1.2303	1.1092
No log	13.2727	146	1.3428	0.2964	1.3428	1.1588
No log	13.4545	148	1.2549	0.2941	1.2549	1.1202
No log	13.6364	150	1.1146	0.2978	1.1146	1.0558
No log	13.8182	152	1.1128	0.2978	1.1128	1.0549
No log	14.0	154	1.1197	0.2978	1.1197	1.0581
No log	14.1818	156	1.0616	0.3022	1.0616	1.0303
No log	14.3636	158	1.0982	0.3022	1.0982	1.0479
No log	14.5455	160	1.2454	0.2553	1.2454	1.1160
No log	14.7273	162	1.1514	0.1500	1.1514	1.0730
No log	14.9091	164	1.0655	0.2351	1.0655	1.0322
No log	15.0909	166	1.0771	0.2188	1.0771	1.0378
No log	15.2727	168	1.1687	0.2046	1.1687	1.0810
No log	15.4545	170	1.4832	0.2632	1.4832	1.2179
No log	15.6364	172	1.4245	0.2632	1.4245	1.1935
No log	15.8182	174	1.1557	0.2195	1.1557	1.0750
No log	16.0	176	1.0982	0.2072	1.0982	1.0479
No log	16.1818	178	1.1412	0.1480	1.1412	1.0683
No log	16.3636	180	1.3303	0.2173	1.3303	1.1534
No log	16.5455	182	1.3833	0.2065	1.3833	1.1761
No log	16.7273	184	1.2788	0.2131	1.2788	1.1308
No log	16.9091	186	1.1286	0.1741	1.1286	1.0624
No log	17.0909	188	1.0916	0.1808	1.0916	1.0448
No log	17.2727	190	1.1137	0.1801	1.1137	1.0553
No log	17.4545	192	1.3657	0.2604	1.3657	1.1686
No log	17.6364	194	1.6686	0.3008	1.6686	1.2917
No log	17.8182	196	1.5792	0.2759	1.5792	1.2567
No log	18.0	198	1.3441	0.2325	1.3441	1.1593
No log	18.1818	200	1.1440	0.2484	1.1440	1.0696
No log	18.3636	202	1.1192	0.2195	1.1192	1.0579
No log	18.5455	204	1.2079	0.2817	1.2079	1.0990
No log	18.7273	206	1.2944	0.2445	1.2944	1.1377
No log	18.9091	208	1.2476	0.2410	1.2476	1.1169
No log	19.0909	210	1.1625	0.2519	1.1625	1.0782
No log	19.2727	212	1.0544	0.1696	1.0544	1.0268
No log	19.4545	214	1.0517	0.2250	1.0517	1.0255
No log	19.6364	216	1.1986	0.3299	1.1986	1.0948
No log	19.8182	218	1.3032	0.2544	1.3032	1.1416
No log	20.0	220	1.3494	0.2574	1.3494	1.1616
No log	20.1818	222	1.3059	0.2512	1.3059	1.1428
No log	20.3636	224	1.2296	0.2512	1.2296	1.1089
No log	20.5455	226	1.1303	0.2519	1.1303	1.0631
No log	20.7273	228	1.0904	0.2931	1.0904	1.0442
No log	20.9091	230	1.0543	0.2953	1.0543	1.0268
No log	21.0909	232	1.0270	0.2651	1.0270	1.0134
No log	21.2727	234	1.1270	0.2131	1.1270	1.0616
No log	21.4545	236	1.1830	0.2410	1.1830	1.0877
No log	21.6364	238	1.1607	0.2334	1.1607	1.0774
No log	21.8182	240	1.1778	0.2334	1.1778	1.0853
No log	22.0	242	1.2012	0.2334	1.2012	1.0960
No log	22.1818	244	1.1806	0.1477	1.1806	1.0866
No log	22.3636	246	1.1050	0.1249	1.1050	1.0512
No log	22.5455	248	1.0554	0.0802	1.0554	1.0273
No log	22.7273	250	1.0506	0.1217	1.0506	1.0250
No log	22.9091	252	1.0955	0.2424	1.0955	1.0467
No log	23.0909	254	1.2163	0.2959	1.2163	1.1029
No log	23.2727	256	1.2745	0.2574	1.2745	1.1289
No log	23.4545	258	1.2028	0.2678	1.2028	1.0967
No log	23.6364	260	1.1800	0.2678	1.1800	1.0863
No log	23.8182	262	1.1471	0.2041	1.1471	1.0710
No log	24.0	264	1.1358	0.1477	1.1358	1.0657
No log	24.1818	266	1.1181	0.1217	1.1181	1.0574
No log	24.3636	268	1.1149	0.1217	1.1149	1.0559
No log	24.5455	270	1.1812	0.1692	1.1812	1.0868
No log	24.7273	272	1.2223	0.2037	1.2223	1.1056
No log	24.9091	274	1.2983	0.2574	1.2983	1.1394
No log	25.0909	276	1.2858	0.2574	1.2858	1.1339
No log	25.2727	278	1.1737	0.3026	1.1737	1.0834
No log	25.4545	280	1.0525	0.1696	1.0525	1.0259
No log	25.6364	282	1.0301	0.1315	1.0301	1.0149
No log	25.8182	284	1.0558	0.1217	1.0558	1.0275
No log	26.0	286	1.1137	0.1219	1.1137	1.0553
No log	26.1818	288	1.1660	0.2334	1.1660	1.0798
No log	26.3636	290	1.2372	0.2959	1.2372	1.1123
No log	26.5455	292	1.2064	0.2678	1.2064	1.0984
No log	26.7273	294	1.1476	0.2041	1.1476	1.0712
No log	26.9091	296	1.0789	0.1316	1.0789	1.0387
No log	27.0909	298	1.0698	0.1641	1.0698	1.0343
No log	27.2727	300	1.1302	0.2334	1.1302	1.0631
No log	27.4545	302	1.2878	0.2544	1.2878	1.1348
No log	27.6364	304	1.3566	0.2815	1.3566	1.1648
No log	27.8182	306	1.3000	0.2544	1.3000	1.1402
No log	28.0	308	1.1937	0.2334	1.1937	1.0926
No log	28.1818	310	1.1034	0.1894	1.1034	1.0504
No log	28.3636	312	1.0740	0.0980	1.0740	1.0364
No log	28.5455	314	1.0957	0.0904	1.0957	1.0468
No log	28.7273	316	1.1353	0.0980	1.1353	1.0655
No log	28.9091	318	1.1716	0.1477	1.1716	1.0824
No log	29.0909	320	1.1853	0.1477	1.1853	1.0887
No log	29.2727	322	1.1509	0.1316	1.1509	1.0728
No log	29.4545	324	1.1402	0.1894	1.1402	1.0678
No log	29.6364	326	1.0937	0.1479	1.0937	1.0458
No log	29.8182	328	1.0940	0.2051	1.0940	1.0459
No log	30.0	330	1.1279	0.2730	1.1279	1.0620
No log	30.1818	332	1.1926	0.2289	1.1926	1.0921
No log	30.3636	334	1.2615	0.2574	1.2615	1.1232
No log	30.5455	336	1.2479	0.2574	1.2479	1.1171
No log	30.7273	338	1.1896	0.2574	1.1896	1.0907
No log	30.9091	340	1.1289	0.2647	1.1289	1.0625
No log	31.0909	342	1.1542	0.2918	1.1542	1.0744
No log	31.2727	344	1.2512	0.2604	1.2512	1.1186
No log	31.4545	346	1.2522	0.2574	1.2522	1.1190
No log	31.6364	348	1.2629	0.2574	1.2629	1.1238
No log	31.8182	350	1.2745	0.2574	1.2745	1.1289
No log	32.0	352	1.1989	0.2512	1.1989	1.0950
No log	32.1818	354	1.0840	0.2730	1.0840	1.0412
No log	32.3636	356	1.0228	0.2207	1.0228	1.0113
No log	32.5455	358	1.0346	0.3124	1.0346	1.0171
No log	32.7273	360	1.1196	0.3049	1.1196	1.0581
No log	32.9091	362	1.2558	0.2544	1.2558	1.1206
No log	33.0909	364	1.3209	0.2544	1.3209	1.1493
No log	33.2727	366	1.2515	0.2959	1.2515	1.1187
No log	33.4545	368	1.1237	0.2790	1.1237	1.0601
No log	33.6364	370	0.9908	0.1952	0.9908	0.9954
No log	33.8182	372	0.9234	0.3298	0.9234	0.9609
No log	34.0	374	0.9218	0.3448	0.9218	0.9601
No log	34.1818	376	0.9818	0.2516	0.9818	0.9909
No log	34.3636	378	1.1128	0.3124	1.1128	1.0549
No log	34.5455	380	1.2049	0.2959	1.2049	1.0977
No log	34.7273	382	1.1904	0.2910	1.1904	1.0910
No log	34.9091	384	1.1460	0.2884	1.1460	1.0705
No log	35.0909	386	1.1097	0.1637	1.1097	1.0534
No log	35.2727	388	1.0834	0.1795	1.0834	1.0409
No log	35.4545	390	1.0815	0.1637	1.0815	1.0400
No log	35.6364	392	1.0920	0.2484	1.0920	1.0450
No log	35.8182	394	1.0584	0.2484	1.0584	1.0288
No log	36.0	396	1.0210	0.2387	1.0210	1.0104
No log	36.1818	398	0.9682	0.2651	0.9682	0.9840
No log	36.3636	400	0.9633	0.25	0.9633	0.9815
No log	36.5455	402	0.9650	0.25	0.9650	0.9823
No log	36.7273	404	0.9801	0.2097	0.9801	0.9900
No log	36.9091	406	1.0058	0.2730	1.0058	1.0029
No log	37.0909	408	1.0024	0.2730	1.0024	1.0012
No log	37.2727	410	1.0398	0.3262	1.0398	1.0197
No log	37.4545	412	1.0395	0.3526	1.0395	1.0195
No log	37.6364	414	0.9905	0.2931	0.9905	0.9952
No log	37.8182	416	0.9621	0.3446	0.9621	0.9809
No log	38.0	418	0.9705	0.3446	0.9705	0.9852
No log	38.1818	420	0.9911	0.3446	0.9911	0.9955
No log	38.3636	422	1.0215	0.3324	1.0215	1.0107
No log	38.5455	424	1.0965	0.3113	1.0965	1.0471
No log	38.7273	426	1.1266	0.2763	1.1266	1.0614
No log	38.9091	428	1.1553	0.2910	1.1553	1.0749
No log	39.0909	430	1.1916	0.2615	1.1916	1.0916
No log	39.2727	432	1.1703	0.2334	1.1703	1.0818
No log	39.4545	434	1.1129	0.2334	1.1129	1.0549
No log	39.6364	436	1.0337	0.1479	1.0337	1.0167
No log	39.8182	438	0.9842	0.2061	0.9842	0.9921
No log	40.0	440	0.9690	0.3559	0.9690	0.9844
No log	40.1818	442	1.0245	0.3270	1.0245	1.0122
No log	40.3636	444	1.1369	0.2941	1.1369	1.0663
No log	40.5455	446	1.2380	0.3067	1.2380	1.1127
No log	40.7273	448	1.2134	0.3067	1.2134	1.1015
No log	40.9091	450	1.1026	0.2704	1.1026	1.0501
No log	41.0909	452	1.0415	0.2484	1.0415	1.0205
No log	41.2727	454	1.0218	0.2878	1.0218	1.0109
No log	41.4545	456	1.0315	0.2484	1.0315	1.0156
No log	41.6364	458	1.0665	0.2334	1.0665	1.0327
No log	41.8182	460	1.0982	0.2334	1.0982	1.0480
No log	42.0	462	1.0857	0.1152	1.0857	1.0420
No log	42.1818	464	1.0854	0.1152	1.0854	1.0418
No log	42.3636	466	1.0584	0.1152	1.0584	1.0288
No log	42.5455	468	1.0402	0.2730	1.0402	1.0199
No log	42.7273	470	1.0463	0.3124	1.0463	1.0229
No log	42.9091	472	1.0085	0.3528	1.0085	1.0042
No log	43.0909	474	0.9673	0.3817	0.9673	0.9835
No log	43.2727	476	1.0076	0.3446	1.0076	1.0038
No log	43.4545	478	1.0889	0.2910	1.0889	1.0435
No log	43.6364	480	1.2214	0.2839	1.2214	1.1051
No log	43.8182	482	1.3094	0.2966	1.3094	1.1443
No log	44.0	484	1.2876	0.2476	1.2876	1.1347
No log	44.1818	486	1.1910	0.2910	1.1910	1.0913
No log	44.3636	488	1.0816	0.2334	1.0816	1.0400
No log	44.5455	490	1.0138	0.25	1.0138	1.0069
No log	44.7273	492	0.9907	0.2651	0.9907	0.9953
No log	44.9091	494	1.0092	0.3025	1.0092	1.0046
No log	45.0909	496	1.0351	0.2633	1.0351	1.0174
No log	45.2727	498	1.0733	0.2730	1.0733	1.0360
0.2673	45.4545	500	1.1481	0.2678	1.1481	1.0715
0.2673	45.6364	502	1.1955	0.2736	1.1955	1.0934
0.2673	45.8182	504	1.1671	0.2678	1.1671	1.0803
0.2673	46.0	506	1.1070	0.2334	1.1070	1.0521
0.2673	46.1818	508	1.0544	0.2878	1.0544	1.0269
0.2673	46.3636	510	1.0652	0.1148	1.0652	1.0321
0.2673	46.5455	512	1.0771	0.1148	1.0771	1.0378
0.2673	46.7273	514	1.1064	0.1477	1.1064	1.0519
0.2673	46.9091	516	1.1301	0.2041	1.1301	1.0631
0.2673	47.0909	518	1.1517	0.2334	1.1517	1.0732

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1