ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k16_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2807
• Qwk: 0.1816
• Mse: 1.2807
• Rmse: 1.1317

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0526	2	3.9297	-0.0091	3.9297	1.9823
No log	0.1053	4	2.2644	0.0093	2.2644	1.5048
No log	0.1579	6	1.4707	-0.0342	1.4707	1.2127
No log	0.2105	8	1.1646	0.1901	1.1646	1.0792
No log	0.2632	10	1.1048	0.1891	1.1048	1.0511
No log	0.3158	12	1.4166	-0.0720	1.4166	1.1902
No log	0.3684	14	1.5278	-0.0657	1.5278	1.2361
No log	0.4211	16	1.1902	0.2268	1.1902	1.0910
No log	0.4737	18	1.0738	0.2492	1.0738	1.0362
No log	0.5263	20	1.1138	0.1107	1.1138	1.0554
No log	0.5789	22	1.0448	0.2061	1.0448	1.0222
No log	0.6316	24	1.0492	0.3082	1.0492	1.0243
No log	0.6842	26	1.0534	0.2834	1.0534	1.0263
No log	0.7368	28	0.9923	0.3457	0.9923	0.9961
No log	0.7895	30	1.1923	0.0884	1.1923	1.0919
No log	0.8421	32	1.5746	-0.2749	1.5746	1.2548
No log	0.8947	34	1.4644	-0.1478	1.4644	1.2101
No log	0.9474	36	1.2039	0.0293	1.2039	1.0972
No log	1.0	38	1.1307	0.0855	1.1307	1.0633
No log	1.0526	40	1.3227	-0.0057	1.3227	1.1501
No log	1.1053	42	1.6379	-0.0797	1.6379	1.2798
No log	1.1579	44	1.6627	-0.0210	1.6627	1.2895
No log	1.2105	46	1.8100	-0.0904	1.8100	1.3454
No log	1.2632	48	1.8027	-0.0274	1.8027	1.3427
No log	1.3158	50	1.8947	-0.0763	1.8947	1.3765
No log	1.3684	52	1.8409	0.0178	1.8409	1.3568
No log	1.4211	54	1.6384	0.1545	1.6384	1.2800
No log	1.4737	56	1.7825	-0.1017	1.7825	1.3351
No log	1.5263	58	1.7611	-0.1364	1.7611	1.3271
No log	1.5789	60	1.6069	0.0791	1.6069	1.2676
No log	1.6316	62	1.6913	-0.0381	1.6913	1.3005
No log	1.6842	64	1.6415	-0.0192	1.6415	1.2812
No log	1.7368	66	1.4119	0.1462	1.4119	1.1882
No log	1.7895	68	1.3219	0.1952	1.3219	1.1497
No log	1.8421	70	1.4256	0.1462	1.4256	1.1940
No log	1.8947	72	1.5223	0.1298	1.5223	1.2338
No log	1.9474	74	1.4131	0.1538	1.4131	1.1887
No log	2.0	76	1.2267	0.0464	1.2267	1.1076
No log	2.0526	78	1.0881	0.0496	1.0881	1.0431
No log	2.1053	80	1.0730	0.0618	1.0730	1.0358
No log	2.1579	82	1.1872	0.0527	1.1872	1.0896
No log	2.2105	84	1.5001	-0.0468	1.5001	1.2248
No log	2.2632	86	1.7777	-0.1153	1.7777	1.3333
No log	2.3158	88	1.7309	-0.0084	1.7309	1.3157
No log	2.3684	90	1.7926	0.1211	1.7926	1.3389
No log	2.4211	92	1.8896	0.1559	1.8896	1.3746
No log	2.4737	94	1.7848	0.1918	1.7848	1.3360
No log	2.5263	96	1.6565	0.1752	1.6565	1.2871
No log	2.5789	98	1.4749	0.2184	1.4749	1.2145
No log	2.6316	100	1.6391	0.1950	1.6391	1.2803
No log	2.6842	102	1.8270	0.1911	1.8270	1.3517
No log	2.7368	104	1.8310	0.1607	1.8310	1.3532
No log	2.7895	106	1.7616	0.1423	1.7616	1.3273
No log	2.8421	108	1.5840	0.2372	1.5840	1.2586
No log	2.8947	110	1.6116	0.1769	1.6116	1.2695
No log	2.9474	112	1.7428	0.2005	1.7428	1.3202
No log	3.0	114	1.5862	0.1832	1.5862	1.2594
No log	3.0526	116	1.4769	0.2184	1.4769	1.2153
No log	3.1053	118	1.4918	0.2474	1.4918	1.2214
No log	3.1579	120	1.4852	0.2611	1.4852	1.2187
No log	3.2105	122	1.6911	0.2527	1.6911	1.3004
No log	3.2632	124	1.7545	0.2296	1.7545	1.3246
No log	3.3158	126	1.5766	0.2522	1.5766	1.2556
No log	3.3684	128	1.3353	0.1744	1.3353	1.1555
No log	3.4211	130	1.2310	0.1142	1.2310	1.1095
No log	3.4737	132	1.2193	0.1142	1.2193	1.1042
No log	3.5263	134	1.2831	0.1407	1.2831	1.1327
No log	3.5789	136	1.3884	0.1814	1.3884	1.1783
No log	3.6316	138	1.4315	0.1814	1.4315	1.1965
No log	3.6842	140	1.3252	0.1744	1.3252	1.1512
No log	3.7368	142	1.2269	0.1538	1.2269	1.1077
No log	3.7895	144	1.2628	0.1725	1.2628	1.1237
No log	3.8421	146	1.4162	0.1744	1.4162	1.1901
No log	3.8947	148	1.6288	0.1298	1.6288	1.2762
No log	3.9474	150	1.7015	0.0500	1.7015	1.3044
No log	4.0	152	1.6055	0.0694	1.6055	1.2671
No log	4.0526	154	1.4147	0.1228	1.4147	1.1894
No log	4.1053	156	1.1925	0.1142	1.1925	1.0920
No log	4.1579	158	1.0782	0.1886	1.0782	1.0384
No log	4.2105	160	1.0829	0.2506	1.0829	1.0406
No log	4.2632	162	1.1439	0.2372	1.1439	1.0695
No log	4.3158	164	1.2598	0.2372	1.2598	1.1224
No log	4.3684	166	1.4574	0.2752	1.4574	1.2072
No log	4.4211	168	1.6639	0.2252	1.6639	1.2899
No log	4.4737	170	1.6256	0.2363	1.6256	1.2750
No log	4.5263	172	1.4613	0.2126	1.4613	1.2089
No log	4.5789	174	1.3283	0.2126	1.3283	1.1525
No log	4.6316	176	1.2587	0.2372	1.2587	1.1219
No log	4.6842	178	1.2206	0.2372	1.2206	1.1048
No log	4.7368	180	1.2299	0.1744	1.2299	1.1090
No log	4.7895	182	1.2713	0.1744	1.2713	1.1275
No log	4.8421	184	1.2208	0.1142	1.2208	1.1049
No log	4.8947	186	1.1791	0.1407	1.1791	1.0859
No log	4.9474	188	1.2151	0.1744	1.2151	1.1023
No log	5.0	190	1.2664	0.1744	1.2664	1.1253
No log	5.0526	192	1.3710	0.2372	1.3710	1.1709
No log	5.1053	194	1.5435	0.2568	1.5435	1.2424
No log	5.1579	196	1.7481	0.2840	1.7481	1.3221
No log	5.2105	198	1.9102	0.2222	1.9102	1.3821
No log	5.2632	200	2.0045	0.2133	2.0045	1.4158
No log	5.3158	202	1.9536	0.1925	1.9536	1.3977
No log	5.3684	204	1.7962	0.2007	1.7962	1.3402
No log	5.4211	206	1.6196	0.2525	1.6196	1.2726
No log	5.4737	208	1.3203	0.2424	1.3203	1.1490
No log	5.5263	210	1.2088	0.1744	1.2088	1.0994
No log	5.5789	212	1.2656	0.1744	1.2656	1.1250
No log	5.6316	214	1.3815	0.1744	1.3815	1.1754
No log	5.6842	216	1.5347	0.2126	1.5347	1.2388
No log	5.7368	218	1.6422	0.2391	1.6422	1.2815
No log	5.7895	220	1.5921	0.2117	1.5921	1.2618
No log	5.8421	222	1.5536	0.2062	1.5536	1.2464
No log	5.8947	224	1.5112	0.2474	1.5112	1.2293
No log	5.9474	226	1.3937	0.2126	1.3937	1.1805
No log	6.0	228	1.4580	0.2184	1.4580	1.2075
No log	6.0526	230	1.6862	0.2270	1.6862	1.2985
No log	6.1053	232	1.7564	0.3095	1.7564	1.3253
No log	6.1579	234	1.6300	0.2806	1.6300	1.2767
No log	6.2105	236	1.4480	0.2184	1.4480	1.2033
No log	6.2632	238	1.3695	0.2126	1.3695	1.1703
No log	6.3158	240	1.4030	0.2126	1.4030	1.1845
No log	6.3684	242	1.5475	0.2869	1.5475	1.2440
No log	6.4211	244	1.5846	0.2906	1.5846	1.2588
No log	6.4737	246	1.4995	0.2793	1.4995	1.2245
No log	6.5263	248	1.3981	0.2065	1.3981	1.1824
No log	6.5789	250	1.3806	0.1744	1.3806	1.1750
No log	6.6316	252	1.3669	0.1814	1.3669	1.1692
No log	6.6842	254	1.3698	0.2126	1.3698	1.1704
No log	6.7368	256	1.3419	0.1744	1.3419	1.1584
No log	6.7895	258	1.2971	0.1744	1.2971	1.1389
No log	6.8421	260	1.2890	0.1744	1.2890	1.1353
No log	6.8947	262	1.4187	0.1744	1.4187	1.1911
No log	6.9474	264	1.5186	0.2372	1.5186	1.2323
No log	7.0	266	1.5260	0.2372	1.5260	1.2353
No log	7.0526	268	1.4733	0.1407	1.4733	1.2138
No log	7.1053	270	1.3790	0.0781	1.3790	1.1743
No log	7.1579	272	1.3793	0.0781	1.3793	1.1744
No log	7.2105	274	1.4136	0.1407	1.4136	1.1889
No log	7.2632	276	1.4855	0.2709	1.4855	1.2188
No log	7.3158	278	1.4576	0.2424	1.4576	1.2073
No log	7.3684	280	1.4248	0.2474	1.4248	1.1937
No log	7.4211	282	1.4775	0.2611	1.4775	1.2155
No log	7.4737	284	1.5982	0.2566	1.5982	1.2642
No log	7.5263	286	1.6067	0.2566	1.6067	1.2675
No log	7.5789	288	1.4728	0.2653	1.4728	1.2136
No log	7.6316	290	1.2975	0.2065	1.2975	1.1391
No log	7.6842	292	1.2552	0.1407	1.2552	1.1204
No log	7.7368	294	1.2743	0.1407	1.2743	1.1288
No log	7.7895	296	1.3631	0.1744	1.3631	1.1675
No log	7.8421	298	1.4207	0.2665	1.4207	1.1919
No log	7.8947	300	1.4830	0.2665	1.4830	1.2178
No log	7.9474	302	1.5736	0.2653	1.5736	1.2544
No log	8.0	304	1.6929	0.2733	1.6929	1.3011
No log	8.0526	306	1.8468	0.1860	1.8468	1.3590
No log	8.1053	308	1.9074	0.1379	1.9074	1.3811
No log	8.1579	310	1.8018	0.1203	1.8018	1.3423
No log	8.2105	312	1.6547	0.2832	1.6547	1.2863
No log	8.2632	314	1.4350	0.2184	1.4350	1.1979
No log	8.3158	316	1.2787	0.1407	1.2787	1.1308
No log	8.3684	318	1.2286	0.0401	1.2286	1.1084
No log	8.4211	320	1.2392	0.0401	1.2392	1.1132
No log	8.4737	322	1.3333	0.0781	1.3333	1.1547
No log	8.5263	324	1.5413	0.2239	1.5413	1.2415
No log	8.5789	326	1.7949	0.2406	1.7949	1.3397
No log	8.6316	328	1.8594	0.2098	1.8594	1.3636
No log	8.6842	330	1.8062	0.2457	1.8062	1.3439
No log	8.7368	332	1.8122	0.2457	1.8122	1.3462
No log	8.7895	334	1.6733	0.2338	1.6733	1.2936
No log	8.8421	336	1.6332	0.2806	1.6332	1.2780
No log	8.8947	338	1.5654	0.2342	1.5654	1.2512
No log	8.9474	340	1.5238	0.2424	1.5238	1.2344
No log	9.0	342	1.4456	0.2424	1.4456	1.2023
No log	9.0526	344	1.4503	0.2424	1.4503	1.2043
No log	9.1053	346	1.4291	0.1814	1.4291	1.1954
No log	9.1579	348	1.4527	0.2126	1.4527	1.2053
No log	9.2105	350	1.5438	0.2522	1.5438	1.2425
No log	9.2632	352	1.5473	0.2474	1.5473	1.2439
No log	9.3158	354	1.5057	0.2424	1.5057	1.2271
No log	9.3684	356	1.3803	0.1407	1.3803	1.1749
No log	9.4211	358	1.3185	0.0401	1.3185	1.1483
No log	9.4737	360	1.3269	0.0401	1.3269	1.1519
No log	9.5263	362	1.4160	0.1814	1.4160	1.1900
No log	9.5789	364	1.4310	0.1407	1.4310	1.1962
No log	9.6316	366	1.4696	0.2424	1.4696	1.2123
No log	9.6842	368	1.5961	0.2793	1.5961	1.2633
No log	9.7368	370	1.6232	0.2568	1.6232	1.2740
No log	9.7895	372	1.5098	0.2126	1.5098	1.2287
No log	9.8421	374	1.3574	0.1744	1.3574	1.1651
No log	9.8947	376	1.2429	0.0401	1.2429	1.1148
No log	9.9474	378	1.2535	0.0401	1.2535	1.1196
No log	10.0	380	1.3467	0.0401	1.3467	1.1605
No log	10.0526	382	1.4393	0.1407	1.4393	1.1997
No log	10.1053	384	1.4593	0.1407	1.4593	1.2080
No log	10.1579	386	1.4466	0.1744	1.4466	1.2027
No log	10.2105	388	1.5174	0.2982	1.5174	1.2318
No log	10.2632	390	1.5586	0.2982	1.5586	1.2484
No log	10.3158	392	1.5970	0.3052	1.5970	1.2637
No log	10.3684	394	1.5403	0.2982	1.5403	1.2411
No log	10.4211	396	1.4602	0.1744	1.4602	1.2084
No log	10.4737	398	1.4416	0.1744	1.4416	1.2007
No log	10.5263	400	1.4361	0.1744	1.4361	1.1984
No log	10.5789	402	1.3738	0.1407	1.3738	1.1721
No log	10.6316	404	1.3393	0.0781	1.3393	1.1573
No log	10.6842	406	1.3636	0.1744	1.3636	1.1677
No log	10.7368	408	1.3889	0.2126	1.3889	1.1785
No log	10.7895	410	1.3992	0.2424	1.3992	1.1829
No log	10.8421	412	1.3378	0.2372	1.3378	1.1566
No log	10.8947	414	1.2682	0.1744	1.2682	1.1261
No log	10.9474	416	1.2462	0.0781	1.2462	1.1164
No log	11.0	418	1.3044	0.0781	1.3044	1.1421
No log	11.0526	420	1.3961	0.1744	1.3961	1.1816
No log	11.1053	422	1.5321	0.2568	1.5321	1.2378
No log	11.1579	424	1.6089	0.2653	1.6089	1.2684
No log	11.2105	426	1.6517	0.2940	1.6517	1.2852
No log	11.2632	428	1.5601	0.2555	1.5601	1.2490
No log	11.3158	430	1.4496	0.2187	1.4496	1.2040
No log	11.3684	432	1.4229	0.2424	1.4229	1.1929
No log	11.4211	434	1.4299	0.2424	1.4299	1.1958
No log	11.4737	436	1.4996	0.2522	1.4996	1.2246
No log	11.5263	438	1.5393	0.2568	1.5393	1.2407
No log	11.5789	440	1.5367	0.2568	1.5367	1.2396
No log	11.6316	442	1.4490	0.2424	1.4490	1.2037
No log	11.6842	444	1.3795	0.2126	1.3795	1.1745
No log	11.7368	446	1.2940	0.0781	1.2940	1.1375
No log	11.7895	448	1.2127	0.0278	1.2127	1.1012
No log	11.8421	450	1.2272	0.0433	1.2272	1.1078
No log	11.8947	452	1.2986	0.1228	1.2986	1.1396
No log	11.9474	454	1.3970	0.2709	1.3970	1.1820
No log	12.0	456	1.4684	0.2611	1.4684	1.2118
No log	12.0526	458	1.4559	0.2568	1.4559	1.2066
No log	12.1053	460	1.4074	0.2752	1.4074	1.1863
No log	12.1579	462	1.2889	0.2424	1.2889	1.1353
No log	12.2105	464	1.1818	0.1500	1.1818	1.0871
No log	12.2632	466	1.1719	0.1887	1.1719	1.0825
No log	12.3158	468	1.2479	0.2260	1.2479	1.1171
No log	12.3684	470	1.4044	0.2568	1.4044	1.1851
No log	12.4211	472	1.5074	0.2653	1.5074	1.2278
No log	12.4737	474	1.4843	0.2611	1.4843	1.2183
No log	12.5263	476	1.3888	0.2709	1.3888	1.1785
No log	12.5789	478	1.2523	0.2126	1.2523	1.1191
No log	12.6316	480	1.2259	0.2126	1.2259	1.1072
No log	12.6842	482	1.2488	0.2126	1.2488	1.1175
No log	12.7368	484	1.3212	0.2126	1.3212	1.1494
No log	12.7895	486	1.3319	0.2126	1.3319	1.1541
No log	12.8421	488	1.3147	0.2065	1.3147	1.1466
No log	12.8947	490	1.2831	0.2065	1.2831	1.1327
No log	12.9474	492	1.2949	0.2065	1.2949	1.1379
No log	13.0	494	1.2793	0.1407	1.2793	1.1311
No log	13.0526	496	1.2770	0.1552	1.2770	1.1301
No log	13.1053	498	1.2965	0.1886	1.2965	1.1386
0.2446	13.1579	500	1.3847	0.2065	1.3847	1.1767
0.2446	13.2105	502	1.5029	0.2372	1.5029	1.2259
0.2446	13.2632	504	1.6077	0.2611	1.6077	1.2679
0.2446	13.3158	506	1.6148	0.2611	1.6148	1.2708
0.2446	13.3684	508	1.5477	0.2424	1.5477	1.2441
0.2446	13.4211	510	1.4749	0.2372	1.4749	1.2145
0.2446	13.4737	512	1.4273	0.2065	1.4273	1.1947
0.2446	13.5263	514	1.4119	0.1744	1.4119	1.1882
0.2446	13.5789	516	1.4320	0.1744	1.4320	1.1967
0.2446	13.6316	518	1.5183	0.2065	1.5183	1.2322
0.2446	13.6842	520	1.6027	0.2239	1.6027	1.2660
0.2446	13.7368	522	1.7140	0.2437	1.7140	1.3092
0.2446	13.7895	524	1.8271	0.2206	1.8271	1.3517
0.2446	13.8421	526	1.7716	0.2437	1.7716	1.3310
0.2446	13.8947	528	1.5679	0.2065	1.5679	1.2522
0.2446	13.9474	530	1.3757	0.1407	1.3757	1.1729
0.2446	14.0	532	1.2969	0.0401	1.2969	1.1388
0.2446	14.0526	534	1.2511	0.0833	1.2511	1.1185
0.2446	14.1053	536	1.2807	0.1816	1.2807	1.1317

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1