ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k10_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.3881
• Qwk: 0.1608
• Mse: 1.3881
• Rmse: 1.1782

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	4.5859	-0.0132	4.5859	2.1415
No log	0.0769	4	2.6587	-0.0463	2.6587	1.6305
No log	0.1154	6	1.8011	0.0372	1.8011	1.3421
No log	0.1538	8	1.4835	0.0682	1.4835	1.2180
No log	0.1923	10	1.3943	0.0610	1.3943	1.1808
No log	0.2308	12	1.3025	0.0723	1.3025	1.1413
No log	0.2692	14	1.2741	0.0704	1.2741	1.1288
No log	0.3077	16	1.2934	0.0952	1.2934	1.1373
No log	0.3462	18	1.3368	0.0839	1.3368	1.1562
No log	0.3846	20	1.3848	0.0357	1.3848	1.1768
No log	0.4231	22	1.4752	0.0462	1.4752	1.2146
No log	0.4615	24	1.4198	-0.1201	1.4198	1.1916
No log	0.5	26	1.3726	-0.0432	1.3726	1.1716
No log	0.5385	28	1.6087	-0.0300	1.6087	1.2684
No log	0.5769	30	1.6285	-0.0300	1.6285	1.2761
No log	0.6154	32	1.4506	0.0232	1.4506	1.2044
No log	0.6538	34	1.4524	-0.0078	1.4524	1.2051
No log	0.6923	36	1.4387	-0.0147	1.4387	1.1995
No log	0.7308	38	1.2772	0.1271	1.2772	1.1301
No log	0.7692	40	1.2611	0.0945	1.2611	1.1230
No log	0.8077	42	1.3150	0.0979	1.3150	1.1467
No log	0.8462	44	1.2545	0.1570	1.2545	1.1200
No log	0.8846	46	1.2420	0.0711	1.2420	1.1145
No log	0.9231	48	1.2597	0.1011	1.2597	1.1224
No log	0.9615	50	1.3006	0.0666	1.3006	1.1404
No log	1.0	52	1.2948	0.0456	1.2948	1.1379
No log	1.0385	54	1.2465	0.1654	1.2465	1.1165
No log	1.0769	56	1.2078	0.1242	1.2078	1.0990
No log	1.1154	58	1.2862	0.1048	1.2862	1.1341
No log	1.1538	60	1.2872	0.1405	1.2872	1.1345
No log	1.1923	62	1.2477	0.1444	1.2477	1.1170
No log	1.2308	64	1.2278	0.1593	1.2278	1.1080
No log	1.2692	66	1.2302	0.1593	1.2302	1.1091
No log	1.3077	68	1.2732	0.1761	1.2732	1.1284
No log	1.3462	70	1.2899	0.1217	1.2899	1.1357
No log	1.3846	72	1.2456	0.1732	1.2456	1.1161
No log	1.4231	74	1.2649	0.2167	1.2649	1.1247
No log	1.4615	76	1.3440	0.1658	1.3440	1.1593
No log	1.5	78	1.2829	0.1203	1.2829	1.1326
No log	1.5385	80	1.2795	0.1119	1.2795	1.1311
No log	1.5769	82	1.2874	0.1509	1.2874	1.1346
No log	1.6154	84	1.3422	0.0768	1.3422	1.1585
No log	1.6538	86	1.3324	0.0768	1.3324	1.1543
No log	1.6923	88	1.2780	0.2167	1.2780	1.1305
No log	1.7308	90	1.2644	0.1863	1.2644	1.1245
No log	1.7692	92	1.2473	0.0583	1.2473	1.1168
No log	1.8077	94	1.2693	0.1675	1.2693	1.1266
No log	1.8462	96	1.2112	0.1546	1.2112	1.1006
No log	1.8846	98	1.2472	0.1448	1.2472	1.1168
No log	1.9231	100	1.4737	0.1143	1.4737	1.2140
No log	1.9615	102	1.3130	0.2151	1.3130	1.1458
No log	2.0	104	1.1015	0.2864	1.1015	1.0495
No log	2.0385	106	1.2298	0.3001	1.2298	1.1090
No log	2.0769	108	1.2461	0.2755	1.2461	1.1163
No log	2.1154	110	1.1210	0.1530	1.1210	1.0588
No log	2.1538	112	1.1705	0.1733	1.1705	1.0819
No log	2.1923	114	1.1684	0.1616	1.1684	1.0809
No log	2.2308	116	1.1827	0.2409	1.1827	1.0875
No log	2.2692	118	1.2853	0.2452	1.2853	1.1337
No log	2.3077	120	1.2500	0.2558	1.2500	1.1180
No log	2.3462	122	1.1566	0.2068	1.1566	1.0755
No log	2.3846	124	1.3141	0.1715	1.3141	1.1463
No log	2.4231	126	1.2929	0.1507	1.2929	1.1371
No log	2.4615	128	1.1466	0.2647	1.1466	1.0708
No log	2.5	130	1.3416	0.1681	1.3416	1.1583
No log	2.5385	132	1.6296	0.2435	1.6296	1.2766
No log	2.5769	134	1.6246	0.2188	1.6246	1.2746
No log	2.6154	136	1.3963	0.1339	1.3963	1.1816
No log	2.6538	138	1.2057	0.2076	1.2057	1.0981
No log	2.6923	140	1.1619	0.2492	1.1619	1.0779
No log	2.7308	142	1.1717	0.3169	1.1717	1.0824
No log	2.7692	144	1.4437	0.1533	1.4437	1.2016
No log	2.8077	146	1.7256	0.2521	1.7256	1.3136
No log	2.8462	148	1.6602	0.2973	1.6602	1.2885
No log	2.8846	150	1.4601	0.2932	1.4601	1.2083
No log	2.9231	152	1.4157	0.2863	1.4157	1.1898
No log	2.9615	154	1.5416	0.3209	1.5416	1.2416
No log	3.0	156	1.3376	0.2840	1.3376	1.1565
No log	3.0385	158	1.3693	0.2863	1.3693	1.1702
No log	3.0769	160	1.4221	0.3024	1.4221	1.1925
No log	3.1154	162	1.4998	0.2883	1.4998	1.2247
No log	3.1538	164	1.3484	0.2798	1.3484	1.1612
No log	3.1923	166	1.3173	0.2481	1.3173	1.1478
No log	3.2308	168	1.3405	0.2663	1.3405	1.1578
No log	3.2692	170	1.5172	0.1886	1.5172	1.2317
No log	3.3077	172	1.4033	0.2275	1.4033	1.1846
No log	3.3462	174	1.3451	0.2542	1.3451	1.1598
No log	3.3846	176	1.4386	0.1977	1.4386	1.1994
No log	3.4231	178	1.5063	0.1807	1.5063	1.2273
No log	3.4615	180	1.5412	0.1806	1.5412	1.2414
No log	3.5	182	1.3458	0.2664	1.3458	1.1601
No log	3.5385	184	1.1531	0.2658	1.1531	1.0738
No log	3.5769	186	1.1507	0.2258	1.1507	1.0727
No log	3.6154	188	1.2614	0.1989	1.2614	1.1231
No log	3.6538	190	1.6884	0.1918	1.6884	1.2994
No log	3.6923	192	1.9247	0.1224	1.9247	1.3873
No log	3.7308	194	1.8218	0.1947	1.8218	1.3498
No log	3.7692	196	1.4733	0.1608	1.4733	1.2138
No log	3.8077	198	1.1857	0.1860	1.1857	1.0889
No log	3.8462	200	1.1609	0.2892	1.1609	1.0774
No log	3.8846	202	1.1548	0.2263	1.1548	1.0746
No log	3.9231	204	1.1534	0.2721	1.1534	1.0740
No log	3.9615	206	1.5388	0.2043	1.5388	1.2405
No log	4.0	208	1.8733	0.1946	1.8733	1.3687
No log	4.0385	210	1.8154	0.2082	1.8154	1.3474
No log	4.0769	212	1.4713	0.2527	1.4713	1.2130
No log	4.1154	214	1.1733	0.3492	1.1733	1.0832
No log	4.1538	216	1.1644	0.3493	1.1644	1.0791
No log	4.1923	218	1.2881	0.1992	1.2881	1.1349
No log	4.2308	220	1.5329	0.2136	1.5329	1.2381
No log	4.2692	222	1.6034	0.1483	1.6034	1.2663
No log	4.3077	224	1.5037	0.2437	1.5037	1.2262
No log	4.3462	226	1.5093	0.1977	1.5093	1.2285
No log	4.3846	228	1.6326	0.1639	1.6326	1.2777
No log	4.4231	230	1.6026	0.1639	1.6026	1.2659
No log	4.4615	232	1.4095	0.2173	1.4095	1.1872
No log	4.5	234	1.3183	0.2452	1.3183	1.1482
No log	4.5385	236	1.3418	0.2574	1.3418	1.1584
No log	4.5769	238	1.3331	0.2818	1.3331	1.1546
No log	4.6154	240	1.3376	0.2466	1.3376	1.1565
No log	4.6538	242	1.4652	0.1851	1.4652	1.2105
No log	4.6923	244	1.7112	0.1095	1.7112	1.3081
No log	4.7308	246	1.7462	0.1116	1.7462	1.3214
No log	4.7692	248	1.6787	0.1209	1.6787	1.2957
No log	4.8077	250	1.4822	0.1224	1.4822	1.2174
No log	4.8462	252	1.3373	0.2041	1.3373	1.1564
No log	4.8846	254	1.3116	0.2417	1.3116	1.1453
No log	4.9231	256	1.3953	0.1663	1.3953	1.1812
No log	4.9615	258	1.5845	0.1618	1.5845	1.2588
No log	5.0	260	1.6577	0.1091	1.6577	1.2875
No log	5.0385	262	1.6513	0.1480	1.6513	1.2850
No log	5.0769	264	1.4704	0.1005	1.4704	1.2126
No log	5.1154	266	1.3218	0.1067	1.3218	1.1497
No log	5.1538	268	1.3370	0.2041	1.3370	1.1563
No log	5.1923	270	1.4304	0.1585	1.4304	1.1960
No log	5.2308	272	1.4890	0.1583	1.4890	1.2202
No log	5.2692	274	1.4856	0.1979	1.4856	1.2189
No log	5.3077	276	1.5056	0.1071	1.5056	1.2270
No log	5.3462	278	1.3682	0.0711	1.3682	1.1697
No log	5.3846	280	1.3021	0.0628	1.3021	1.1411
No log	5.4231	282	1.3384	0.0711	1.3384	1.1569
No log	5.4615	284	1.5269	0.1196	1.5269	1.2357
No log	5.5	286	1.7541	0.1282	1.7541	1.3244
No log	5.5385	288	1.8123	0.1368	1.8123	1.3462
No log	5.5769	290	1.6964	0.2084	1.6964	1.3025
No log	5.6154	292	1.5085	0.1005	1.5085	1.2282
No log	5.6538	294	1.4719	0.1005	1.4719	1.2132
No log	5.6923	296	1.5075	0.1071	1.5075	1.2278
No log	5.7308	298	1.7978	0.1106	1.7978	1.3408
No log	5.7692	300	1.9001	0.0735	1.9001	1.3784
No log	5.8077	302	1.9494	0.0513	1.9494	1.3962
No log	5.8462	304	1.8284	0.0465	1.8284	1.3522
No log	5.8846	306	1.6696	0.1283	1.6696	1.2921
No log	5.9231	308	1.5976	0.2047	1.5976	1.2640
No log	5.9615	310	1.4915	0.2325	1.4915	1.2213
No log	6.0	312	1.4202	0.2032	1.4202	1.1917
No log	6.0385	314	1.5109	0.2424	1.5109	1.2292
No log	6.0769	316	1.4840	0.2604	1.4840	1.2182
No log	6.1154	318	1.3112	0.1935	1.3112	1.1451
No log	6.1538	320	1.2554	0.2041	1.2554	1.1204
No log	6.1923	322	1.3993	0.1842	1.3993	1.1829
No log	6.2308	324	1.6644	0.2393	1.6644	1.2901
No log	6.2692	326	1.8495	0.1686	1.8495	1.3600
No log	6.3077	328	1.8850	0.1720	1.8850	1.3730
No log	6.3462	330	1.9062	0.1596	1.9062	1.3806
No log	6.3846	332	1.8194	0.1713	1.8194	1.3489
No log	6.4231	334	1.5270	0.2359	1.5270	1.2357
No log	6.4615	336	1.3519	0.1005	1.3519	1.1627
No log	6.5	338	1.2798	0.0769	1.2798	1.1313
No log	6.5385	340	1.2689	0.0954	1.2689	1.1265
No log	6.5769	342	1.3455	0.0273	1.3455	1.1599
No log	6.6154	344	1.5571	0.1928	1.5571	1.2478
No log	6.6538	346	1.7370	0.1664	1.7370	1.3180
No log	6.6923	348	1.6985	0.1664	1.6985	1.3033
No log	6.7308	350	1.6354	0.1997	1.6354	1.2788
No log	6.7692	352	1.6372	0.1997	1.6372	1.2795
No log	6.8077	354	1.4911	0.1758	1.4911	1.2211
No log	6.8462	356	1.4227	0.1481	1.4227	1.1928
No log	6.8846	358	1.4623	0.1481	1.4623	1.2093
No log	6.9231	360	1.5699	0.1923	1.5699	1.2530
No log	6.9615	362	1.7801	0.1499	1.7801	1.3342
No log	7.0	364	2.0876	0.1224	2.0876	1.4448
No log	7.0385	366	2.2366	0.0827	2.2366	1.4955
No log	7.0769	368	2.0450	0.1263	2.0450	1.4300
No log	7.1154	370	1.6352	0.1845	1.6352	1.2788
No log	7.1538	372	1.3756	0.1498	1.3756	1.1728
No log	7.1923	374	1.2625	0.1217	1.2625	1.1236
No log	7.2308	376	1.2825	0.1795	1.2825	1.1325
No log	7.2692	378	1.3854	0.1795	1.3854	1.1770
No log	7.3077	380	1.4456	0.1935	1.4456	1.2023
No log	7.3462	382	1.3797	0.2115	1.3797	1.1746
No log	7.3846	384	1.3927	0.2115	1.3927	1.1801
No log	7.4231	386	1.5529	0.2047	1.5529	1.2461
No log	7.4615	388	1.6470	0.2407	1.6470	1.2834
No log	7.5	390	1.5468	0.2659	1.5468	1.2437
No log	7.5385	392	1.4634	0.1842	1.4634	1.2097
No log	7.5769	394	1.3362	0.1944	1.3362	1.1560
No log	7.6154	396	1.3068	0.2097	1.3068	1.1431
No log	7.6538	398	1.3770	0.2263	1.3770	1.1734
No log	7.6923	400	1.4417	0.1618	1.4417	1.2007
No log	7.7308	402	1.4953	0.2181	1.4953	1.2228
No log	7.7692	404	1.6204	0.2542	1.6204	1.2730
No log	7.8077	406	1.7132	0.2022	1.7132	1.3089
No log	7.8462	408	1.7070	0.1988	1.7070	1.3065
No log	7.8846	410	1.6096	0.2658	1.6096	1.2687
No log	7.9231	412	1.4653	0.2337	1.4653	1.2105
No log	7.9615	414	1.3598	0.2032	1.3598	1.1661
No log	8.0	416	1.4026	0.2074	1.4026	1.1843
No log	8.0385	418	1.5226	0.2782	1.5226	1.2339
No log	8.0769	420	1.7260	0.2339	1.7260	1.3138
No log	8.1154	422	1.9219	0.1690	1.9219	1.3863
No log	8.1538	424	1.8682	0.1472	1.8682	1.3668
No log	8.1923	426	1.7702	0.2618	1.7702	1.3305
No log	8.2308	428	1.5660	0.2275	1.5660	1.2514
No log	8.2692	430	1.5059	0.2227	1.5059	1.2271
No log	8.3077	432	1.4272	0.2115	1.4272	1.1947
No log	8.3462	434	1.5055	0.1890	1.5055	1.2270
No log	8.3846	436	1.7244	0.2407	1.7244	1.3132
No log	8.4231	438	1.8865	0.1345	1.8865	1.3735
No log	8.4615	440	1.8201	0.1583	1.8201	1.3491
No log	8.5	442	1.6500	0.1009	1.6500	1.2845
No log	8.5385	444	1.3925	0.0692	1.3925	1.1801
No log	8.5769	446	1.2671	0.1247	1.2671	1.1257
No log	8.6154	448	1.2527	0.1314	1.2527	1.1192
No log	8.6538	450	1.3129	0.0802	1.3129	1.1458
No log	8.6923	452	1.4936	0.1554	1.4936	1.2221
No log	8.7308	454	1.6481	0.1882	1.6481	1.2838
No log	8.7692	456	1.7324	0.2071	1.7324	1.3162
No log	8.8077	458	1.7373	0.2323	1.7373	1.3180
No log	8.8462	460	1.5906	0.2251	1.5906	1.2612
No log	8.8846	462	1.4989	0.2405	1.4989	1.2243
No log	8.9231	464	1.4837	0.1481	1.4837	1.2181
No log	8.9615	466	1.5614	0.2550	1.5614	1.2496
No log	9.0	468	1.6563	0.2644	1.6563	1.2870
No log	9.0385	470	1.6048	0.3123	1.6048	1.2668
No log	9.0769	472	1.6336	0.2542	1.6336	1.2781
No log	9.1154	474	1.6353	0.2521	1.6353	1.2788
No log	9.1538	476	1.5853	0.2658	1.5853	1.2591
No log	9.1923	478	1.6614	0.2915	1.6614	1.2890
No log	9.2308	480	1.7370	0.2310	1.7370	1.3179
No log	9.2692	482	1.6547	0.2782	1.6547	1.2864
No log	9.3077	484	1.5212	0.3045	1.5212	1.2334
No log	9.3462	486	1.4526	0.2578	1.4526	1.2052
No log	9.3846	488	1.3925	0.1891	1.3925	1.1800
No log	9.4231	490	1.4992	0.2782	1.4992	1.2244
No log	9.4615	492	1.8119	0.2756	1.8119	1.3461
No log	9.5	494	1.9341	0.1379	1.9341	1.3907
No log	9.5385	496	1.8050	0.2419	1.8050	1.3435
No log	9.5769	498	1.5218	0.1765	1.5218	1.2336
0.3947	9.6154	500	1.3287	0.2313	1.3287	1.1527
0.3947	9.6538	502	1.2989	0.2313	1.2989	1.1397
0.3947	9.6923	504	1.3683	0.1891	1.3683	1.1698
0.3947	9.7308	506	1.5028	0.1888	1.5028	1.2259
0.3947	9.7692	508	1.5043	0.2457	1.5043	1.2265
0.3947	9.8077	510	1.4110	0.1608	1.4110	1.1879
0.3947	9.8462	512	1.2779	0.0711	1.2779	1.1304
0.3947	9.8846	514	1.2451	0.1379	1.2451	1.1159
0.3947	9.9231	516	1.2873	0.0780	1.2873	1.1346
0.3947	9.9615	518	1.3881	0.1608	1.3881	1.1782

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1