ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k19_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2696
• Qwk: 0.2817
• Mse: 1.2696
• Rmse: 1.1268

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0206	2	4.7852	-0.0075	4.7852	2.1875
No log	0.0412	4	2.9876	-0.0233	2.9876	1.7285
No log	0.0619	6	2.5533	-0.1065	2.5533	1.5979
No log	0.0825	8	1.9557	-0.0017	1.9557	1.3985
No log	0.1031	10	1.3523	-0.0039	1.3523	1.1629
No log	0.1237	12	1.2458	0.0642	1.2458	1.1161
No log	0.1443	14	1.2716	0.0346	1.2716	1.1277
No log	0.1649	16	1.6626	0.0393	1.6626	1.2894
No log	0.1856	18	1.6867	0.0393	1.6867	1.2987
No log	0.2062	20	1.3833	0.1045	1.3833	1.1761
No log	0.2268	22	1.2468	0.2081	1.2468	1.1166
No log	0.2474	24	1.2825	0.1472	1.2825	1.1325
No log	0.2680	26	1.2544	0.1519	1.2544	1.1200
No log	0.2887	28	1.2436	0.1343	1.2436	1.1152
No log	0.3093	30	1.1938	0.1585	1.1938	1.0926
No log	0.3299	32	1.1735	0.1507	1.1735	1.0833
No log	0.3505	34	1.2860	0.1076	1.2860	1.1340
No log	0.3711	36	1.5193	0.0254	1.5193	1.2326
No log	0.3918	38	1.8678	0.0682	1.8678	1.3667
No log	0.4124	40	1.9673	0.0971	1.9673	1.4026
No log	0.4330	42	1.7914	0.0504	1.7914	1.3384
No log	0.4536	44	1.5289	0.0372	1.5289	1.2365
No log	0.4742	46	1.3458	0.0538	1.3458	1.1601
No log	0.4948	48	1.2233	0.2234	1.2233	1.1060
No log	0.5155	50	1.1952	0.1935	1.1952	1.0933
No log	0.5361	52	1.2217	0.1076	1.2217	1.1053
No log	0.5567	54	1.2286	-0.0043	1.2286	1.1084
No log	0.5773	56	1.2506	0.2155	1.2506	1.1183
No log	0.5979	58	1.3452	0.1045	1.3452	1.1598
No log	0.6186	60	1.3291	0.1200	1.3291	1.1529
No log	0.6392	62	1.2764	0.2333	1.2764	1.1298
No log	0.6598	64	1.1962	0.2726	1.1962	1.0937
No log	0.6804	66	1.1506	0.2898	1.1506	1.0727
No log	0.7010	68	1.2192	0.2534	1.2192	1.1042
No log	0.7216	70	1.3752	0.2240	1.3752	1.1727
No log	0.7423	72	1.3593	0.1972	1.3593	1.1659
No log	0.7629	74	1.1388	0.3213	1.1388	1.0671
No log	0.7835	76	1.0196	0.3940	1.0196	1.0098
No log	0.8041	78	1.2185	0.3458	1.2185	1.1039
No log	0.8247	80	1.3243	0.3834	1.3243	1.1508
No log	0.8454	82	1.1173	0.3620	1.1173	1.0570
No log	0.8660	84	0.9769	0.3914	0.9769	0.9884
No log	0.8866	86	1.0192	0.3996	1.0192	1.0096
No log	0.9072	88	1.1162	0.2690	1.1162	1.0565
No log	0.9278	90	1.0422	0.4557	1.0422	1.0209
No log	0.9485	92	1.0303	0.2006	1.0303	1.0150
No log	0.9691	94	1.1500	0.2457	1.1500	1.0724
No log	0.9897	96	1.1120	0.2721	1.1120	1.0545
No log	1.0103	98	0.9826	0.3300	0.9826	0.9913
No log	1.0309	100	1.0146	0.4197	1.0146	1.0073
No log	1.0515	102	1.0073	0.4527	1.0073	1.0036
No log	1.0722	104	1.0128	0.4181	1.0128	1.0064
No log	1.0928	106	1.1143	0.3898	1.1143	1.0556
No log	1.1134	108	1.3219	0.4357	1.3219	1.1497
No log	1.1340	110	1.4322	0.4158	1.4322	1.1968
No log	1.1546	112	1.3003	0.3817	1.3003	1.1403
No log	1.1753	114	1.0391	0.3565	1.0391	1.0194
No log	1.1959	116	1.1342	0.1999	1.1342	1.0650
No log	1.2165	118	1.1259	0.2342	1.1259	1.0611
No log	1.2371	120	1.0430	0.3160	1.0430	1.0213
No log	1.2577	122	1.0571	0.2929	1.0571	1.0281
No log	1.2784	124	1.0380	0.3663	1.0380	1.0188
No log	1.2990	126	1.0350	0.3160	1.0350	1.0174
No log	1.3196	128	1.2539	0.3436	1.2539	1.1198
No log	1.3402	130	1.5995	0.3471	1.5995	1.2647
No log	1.3608	132	1.4499	0.3426	1.4499	1.2041
No log	1.3814	134	1.1021	0.3111	1.1021	1.0498
No log	1.4021	136	1.0499	0.2871	1.0499	1.0247
No log	1.4227	138	1.0616	0.2723	1.0616	1.0303
No log	1.4433	140	1.1506	0.3022	1.1506	1.0726
No log	1.4639	142	1.1625	0.3043	1.1625	1.0782
No log	1.4845	144	1.1543	0.3390	1.1543	1.0744
No log	1.5052	146	1.1141	0.3268	1.1141	1.0555
No log	1.5258	148	1.1163	0.3979	1.1163	1.0565
No log	1.5464	150	1.2771	0.3605	1.2771	1.1301
No log	1.5670	152	1.2344	0.2840	1.2344	1.1110
No log	1.5876	154	1.0615	0.3451	1.0615	1.0303
No log	1.6082	156	1.0472	0.2714	1.0472	1.0233
No log	1.6289	158	1.0508	0.2211	1.0508	1.0251
No log	1.6495	160	1.0509	0.3091	1.0509	1.0251
No log	1.6701	162	1.1462	0.2934	1.1462	1.0706
No log	1.6907	164	1.1571	0.2934	1.1571	1.0757
No log	1.7113	166	1.2790	0.3513	1.2790	1.1310
No log	1.7320	168	1.3585	0.3392	1.3585	1.1656
No log	1.7526	170	1.2736	0.3243	1.2736	1.1285
No log	1.7732	172	1.1035	0.1712	1.1035	1.0505
No log	1.7938	174	1.0721	0.2592	1.0721	1.0354
No log	1.8144	176	1.0731	0.2704	1.0731	1.0359
No log	1.8351	178	1.2036	0.3178	1.2036	1.0971
No log	1.8557	180	1.4924	0.3269	1.4924	1.2216
No log	1.8763	182	1.5243	0.3283	1.5243	1.2346
No log	1.8969	184	1.2865	0.2899	1.2865	1.1342
No log	1.9175	186	1.0829	0.3211	1.0829	1.0406
No log	1.9381	188	1.0698	0.3363	1.0698	1.0343
No log	1.9588	190	1.0693	0.3560	1.0693	1.0341
No log	1.9794	192	1.1962	0.2958	1.1962	1.0937
No log	2.0	194	1.4815	0.3254	1.4815	1.2172
No log	2.0206	196	1.4977	0.3254	1.4977	1.2238
No log	2.0412	198	1.3389	0.3293	1.3389	1.1571
No log	2.0619	200	1.1345	0.2909	1.1345	1.0651
No log	2.0825	202	1.0461	0.2857	1.0461	1.0228
No log	2.1031	204	1.0027	0.3094	1.0027	1.0013
No log	2.1237	206	1.0179	0.3094	1.0179	1.0089
No log	2.1443	208	1.0224	0.3094	1.0224	1.0112
No log	2.1649	210	1.0979	0.2810	1.0979	1.0478
No log	2.1856	212	1.2041	0.2313	1.2041	1.0973
No log	2.2062	214	1.1419	0.2143	1.1419	1.0686
No log	2.2268	216	1.0799	0.1761	1.0799	1.0392
No log	2.2474	218	1.1253	0.1853	1.1253	1.0608
No log	2.2680	220	1.1151	0.2056	1.1151	1.0560
No log	2.2887	222	1.0673	0.3169	1.0673	1.0331
No log	2.3093	224	1.1099	0.2326	1.1099	1.0535
No log	2.3299	226	1.1632	0.2542	1.1632	1.0785
No log	2.3505	228	1.1814	0.2725	1.1814	1.0869
No log	2.3711	230	1.1260	0.2417	1.1260	1.0611
No log	2.3918	232	1.0977	0.2343	1.0977	1.0477
No log	2.4124	234	1.0584	0.1968	1.0584	1.0288
No log	2.4330	236	1.0009	0.2970	1.0009	1.0004
No log	2.4536	238	1.0242	0.3449	1.0242	1.0120
No log	2.4742	240	1.1727	0.2485	1.1727	1.0829
No log	2.4948	242	1.3489	0.4014	1.3489	1.1614
No log	2.5155	244	1.3532	0.3811	1.3532	1.1633
No log	2.5361	246	1.1854	0.3071	1.1854	1.0888
No log	2.5567	248	1.0581	0.2899	1.0581	1.0286
No log	2.5773	250	1.1059	0.2000	1.1059	1.0516
No log	2.5979	252	1.1605	0.2195	1.1605	1.0773
No log	2.6186	254	1.1678	0.2586	1.1678	1.0806
No log	2.6392	256	1.0531	0.2772	1.0531	1.0262
No log	2.6598	258	1.0157	0.3069	1.0157	1.0078
No log	2.6804	260	1.1348	0.3178	1.1348	1.0653
No log	2.7010	262	1.3718	0.4005	1.3718	1.1712
No log	2.7216	264	1.3315	0.3798	1.3315	1.1539
No log	2.7423	266	1.1705	0.3093	1.1705	1.0819
No log	2.7629	268	1.0236	0.2432	1.0236	1.0117
No log	2.7835	270	0.9950	0.2792	0.9950	0.9975
No log	2.8041	272	1.0204	0.2009	1.0204	1.0102
No log	2.8247	274	1.1066	0.3357	1.1066	1.0520
No log	2.8454	276	1.1740	0.3697	1.1740	1.0835
No log	2.8660	278	1.1704	0.3814	1.1704	1.0819
No log	2.8866	280	1.0815	0.3567	1.0815	1.0399
No log	2.9072	282	1.0072	0.2060	1.0072	1.0036
No log	2.9278	284	0.9914	0.3206	0.9914	0.9957
No log	2.9485	286	1.0291	0.2844	1.0291	1.0144
No log	2.9691	288	1.1650	0.3833	1.1650	1.0794
No log	2.9897	290	1.4145	0.3667	1.4145	1.1893
No log	3.0103	292	1.4149	0.3667	1.4149	1.1895
No log	3.0309	294	1.1891	0.3715	1.1891	1.0905
No log	3.0515	296	1.0173	0.3530	1.0173	1.0086
No log	3.0722	298	1.0192	0.3263	1.0192	1.0095
No log	3.0928	300	1.1149	0.2664	1.1149	1.0559
No log	3.1134	302	1.1887	0.2647	1.1887	1.0903
No log	3.1340	304	1.1239	0.2799	1.1239	1.0601
No log	3.1546	306	0.9932	0.2947	0.9932	0.9966
No log	3.1753	308	0.9655	0.3217	0.9655	0.9826
No log	3.1959	310	1.0158	0.2998	1.0158	1.0079
No log	3.2165	312	1.1071	0.2195	1.1071	1.0522
No log	3.2371	314	1.0943	0.1579	1.0943	1.0461
No log	3.2577	316	1.0325	0.1482	1.0325	1.0161
No log	3.2784	318	1.0616	0.1801	1.0616	1.0303
No log	3.2990	320	1.1279	0.2195	1.1279	1.0620
No log	3.3196	322	1.1653	0.2195	1.1653	1.0795
No log	3.3402	324	1.2047	0.1991	1.2047	1.0976
No log	3.3608	326	1.2480	0.2317	1.2480	1.1171
No log	3.3814	328	1.1557	0.2460	1.1557	1.0750
No log	3.4021	330	1.0772	0.2304	1.0772	1.0379
No log	3.4227	332	1.0653	0.2019	1.0653	1.0322
No log	3.4433	334	1.1152	0.1952	1.1152	1.0560
No log	3.4639	336	1.2516	0.2278	1.2516	1.1187
No log	3.4845	338	1.3958	0.2586	1.3958	1.1815
No log	3.5052	340	1.4416	0.1751	1.4416	1.2007
No log	3.5258	342	1.3029	0.2586	1.3029	1.1415
No log	3.5464	344	1.1397	0.2782	1.1397	1.0676
No log	3.5670	346	1.1038	0.3069	1.1038	1.0506
No log	3.5876	348	1.1312	0.2810	1.1312	1.0636
No log	3.6082	350	1.1924	0.2494	1.1924	1.0920
No log	3.6289	352	1.1982	0.2494	1.1982	1.0946
No log	3.6495	354	1.2154	0.2586	1.2154	1.1025
No log	3.6701	356	1.1452	0.2714	1.1452	1.0701
No log	3.6907	358	1.0536	0.2782	1.0536	1.0264
No log	3.7113	360	1.0174	0.3308	1.0174	1.0087
No log	3.7320	362	1.0590	0.3141	1.0590	1.0291
No log	3.7526	364	1.0923	0.3023	1.0923	1.0451
No log	3.7732	366	1.1325	0.2602	1.1325	1.0642
No log	3.7938	368	1.0879	0.2304	1.0879	1.0430
No log	3.8144	370	1.0171	0.2019	1.0171	1.0085
No log	3.8351	372	1.0149	0.2019	1.0149	1.0074
No log	3.8557	374	1.0349	0.2019	1.0349	1.0173
No log	3.8763	376	1.0715	0.2650	1.0715	1.0351
No log	3.8969	378	1.2712	0.3926	1.2712	1.1275
No log	3.9175	380	1.4252	0.3841	1.4252	1.1938
No log	3.9381	382	1.3646	0.4008	1.3646	1.1682
No log	3.9588	384	1.1849	0.2914	1.1849	1.0885
No log	3.9794	386	1.1263	0.2381	1.1263	1.0613
No log	4.0	388	1.0898	0.2490	1.0898	1.0439
No log	4.0206	390	1.0332	0.2219	1.0332	1.0165
No log	4.0412	392	1.0347	0.2899	1.0347	1.0172
No log	4.0619	394	1.1252	0.2884	1.1252	1.0607
No log	4.0825	396	1.2833	0.3922	1.2833	1.1328
No log	4.1031	398	1.4339	0.3659	1.4339	1.1975
No log	4.1237	400	1.5862	0.3297	1.5862	1.2594
No log	4.1443	402	1.5843	0.2782	1.5843	1.2587
No log	4.1649	404	1.4306	0.2929	1.4306	1.1961
No log	4.1856	406	1.1728	0.2980	1.1728	1.0830
No log	4.2062	408	1.0354	0.2119	1.0354	1.0175
No log	4.2268	410	1.0194	0.1667	1.0194	1.0097
No log	4.2474	412	1.0468	0.1969	1.0468	1.0231
No log	4.2680	414	1.1014	0.1701	1.1014	1.0495
No log	4.2887	416	1.2131	0.1692	1.2131	1.1014
No log	4.3093	418	1.2930	0.2817	1.2930	1.1371
No log	4.3299	420	1.2509	0.2519	1.2509	1.1184
No log	4.3505	422	1.2090	0.1903	1.2090	1.0996
No log	4.3711	424	1.2298	0.1750	1.2298	1.1090
No log	4.3918	426	1.3032	0.2519	1.3032	1.1416
No log	4.4124	428	1.3275	0.3316	1.3275	1.1522
No log	4.4330	430	1.3573	0.3316	1.3573	1.1650
No log	4.4536	432	1.3297	0.1991	1.3297	1.1531
No log	4.4742	434	1.2300	0.1282	1.2300	1.1091
No log	4.4948	436	1.1774	0.1214	1.1774	1.0851
No log	4.5155	438	1.0952	0.1343	1.0952	1.0465
No log	4.5361	440	1.0776	0.1919	1.0776	1.0381
No log	4.5567	442	1.0719	0.2331	1.0719	1.0353
No log	4.5773	444	1.1134	0.1712	1.1134	1.0552
No log	4.5979	446	1.2694	0.3316	1.2694	1.1267
No log	4.6186	448	1.3980	0.3574	1.3980	1.1824
No log	4.6392	450	1.4583	0.2929	1.4583	1.2076
No log	4.6598	452	1.3399	0.3562	1.3399	1.1575
No log	4.6804	454	1.1542	0.3158	1.1542	1.0743
No log	4.7010	456	1.0048	0.2801	1.0048	1.0024
No log	4.7216	458	0.9472	0.3263	0.9472	0.9733
No log	4.7423	460	0.9407	0.3652	0.9407	0.9699
No log	4.7629	462	0.9658	0.3602	0.9658	0.9828
No log	4.7835	464	1.0477	0.25	1.0477	1.0236
No log	4.8041	466	1.1839	0.3332	1.1839	1.0881
No log	4.8247	468	1.2819	0.3205	1.2819	1.1322
No log	4.8454	470	1.2963	0.3205	1.2963	1.1386
No log	4.8660	472	1.1819	0.3261	1.1819	1.0871
No log	4.8866	474	1.0795	0.3349	1.0795	1.0390
No log	4.9072	476	1.1014	0.3438	1.1014	1.0495
No log	4.9278	478	1.1918	0.3093	1.1918	1.0917
No log	4.9485	480	1.3608	0.3205	1.3608	1.1665
No log	4.9691	482	1.3687	0.3205	1.3687	1.1699
No log	4.9897	484	1.2853	0.3093	1.2853	1.1337
No log	5.0103	486	1.1545	0.3071	1.1545	1.0745
No log	5.0309	488	1.1350	0.2790	1.1350	1.0654
No log	5.0515	490	1.1156	0.2278	1.1156	1.0562
No log	5.0722	492	1.1649	0.2790	1.1649	1.0793
No log	5.0928	494	1.2677	0.3071	1.2677	1.1259
No log	5.1134	496	1.3530	0.2736	1.3530	1.1632
No log	5.1340	498	1.3351	0.2736	1.3351	1.1555
0.3806	5.1546	500	1.2252	0.3071	1.2252	1.1069
0.3806	5.1753	502	1.1011	0.2184	1.1011	1.0493
0.3806	5.1959	504	1.0352	0.2733	1.0352	1.0175
0.3806	5.2165	506	1.0370	0.1860	1.0370	1.0183
0.3806	5.2371	508	1.1391	0.2278	1.1391	1.0673
0.3806	5.2577	510	1.2696	0.2817	1.2696	1.1268

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1