ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k7_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4450
• Qwk: 0.0948
• Mse: 1.4450
• Rmse: 1.2021

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0571	2	4.6376	0.0010	4.6376	2.1535
No log	0.1143	4	2.9245	-0.0375	2.9245	1.7101
No log	0.1714	6	2.2601	-0.0298	2.2601	1.5034
No log	0.2286	8	1.8485	-0.0303	1.8485	1.3596
No log	0.2857	10	2.4049	-0.0108	2.4049	1.5508
No log	0.3429	12	2.2440	-0.0667	2.2440	1.4980
No log	0.4	14	1.4717	0.0269	1.4717	1.2131
No log	0.4571	16	1.2356	0.0841	1.2356	1.1116
No log	0.5143	18	1.2448	0.0228	1.2448	1.1157
No log	0.5714	20	1.3783	0.0682	1.3783	1.1740
No log	0.6286	22	1.8329	-0.1816	1.8329	1.3538
No log	0.6857	24	1.8440	-0.1542	1.8440	1.3580
No log	0.7429	26	1.6676	-0.1940	1.6676	1.2913
No log	0.8	28	1.5878	-0.1940	1.5878	1.2601
No log	0.8571	30	1.5651	-0.1298	1.5651	1.2511
No log	0.9143	32	1.5889	-0.1148	1.5889	1.2605
No log	0.9714	34	1.6827	-0.0522	1.6827	1.2972
No log	1.0286	36	1.5719	-0.0674	1.5719	1.2538
No log	1.0857	38	1.3560	0.0050	1.3560	1.1645
No log	1.1429	40	1.2051	0.0711	1.2051	1.0978
No log	1.2	42	1.2394	0.1043	1.2394	1.1133
No log	1.2571	44	1.2698	0.1043	1.2698	1.1269
No log	1.3143	46	1.2393	0.1076	1.2393	1.1133
No log	1.3714	48	1.2808	0.1173	1.2808	1.1317
No log	1.4286	50	1.3901	0.0319	1.3901	1.1790
No log	1.4857	52	1.4749	-0.1148	1.4749	1.2145
No log	1.5429	54	1.5481	0.0018	1.5481	1.2442
No log	1.6	56	1.4894	-0.0195	1.4894	1.2204
No log	1.6571	58	1.2779	0.2124	1.2779	1.1304
No log	1.7143	60	1.2129	0.1693	1.2129	1.1013
No log	1.7714	62	1.2557	0.1632	1.2557	1.1206
No log	1.8286	64	1.3697	0.0654	1.3697	1.1704
No log	1.8857	66	1.5698	-0.0177	1.5698	1.2529
No log	1.9429	68	1.4582	0.0420	1.4582	1.2075
No log	2.0	70	1.2790	0.0394	1.2790	1.1309
No log	2.0571	72	1.3204	0.0394	1.3204	1.1491
No log	2.1143	74	1.3905	0.0385	1.3905	1.1792
No log	2.1714	76	1.4503	0.0769	1.4503	1.2043
No log	2.2286	78	1.5809	-0.0247	1.5809	1.2573
No log	2.2857	80	1.4201	0.0769	1.4201	1.1917
No log	2.3429	82	1.2349	0.1212	1.2349	1.1113
No log	2.4	84	1.4155	0.0082	1.4155	1.1897
No log	2.4571	86	1.6188	-0.0511	1.6188	1.2723
No log	2.5143	88	1.5238	0.0442	1.5238	1.2344
No log	2.5714	90	1.2169	0.2617	1.2169	1.1031
No log	2.6286	92	1.0776	0.3217	1.0776	1.0381
No log	2.6857	94	1.1762	0.2570	1.1762	1.0845
No log	2.7429	96	1.4434	0.0870	1.4434	1.2014
No log	2.8	98	1.6512	-0.1358	1.6512	1.2850
No log	2.8571	100	1.5359	-0.0144	1.5359	1.2393
No log	2.9143	102	1.3384	0.1183	1.3384	1.1569
No log	2.9714	104	1.2577	0.1281	1.2577	1.1215
No log	3.0286	106	1.3411	0.1081	1.3411	1.1580
No log	3.0857	108	1.4891	0.1011	1.4891	1.2203
No log	3.1429	110	1.7644	-0.2506	1.7644	1.3283
No log	3.2	112	1.7519	-0.2506	1.7519	1.3236
No log	3.2571	114	1.6530	-0.1073	1.6530	1.2857
No log	3.3143	116	1.4757	0.0885	1.4757	1.2148
No log	3.3714	118	1.6358	0.1171	1.6358	1.2790
No log	3.4286	120	1.8074	0.0992	1.8074	1.3444
No log	3.4857	122	1.7159	0.1124	1.7159	1.3099
No log	3.5429	124	1.5503	0.0500	1.5503	1.2451
No log	3.6	126	1.5772	-0.0654	1.5772	1.2558
No log	3.6571	128	1.7785	-0.1940	1.7785	1.3336
No log	3.7143	130	1.7326	-0.1940	1.7326	1.3163
No log	3.7714	132	1.5882	-0.0479	1.5882	1.2602
No log	3.8286	134	1.5722	0.0437	1.5722	1.2539
No log	3.8857	136	1.5929	0.0156	1.5929	1.2621
No log	3.9429	138	1.5761	0.0589	1.5761	1.2554
No log	4.0	140	1.4988	0.0433	1.4988	1.2242
No log	4.0571	142	1.5410	0.0914	1.5410	1.2414
No log	4.1143	144	1.6220	0.0564	1.6220	1.2736
No log	4.1714	146	1.6738	0.0272	1.6738	1.2937
No log	4.2286	148	1.6432	0.0117	1.6432	1.2819
No log	4.2857	150	1.5751	-0.0010	1.5751	1.2550
No log	4.3429	152	1.4892	-0.0011	1.4892	1.2203
No log	4.4	154	1.3996	0.0880	1.3996	1.1830
No log	4.4571	156	1.5210	0.0273	1.5210	1.2333
No log	4.5143	158	1.6469	0.0586	1.6469	1.2833
No log	4.5714	160	1.5807	0.0426	1.5807	1.2573
No log	4.6286	162	1.5855	0.0541	1.5855	1.2592
No log	4.6857	164	1.7383	-0.0773	1.7383	1.3184
No log	4.7429	166	1.7572	-0.0963	1.7572	1.3256
No log	4.8	168	1.6425	0.1002	1.6425	1.2816
No log	4.8571	170	1.5237	0.0892	1.5237	1.2344
No log	4.9143	172	1.4677	0.1311	1.4677	1.2115
No log	4.9714	174	1.5264	0.0705	1.5264	1.2355
No log	5.0286	176	1.5699	0.0295	1.5699	1.2530
No log	5.0857	178	1.6011	0.0488	1.6011	1.2653
No log	5.1429	180	1.6018	0.1166	1.6018	1.2656
No log	5.2	182	1.5032	0.0626	1.5032	1.2260
No log	5.2571	184	1.3914	0.0818	1.3914	1.1796
No log	5.3143	186	1.3913	0.0721	1.3913	1.1795
No log	5.3714	188	1.4507	0.0474	1.4507	1.2045
No log	5.4286	190	1.6216	0.0858	1.6216	1.2734
No log	5.4857	192	1.7844	0.0342	1.7844	1.3358
No log	5.5429	194	1.7214	0.0410	1.7214	1.3120
No log	5.6	196	1.5732	0.0164	1.5732	1.2543
No log	5.6571	198	1.4853	-0.0175	1.4853	1.2187
No log	5.7143	200	1.4716	-0.1046	1.4716	1.2131
No log	5.7714	202	1.5503	-0.0235	1.5503	1.2451
No log	5.8286	204	1.7184	-0.1523	1.7184	1.3109
No log	5.8857	206	1.6905	-0.0671	1.6905	1.3002
No log	5.9429	208	1.6500	0.0049	1.6500	1.2845
No log	6.0	210	1.7005	-0.0132	1.7005	1.3040
No log	6.0571	212	1.6448	0.0428	1.6448	1.2825
No log	6.1143	214	1.5706	0.0500	1.5706	1.2533
No log	6.1714	216	1.4186	0.0851	1.4186	1.1911
No log	6.2286	218	1.4183	0.1405	1.4183	1.1909
No log	6.2857	220	1.4663	0.1405	1.4663	1.2109
No log	6.3429	222	1.6121	0.0907	1.6121	1.2697
No log	6.4	224	1.6170	0.0	1.6170	1.2716
No log	6.4571	226	1.5562	0.0827	1.5562	1.2475
No log	6.5143	228	1.4560	0.1279	1.4560	1.2066
No log	6.5714	230	1.3108	0.0849	1.3108	1.1449
No log	6.6286	232	1.2893	0.1048	1.2893	1.1355
No log	6.6857	234	1.3553	0.1048	1.3553	1.1642
No log	6.7429	236	1.4759	0.0923	1.4759	1.2149
No log	6.8	238	1.6092	0.0159	1.6092	1.2685
No log	6.8571	240	1.6829	-0.0293	1.6829	1.2972
No log	6.9143	242	1.6780	-0.0107	1.6780	1.2954
No log	6.9714	244	1.6574	0.0263	1.6574	1.2874
No log	7.0286	246	1.5970	-0.0368	1.5970	1.2637
No log	7.0857	248	1.5673	0.0090	1.5673	1.2519
No log	7.1429	250	1.5399	0.0239	1.5399	1.2409
No log	7.2	252	1.5460	0.0380	1.5460	1.2434
No log	7.2571	254	1.6589	0.0153	1.6589	1.2880
No log	7.3143	256	1.6679	0.0061	1.6679	1.2915
No log	7.3714	258	1.5781	0.0310	1.5781	1.2562
No log	7.4286	260	1.4615	0.0095	1.4615	1.2089
No log	7.4857	262	1.4272	0.0880	1.4272	1.1946
No log	7.5429	264	1.4190	0.0880	1.4190	1.1912
No log	7.6	266	1.4771	0.0430	1.4771	1.2154
No log	7.6571	268	1.5180	0.0430	1.5180	1.2321
No log	7.7143	270	1.5961	0.0256	1.5961	1.2634
No log	7.7714	272	1.6532	-0.0069	1.6532	1.2858
No log	7.8286	274	1.6100	0.0347	1.6100	1.2689
No log	7.8857	276	1.5601	-0.0138	1.5601	1.2490
No log	7.9429	278	1.6198	0.1031	1.6198	1.2727
No log	8.0	280	1.6928	0.1091	1.6928	1.3011
No log	8.0571	282	1.7188	0.1364	1.7188	1.3110
No log	8.1143	284	1.7594	0.0555	1.7594	1.3264
No log	8.1714	286	1.8697	0.1126	1.8697	1.3674
No log	8.2286	288	1.8629	0.1126	1.8629	1.3649
No log	8.2857	290	1.7010	0.0633	1.7010	1.3042
No log	8.3429	292	1.5337	0.1031	1.5337	1.2384
No log	8.4	294	1.3940	0.1126	1.3940	1.1807
No log	8.4571	296	1.3318	0.1316	1.3318	1.1540
No log	8.5143	298	1.3886	0.0442	1.3886	1.1784
No log	8.5714	300	1.4383	0.0444	1.4383	1.1993
No log	8.6286	302	1.4938	0.0778	1.4938	1.2222
No log	8.6857	304	1.4975	0.0685	1.4975	1.2237
No log	8.7429	306	1.5425	0.0678	1.5425	1.2420
No log	8.8	308	1.5364	0.1131	1.5364	1.2395
No log	8.8571	310	1.5637	0.0228	1.5637	1.2505
No log	8.9143	312	1.6048	0.0732	1.6048	1.2668
No log	8.9714	314	1.5924	0.0142	1.5924	1.2619
No log	9.0286	316	1.5325	0.0194	1.5325	1.2379
No log	9.0857	318	1.4799	0.0194	1.4799	1.2165
No log	9.1429	320	1.4321	0.0500	1.4321	1.1967
No log	9.2	322	1.4963	0.125	1.4963	1.2233
No log	9.2571	324	1.6358	0.1535	1.6358	1.2790
No log	9.3143	326	1.7455	0.0275	1.7455	1.3212
No log	9.3714	328	1.6410	0.1202	1.6410	1.2810
No log	9.4286	330	1.3990	0.1005	1.3990	1.1828
No log	9.4857	332	1.2421	0.1952	1.2421	1.1145
No log	9.5429	334	1.2363	0.2108	1.2363	1.1119
No log	9.6	336	1.3062	0.1180	1.3062	1.1429
No log	9.6571	338	1.4178	0.0529	1.4178	1.1907
No log	9.7143	340	1.4737	0.0500	1.4737	1.2139
No log	9.7714	342	1.5080	0.1405	1.5080	1.2280
No log	9.8286	344	1.6570	0.1340	1.6570	1.2873
No log	9.8857	346	1.6868	0.1091	1.6868	1.2988
No log	9.9429	348	1.5885	0.1461	1.5885	1.2604
No log	10.0	350	1.4691	0.0596	1.4691	1.2120
No log	10.0571	352	1.4092	0.0849	1.4092	1.1871
No log	10.1143	354	1.3936	0.1048	1.3936	1.1805
No log	10.1714	356	1.4878	0.1188	1.4878	1.2198
No log	10.2286	358	1.5501	0.0778	1.5501	1.2450
No log	10.2857	360	1.5653	0.1554	1.5653	1.2511
No log	10.3429	362	1.5445	0.1943	1.5445	1.2428
No log	10.4	364	1.5144	0.1850	1.5144	1.2306
No log	10.4571	366	1.5110	0.0596	1.5110	1.2292
No log	10.5143	368	1.5566	0.0731	1.5566	1.2476
No log	10.5714	370	1.6060	0.0568	1.6060	1.2673
No log	10.6286	372	1.5948	0.0500	1.5948	1.2629
No log	10.6857	374	1.6155	0.1557	1.6155	1.2710
No log	10.7429	376	1.7538	-0.0229	1.7538	1.3243
No log	10.8	378	1.7977	-0.0363	1.7977	1.3408
No log	10.8571	380	1.7204	-0.0088	1.7204	1.3116
No log	10.9143	382	1.6035	0.0405	1.6035	1.2663
No log	10.9714	384	1.6275	-0.0968	1.6275	1.2757
No log	11.0286	386	1.6448	-0.0891	1.6448	1.2825
No log	11.0857	388	1.5851	-0.0703	1.5851	1.2590
No log	11.1429	390	1.5477	0.0405	1.5477	1.2441
No log	11.2	392	1.6377	0.1098	1.6377	1.2797
No log	11.2571	394	1.6304	0.0513	1.6304	1.2769
No log	11.3143	396	1.5640	0.0500	1.5640	1.2506
No log	11.3714	398	1.5058	0.0636	1.5058	1.2271
No log	11.4286	400	1.4679	0.0983	1.4679	1.2116
No log	11.4857	402	1.4358	0.0983	1.4358	1.1983
No log	11.5429	404	1.4137	0.0930	1.4137	1.1890
No log	11.6	406	1.4774	0.0695	1.4774	1.2155
No log	11.6571	408	1.4859	0.0365	1.4859	1.2190
No log	11.7143	410	1.4634	0.0365	1.4634	1.2097
No log	11.7714	412	1.4962	0.0685	1.4962	1.2232
No log	11.8286	414	1.4720	0.1094	1.4720	1.2133
No log	11.8857	416	1.4232	0.125	1.4232	1.1930
No log	11.9429	418	1.4117	0.1696	1.4117	1.1882
No log	12.0	420	1.4415	0.0365	1.4415	1.2006
No log	12.0571	422	1.5281	0.1011	1.5281	1.2362
No log	12.1143	424	1.5341	0.1138	1.5341	1.2386
No log	12.1714	426	1.5142	0.1005	1.5142	1.2305
No log	12.2286	428	1.5248	0.1557	1.5248	1.2348
No log	12.2857	430	1.5671	0.0827	1.5671	1.2518
No log	12.3429	432	1.5903	0.0516	1.5903	1.2611
No log	12.4	434	1.5745	0.0194	1.5745	1.2548
No log	12.4571	436	1.5450	0.0500	1.5450	1.2430
No log	12.5143	438	1.5462	0.0930	1.5462	1.2435
No log	12.5714	440	1.5702	0.0920	1.5702	1.2531
No log	12.6286	442	1.5859	0.0920	1.5859	1.2593
No log	12.6857	444	1.6117	0.0436	1.6117	1.2695
No log	12.7429	446	1.6181	0.0326	1.6181	1.2720
No log	12.8	448	1.6392	-0.0673	1.6392	1.2803
No log	12.8571	450	1.6401	-0.1261	1.6401	1.2806
No log	12.9143	452	1.5921	0.0052	1.5921	1.2618
No log	12.9714	454	1.5471	0.1159	1.5471	1.2438
No log	13.0286	456	1.4712	0.1692	1.4712	1.2129
No log	13.0857	458	1.4417	0.1536	1.4417	1.2007
No log	13.1429	460	1.4443	0.1692	1.4443	1.2018
No log	13.2	462	1.4728	0.1159	1.4728	1.2136
No log	13.2571	464	1.4417	0.1159	1.4417	1.2007
No log	13.3143	466	1.3904	0.1281	1.3904	1.1792
No log	13.3714	468	1.3968	0.1159	1.3968	1.1819
No log	13.4286	470	1.4331	0.1159	1.4331	1.1971
No log	13.4857	472	1.4640	0.1404	1.4640	1.2099
No log	13.5429	474	1.4063	0.1005	1.4063	1.1859
No log	13.6	476	1.3555	0.1379	1.3555	1.1643
No log	13.6571	478	1.3709	0.1015	1.3709	1.1709
No log	13.7143	480	1.4036	0.1015	1.4036	1.1847
No log	13.7714	482	1.4534	0.0835	1.4534	1.2056
No log	13.8286	484	1.5186	0.0822	1.5186	1.2323
No log	13.8857	486	1.5103	0.0914	1.5103	1.2289
No log	13.9429	488	1.4268	0.1000	1.4268	1.1945
No log	14.0	490	1.3686	0.1599	1.3686	1.1699
No log	14.0571	492	1.3742	0.1344	1.3742	1.1723
No log	14.1143	494	1.3966	0.1344	1.3966	1.1818
No log	14.1714	496	1.4439	0.1463	1.4439	1.2016
No log	14.2286	498	1.5552	0.1282	1.5552	1.2471
0.3523	14.2857	500	1.6142	0.1282	1.6142	1.2705
0.3523	14.3429	502	1.5776	0.1282	1.5776	1.2560
0.3523	14.4	504	1.4679	0.1557	1.4679	1.2116
0.3523	14.4571	506	1.3817	0.1696	1.3817	1.1755
0.3523	14.5143	508	1.3387	0.0584	1.3387	1.1570
0.3523	14.5714	510	1.3296	0.0751	1.3296	1.1531
0.3523	14.6286	512	1.3550	0.2000	1.3550	1.1640
0.3523	14.6857	514	1.4385	0.1404	1.4385	1.1994
0.3523	14.7429	516	1.5429	0.1461	1.5429	1.2421
0.3523	14.8	518	1.6143	0.1283	1.6143	1.2706
0.3523	14.8571	520	1.5556	0.1371	1.5556	1.2472
0.3523	14.9143	522	1.4682	0.1156	1.4682	1.2117
0.3523	14.9714	524	1.4413	0.0885	1.4413	1.2005
0.3523	15.0286	526	1.4194	0.0885	1.4194	1.1914
0.3523	15.0857	528	1.4172	0.0653	1.4172	1.1905
0.3523	15.1429	530	1.4721	0.1557	1.4721	1.2133
0.3523	15.2	532	1.5343	0.1462	1.5343	1.2387
0.3523	15.2571	534	1.5083	0.1159	1.5083	1.2281
0.3523	15.3143	536	1.4827	0.1557	1.4827	1.2177
0.3523	15.3714	538	1.4375	0.0584	1.4375	1.1989
0.3523	15.4286	540	1.4290	0.0948	1.4290	1.1954
0.3523	15.4857	542	1.4095	0.0584	1.4095	1.1872
0.3523	15.5429	544	1.4274	0.1281	1.4274	1.1948
0.3523	15.6	546	1.4450	0.0948	1.4450	1.2021

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1