ArabicNewSplits7_B_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k6_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.7066
• Qwk: 0.3284
• Mse: 1.7066
• Rmse: 1.3064

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	7.0605	-0.0056	7.0605	2.6572
No log	0.1379	4	5.2284	0.0161	5.2284	2.2866
No log	0.2069	6	3.9075	-0.0199	3.9075	1.9767
No log	0.2759	8	2.7390	0.0519	2.7390	1.6550
No log	0.3448	10	2.3785	0.1594	2.3785	1.5423
No log	0.4138	12	3.1449	-0.0530	3.1449	1.7734
No log	0.4828	14	3.1950	-0.1268	3.1950	1.7875
No log	0.5517	16	2.0481	0.0360	2.0481	1.4311
No log	0.6207	18	1.7799	0.1165	1.7799	1.3341
No log	0.6897	20	1.8031	0.1165	1.8031	1.3428
No log	0.7586	22	1.9367	0.1143	1.9367	1.3916
No log	0.8276	24	2.0377	0.2632	2.0377	1.4275
No log	0.8966	26	1.9785	0.2645	1.9785	1.4066
No log	0.9655	28	1.8603	0.2931	1.8603	1.3639
No log	1.0345	30	1.9245	0.368	1.9245	1.3872
No log	1.1034	32	1.8819	0.3607	1.8819	1.3718
No log	1.1724	34	1.9896	0.3307	1.9896	1.4105
No log	1.2414	36	1.9869	0.3279	1.9869	1.4096
No log	1.3103	38	1.9537	0.3361	1.9537	1.3977
No log	1.3793	40	1.9613	0.2883	1.9613	1.4005
No log	1.4483	42	1.9849	0.2957	1.9849	1.4088
No log	1.5172	44	2.0292	0.3252	2.0292	1.4245
No log	1.5862	46	1.9845	0.3200	1.9845	1.4087
No log	1.6552	48	1.8940	0.3419	1.8940	1.3762
No log	1.7241	50	1.7722	0.2222	1.7722	1.3312
No log	1.7931	52	1.6982	0.1524	1.6982	1.3032
No log	1.8621	54	1.7080	0.0777	1.7080	1.3069
No log	1.9310	56	1.7193	0.1524	1.7193	1.3112
No log	2.0	58	1.8044	0.2857	1.8044	1.3433
No log	2.0690	60	2.2364	0.1722	2.2364	1.4954
No log	2.1379	62	2.5346	0.0903	2.5346	1.5921
No log	2.2069	64	2.3499	0.1438	2.3499	1.5330
No log	2.2759	66	1.8871	0.3150	1.8871	1.3737
No log	2.3448	68	1.6610	0.2545	1.6610	1.2888
No log	2.4138	70	1.8049	0.1154	1.8049	1.3435
No log	2.4828	72	2.0543	0.1455	2.0543	1.4333
No log	2.5517	74	1.9282	0.1887	1.9282	1.3886
No log	2.6207	76	1.7591	0.1887	1.7591	1.3263
No log	2.6897	78	1.7334	0.2202	1.7334	1.3166
No log	2.7586	80	1.7400	0.2679	1.7400	1.3191
No log	2.8276	82	1.8104	0.2759	1.8104	1.3455
No log	2.8966	84	1.9489	0.2556	1.9489	1.3960
No log	2.9655	86	2.0055	0.2302	2.0055	1.4161
No log	3.0345	88	2.2457	0.1111	2.2457	1.4986
No log	3.1034	90	2.1865	0.1549	2.1865	1.4787
No log	3.1724	92	1.9377	0.2256	1.9377	1.3920
No log	3.2414	94	1.7601	0.2957	1.7601	1.3267
No log	3.3103	96	1.6794	0.1509	1.6794	1.2959
No log	3.3793	98	1.6145	0.1869	1.6145	1.2706
No log	3.4483	100	1.5718	0.1682	1.5718	1.2537
No log	3.5172	102	1.4719	0.2075	1.4719	1.2132
No log	3.5862	104	1.4444	0.2569	1.4444	1.2018
No log	3.6552	106	1.3962	0.2909	1.3962	1.1816
No log	3.7241	108	1.3917	0.2752	1.3917	1.1797
No log	3.7931	110	1.4545	0.2883	1.4545	1.2060
No log	3.8621	112	1.5470	0.2807	1.5470	1.2438
No log	3.9310	114	1.6264	0.3306	1.6264	1.2753
No log	4.0	116	1.5263	0.3130	1.5263	1.2354
No log	4.0690	118	1.4727	0.2243	1.4727	1.2135
No log	4.1379	120	1.4115	0.2545	1.4115	1.1881
No log	4.2069	122	1.4009	0.3717	1.4009	1.1836
No log	4.2759	124	1.4936	0.2593	1.4936	1.2221
No log	4.3448	126	1.5351	0.2222	1.5351	1.2390
No log	4.4138	128	1.5097	0.2632	1.5097	1.2287
No log	4.4828	130	1.4657	0.2857	1.4657	1.2107
No log	4.5517	132	1.4525	0.3115	1.4525	1.2052
No log	4.6207	134	1.4698	0.3252	1.4698	1.2123
No log	4.6897	136	1.5439	0.3360	1.5439	1.2425
No log	4.7586	138	1.5349	0.2832	1.5349	1.2389
No log	4.8276	140	1.4315	0.3793	1.4315	1.1964
No log	4.8966	142	1.4525	0.4202	1.4525	1.2052
No log	4.9655	144	1.5018	0.3361	1.5018	1.2255
No log	5.0345	146	1.6218	0.2975	1.6218	1.2735
No log	5.1034	148	1.8322	0.2520	1.8322	1.3536
No log	5.1724	150	1.8059	0.2615	1.8059	1.3438
No log	5.2414	152	1.6150	0.2602	1.6150	1.2708
No log	5.3103	154	1.5046	0.3471	1.5046	1.2266
No log	5.3793	156	1.4898	0.4068	1.4898	1.2206
No log	5.4483	158	1.4828	0.3193	1.4828	1.2177
No log	5.5172	160	1.5884	0.3175	1.5884	1.2603
No log	5.5862	162	1.8352	0.2609	1.8352	1.3547
No log	5.6552	164	1.7984	0.2748	1.7984	1.3410
No log	5.7241	166	1.6060	0.3167	1.6060	1.2673
No log	5.7931	168	1.5029	0.3248	1.5029	1.2259
No log	5.8621	170	1.4217	0.3559	1.4217	1.1924
No log	5.9310	172	1.4142	0.3770	1.4142	1.1892
No log	6.0	174	1.5643	0.375	1.5643	1.2507
No log	6.0690	176	1.6012	0.3876	1.6012	1.2654
No log	6.1379	178	1.4473	0.3810	1.4473	1.2030
No log	6.2069	180	1.4746	0.375	1.4746	1.2143
No log	6.2759	182	1.4973	0.3465	1.4973	1.2236
No log	6.3448	184	1.5679	0.3411	1.5679	1.2521
No log	6.4138	186	1.5564	0.3231	1.5564	1.2475
No log	6.4828	188	1.7324	0.2687	1.7324	1.3162
No log	6.5517	190	1.9205	0.2222	1.9205	1.3858
No log	6.6207	192	2.0913	0.1493	2.0913	1.4461
No log	6.6897	194	1.9899	0.2158	1.9899	1.4107
No log	6.7586	196	1.8342	0.2695	1.8342	1.3543
No log	6.8276	198	1.6506	0.3111	1.6506	1.2848
No log	6.8966	200	1.5969	0.2969	1.5969	1.2637
No log	6.9655	202	1.6587	0.3206	1.6587	1.2879
No log	7.0345	204	1.7871	0.2667	1.7871	1.3368
No log	7.1034	206	1.7102	0.3053	1.7102	1.3078
No log	7.1724	208	1.5631	0.3577	1.5631	1.2503
No log	7.2414	210	1.5437	0.3607	1.5437	1.2425
No log	7.3103	212	1.5382	0.3607	1.5382	1.2402
No log	7.3793	214	1.5241	0.3306	1.5241	1.2345
No log	7.4483	216	1.6220	0.3438	1.6220	1.2736
No log	7.5172	218	1.7968	0.2647	1.7968	1.3405
No log	7.5862	220	1.7907	0.2647	1.7907	1.3382
No log	7.6552	222	1.6469	0.3030	1.6469	1.2833
No log	7.7241	224	1.7279	0.2857	1.7279	1.3145
No log	7.7931	226	1.9652	0.2429	1.9652	1.4018
No log	7.8621	228	1.9996	0.2098	1.9996	1.4141
No log	7.9310	230	1.7618	0.2923	1.7618	1.3273
No log	8.0	232	1.6278	0.3307	1.6278	1.2758
No log	8.0690	234	1.5644	0.3333	1.5644	1.2507
No log	8.1379	236	1.6005	0.2787	1.6005	1.2651
No log	8.2069	238	1.6099	0.3040	1.6099	1.2688
No log	8.2759	240	1.5736	0.3040	1.5736	1.2544
No log	8.3448	242	1.5227	0.3361	1.5227	1.2340
No log	8.4138	244	1.6108	0.368	1.6108	1.2692
No log	8.4828	246	1.6986	0.3206	1.6986	1.3033
No log	8.5517	248	1.7503	0.3158	1.7503	1.3230
No log	8.6207	250	1.6484	0.3333	1.6484	1.2839
No log	8.6897	252	1.6637	0.3158	1.6637	1.2899
No log	8.7586	254	1.7943	0.2941	1.7943	1.3395
No log	8.8276	256	1.9087	0.3066	1.9087	1.3816
No log	8.8966	258	1.7785	0.3066	1.7785	1.3336
No log	8.9655	260	1.5261	0.3438	1.5261	1.2354
No log	9.0345	262	1.3582	0.3167	1.3582	1.1654
No log	9.1034	264	1.3593	0.3361	1.3593	1.1659
No log	9.1724	266	1.4543	0.3252	1.4543	1.2059
No log	9.2414	268	1.7842	0.3066	1.7842	1.3357
No log	9.3103	270	1.9612	0.2734	1.9612	1.4004
No log	9.3793	272	1.8006	0.3235	1.8006	1.3419
No log	9.4483	274	1.4945	0.3411	1.4945	1.2225
No log	9.5172	276	1.3177	0.3697	1.3177	1.1479
No log	9.5862	278	1.2850	0.3802	1.2850	1.1336
No log	9.6552	280	1.3774	0.3968	1.3774	1.1736
No log	9.7241	282	1.4724	0.4	1.4724	1.2134
No log	9.7931	284	1.4921	0.3969	1.4921	1.2215
No log	9.8621	286	1.6445	0.3609	1.6445	1.2824
No log	9.9310	288	1.7572	0.2581	1.7572	1.3256
No log	10.0	290	1.8106	0.2609	1.8106	1.3456
No log	10.0690	292	1.7455	0.1121	1.7455	1.3212
No log	10.1379	294	1.6481	0.3590	1.6481	1.2838
No log	10.2069	296	1.5597	0.3721	1.5597	1.2489
No log	10.2759	298	1.5100	0.4275	1.5100	1.2288
No log	10.3448	300	1.5609	0.3788	1.5609	1.2494
No log	10.4138	302	1.6247	0.3053	1.6247	1.2746
No log	10.4828	304	1.5695	0.3692	1.5695	1.2528
No log	10.5517	306	1.4511	0.3692	1.4511	1.2046
No log	10.6207	308	1.4776	0.3692	1.4776	1.2156
No log	10.6897	310	1.6630	0.3053	1.6630	1.2896
No log	10.7586	312	1.9137	0.2628	1.9137	1.3834
No log	10.8276	314	1.9095	0.2667	1.9095	1.3818
No log	10.8966	316	1.6701	0.3053	1.6701	1.2923
No log	10.9655	318	1.4570	0.3065	1.4570	1.2071
No log	11.0345	320	1.4397	0.3902	1.4397	1.1999
No log	11.1034	322	1.5167	0.2764	1.5167	1.2315
No log	11.1724	324	1.7523	0.2769	1.7523	1.3237
No log	11.2414	326	1.9861	0.2836	1.9861	1.4093
No log	11.3103	328	2.0344	0.2482	2.0344	1.4263
No log	11.3793	330	1.8383	0.3008	1.8383	1.3559
No log	11.4483	332	1.6279	0.2362	1.6279	1.2759
No log	11.5172	334	1.5333	0.2764	1.5333	1.2383
No log	11.5862	336	1.5705	0.2764	1.5705	1.2532
No log	11.6552	338	1.7184	0.3053	1.7184	1.3109
No log	11.7241	340	1.7603	0.3053	1.7603	1.3267
No log	11.7931	342	1.7338	0.3053	1.7338	1.3168
No log	11.8621	344	1.6549	0.3281	1.6549	1.2864
No log	11.9310	346	1.5812	0.3065	1.5812	1.2574
No log	12.0	348	1.5095	0.2951	1.5095	1.2286
No log	12.0690	350	1.5180	0.3387	1.5180	1.2321
No log	12.1379	352	1.6093	0.3594	1.6093	1.2686
No log	12.2069	354	1.7331	0.3053	1.7331	1.3165
No log	12.2759	356	1.7908	0.3008	1.7908	1.3382
No log	12.3448	358	1.6765	0.3053	1.6765	1.2948
No log	12.4138	360	1.5567	0.3465	1.5567	1.2477
No log	12.4828	362	1.5627	0.3692	1.5627	1.2501
No log	12.5517	364	1.5888	0.3692	1.5888	1.2605
No log	12.6207	366	1.6883	0.3182	1.6883	1.2993
No log	12.6897	368	1.6924	0.3182	1.6924	1.3009
No log	12.7586	370	1.7326	0.3008	1.7326	1.3163
No log	12.8276	372	1.7846	0.2920	1.7846	1.3359
No log	12.8966	374	1.7601	0.3158	1.7601	1.3267
No log	12.9655	376	1.6733	0.3459	1.6733	1.2936
No log	13.0345	378	1.6424	0.3485	1.6424	1.2815
No log	13.1034	380	1.5638	0.3651	1.5638	1.2505
No log	13.1724	382	1.5196	0.3415	1.5196	1.2327
No log	13.2414	384	1.4218	0.3361	1.4218	1.1924
No log	13.3103	386	1.4122	0.3361	1.4122	1.1884
No log	13.3793	388	1.4723	0.3471	1.4723	1.2134
No log	13.4483	390	1.6491	0.2923	1.6491	1.2842
No log	13.5172	392	1.7498	0.3182	1.7498	1.3228
No log	13.5862	394	1.6851	0.3333	1.6851	1.2981
No log	13.6552	396	1.5336	0.3125	1.5336	1.2384
No log	13.7241	398	1.4701	0.3492	1.4701	1.2125
No log	13.7931	400	1.5381	0.3465	1.5381	1.2402
No log	13.8621	402	1.6866	0.3333	1.6866	1.2987
No log	13.9310	404	1.8489	0.2815	1.8489	1.3597
No log	14.0	406	1.9907	0.2319	1.9907	1.4109
No log	14.0690	408	1.9943	0.2319	1.9943	1.4122
No log	14.1379	410	1.8370	0.3182	1.8370	1.3554
No log	14.2069	412	1.7359	0.3182	1.7359	1.3175
No log	14.2759	414	1.6270	0.2835	1.6270	1.2755
No log	14.3448	416	1.5626	0.3016	1.5626	1.2500
No log	14.4138	418	1.6227	0.3256	1.6227	1.2739
No log	14.4828	420	1.7742	0.3111	1.7742	1.3320
No log	14.5517	422	1.8534	0.3111	1.8534	1.3614
No log	14.6207	424	1.9279	0.2609	1.9279	1.3885
No log	14.6897	426	1.8270	0.2963	1.8270	1.3517
No log	14.7586	428	1.7414	0.3459	1.7414	1.3196
No log	14.8276	430	1.6344	0.3307	1.6344	1.2785
No log	14.8966	432	1.5347	0.3415	1.5347	1.2388
No log	14.9655	434	1.5188	0.3443	1.5188	1.2324
No log	15.0345	436	1.5312	0.3115	1.5312	1.2374
No log	15.1034	438	1.5923	0.3016	1.5923	1.2619
No log	15.1724	440	1.5757	0.3016	1.5757	1.2553
No log	15.2414	442	1.5236	0.3651	1.5236	1.2343
No log	15.3103	444	1.5712	0.3150	1.5712	1.2535
No log	15.3793	446	1.6780	0.3636	1.6780	1.2954
No log	15.4483	448	1.6442	0.3385	1.6442	1.2823
No log	15.5172	450	1.6073	0.3256	1.6073	1.2678
No log	15.5862	452	1.5213	0.3492	1.5213	1.2334
No log	15.6552	454	1.5308	0.3492	1.5308	1.2373
No log	15.7241	456	1.5276	0.3492	1.5276	1.2360
No log	15.7931	458	1.5087	0.3680	1.5087	1.2283
No log	15.8621	460	1.5035	0.3680	1.5035	1.2262
No log	15.9310	462	1.5914	0.3360	1.5914	1.2615
No log	16.0	464	1.7768	0.3556	1.7768	1.3329
No log	16.0690	466	1.8202	0.3188	1.8202	1.3491
No log	16.1379	468	1.7687	0.3212	1.7687	1.3299
No log	16.2069	470	1.6814	0.3664	1.6814	1.2967
No log	16.2759	472	1.6673	0.3664	1.6673	1.2912
No log	16.3448	474	1.6973	0.3308	1.6973	1.3028
No log	16.4138	476	1.6235	0.3566	1.6235	1.2742
No log	16.4828	478	1.5638	0.3360	1.5638	1.2505
No log	16.5517	480	1.5819	0.3360	1.5819	1.2577
No log	16.6207	482	1.6862	0.3459	1.6862	1.2985
No log	16.6897	484	1.8277	0.3556	1.8277	1.3519
No log	16.7586	486	1.7787	0.3433	1.7787	1.3337
No log	16.8276	488	1.6562	0.3538	1.6563	1.2870
No log	16.8966	490	1.6423	0.3538	1.6423	1.2815
No log	16.9655	492	1.5947	0.4094	1.5947	1.2628
No log	17.0345	494	1.6121	0.3359	1.6121	1.2697
No log	17.1034	496	1.6246	0.3359	1.6246	1.2746
No log	17.1724	498	1.5337	0.3817	1.5337	1.2384
0.4701	17.2414	500	1.5431	0.3817	1.5431	1.2422
0.4701	17.3103	502	1.5755	0.3636	1.5755	1.2552
0.4701	17.3793	504	1.6377	0.3485	1.6377	1.2797
0.4701	17.4483	506	1.6293	0.3485	1.6293	1.2765
0.4701	17.5172	508	1.5555	0.4	1.5555	1.2472
0.4701	17.5862	510	1.4811	0.4375	1.4811	1.2170
0.4701	17.6552	512	1.5127	0.4	1.5127	1.2299
0.4701	17.7241	514	1.5393	0.3721	1.5393	1.2407
0.4701	17.7931	516	1.6200	0.3485	1.6200	1.2728
0.4701	17.8621	518	1.6548	0.3485	1.6548	1.2864
0.4701	17.9310	520	1.7075	0.3407	1.7075	1.3067
0.4701	18.0	522	1.7066	0.3284	1.7066	1.3064

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1