ArabicNewSplits7_B_usingALLEssays_FineTuningAraBERT_run3_AugV5_k3_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8609
• Qwk: 0.3753
• Mse: 0.8609
• Rmse: 0.9278

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1538	2	4.7039	0.0010	4.7039	2.1688
No log	0.3077	4	2.8509	-0.0285	2.8509	1.6885
No log	0.4615	6	1.9145	-0.0575	1.9145	1.3837
No log	0.6154	8	1.4809	-0.0194	1.4809	1.2169
No log	0.7692	10	1.2739	0.1176	1.2739	1.1287
No log	0.9231	12	1.1778	0.2464	1.1778	1.0853
No log	1.0769	14	1.1531	0.1556	1.1531	1.0738
No log	1.2308	16	1.1371	0.2234	1.1371	1.0664
No log	1.3846	18	1.1217	0.2378	1.1217	1.0591
No log	1.5385	20	1.1289	0.2068	1.1289	1.0625
No log	1.6923	22	1.1797	0.1354	1.1797	1.0861
No log	1.8462	24	1.2750	0.1196	1.2750	1.1292
No log	2.0	26	1.3900	0.0865	1.3900	1.1790
No log	2.1538	28	1.3618	0.0651	1.3618	1.1670
No log	2.3077	30	1.6206	0.0426	1.6206	1.2730
No log	2.4615	32	1.6800	0.0169	1.6800	1.2961
No log	2.6154	34	1.4167	0.0537	1.4167	1.1902
No log	2.7692	36	1.1998	0.1756	1.1998	1.0953
No log	2.9231	38	1.1088	0.2374	1.1088	1.0530
No log	3.0769	40	1.1344	0.3317	1.1344	1.0651
No log	3.2308	42	1.0581	0.2904	1.0581	1.0287
No log	3.3846	44	1.0910	0.3149	1.0910	1.0445
No log	3.5385	46	1.0478	0.4489	1.0478	1.0236
No log	3.6923	48	1.1305	0.3418	1.1305	1.0633
No log	3.8462	50	1.1341	0.2555	1.1341	1.0649
No log	4.0	52	1.0846	0.4087	1.0846	1.0414
No log	4.1538	54	1.0727	0.3496	1.0727	1.0357
No log	4.3077	56	1.0805	0.3902	1.0805	1.0395
No log	4.4615	58	1.2041	0.1514	1.2041	1.0973
No log	4.6154	60	1.1103	0.2058	1.1103	1.0537
No log	4.7692	62	0.9576	0.4874	0.9576	0.9786
No log	4.9231	64	1.0090	0.3941	1.0090	1.0045
No log	5.0769	66	1.0759	0.4219	1.0759	1.0373
No log	5.2308	68	0.9110	0.4595	0.9110	0.9545
No log	5.3846	70	1.0118	0.3886	1.0118	1.0059
No log	5.5385	72	1.0686	0.3100	1.0686	1.0337
No log	5.6923	74	0.9573	0.4393	0.9573	0.9784
No log	5.8462	76	0.9363	0.4142	0.9363	0.9676
No log	6.0	78	0.9689	0.3632	0.9689	0.9843
No log	6.1538	80	0.9147	0.4180	0.9147	0.9564
No log	6.3077	82	0.9153	0.4118	0.9153	0.9567
No log	6.4615	84	0.9505	0.4371	0.9505	0.9749
No log	6.6154	86	0.9111	0.4042	0.9111	0.9545
No log	6.7692	88	0.9210	0.5211	0.9210	0.9597
No log	6.9231	90	0.9694	0.4822	0.9694	0.9846
No log	7.0769	92	0.9281	0.4894	0.9281	0.9634
No log	7.2308	94	0.9197	0.4091	0.9197	0.9590
No log	7.3846	96	0.9123	0.3991	0.9123	0.9552
No log	7.5385	98	0.9006	0.4159	0.9006	0.9490
No log	7.6923	100	0.8944	0.4294	0.8944	0.9457
No log	7.8462	102	0.9145	0.4016	0.9145	0.9563
No log	8.0	104	1.0831	0.4218	1.0831	1.0407
No log	8.1538	106	1.0127	0.4131	1.0127	1.0063
No log	8.3077	108	0.9005	0.4104	0.9005	0.9490
No log	8.4615	110	0.8805	0.4328	0.8805	0.9383
No log	8.6154	112	0.9326	0.4522	0.9326	0.9657
No log	8.7692	114	0.9007	0.4361	0.9007	0.9490
No log	8.9231	116	0.9011	0.4460	0.9011	0.9493
No log	9.0769	118	0.8871	0.4424	0.8871	0.9418
No log	9.2308	120	0.8812	0.4424	0.8812	0.9387
No log	9.3846	122	0.8608	0.3979	0.8608	0.9278
No log	9.5385	124	0.8793	0.4661	0.8793	0.9377
No log	9.6923	126	0.8857	0.5025	0.8857	0.9411
No log	9.8462	128	0.8611	0.4397	0.8611	0.9280
No log	10.0	130	0.8457	0.3974	0.8457	0.9196
No log	10.1538	132	0.8566	0.3695	0.8566	0.9255
No log	10.3077	134	0.8428	0.4413	0.8428	0.9181
No log	10.4615	136	0.8314	0.4686	0.8314	0.9118
No log	10.6154	138	0.8532	0.4590	0.8532	0.9237
No log	10.7692	140	0.8538	0.4590	0.8538	0.9240
No log	10.9231	142	0.9495	0.5110	0.9495	0.9744
No log	11.0769	144	0.8937	0.4763	0.8937	0.9454
No log	11.2308	146	0.8299	0.4661	0.8299	0.9110
No log	11.3846	148	0.8159	0.4321	0.8159	0.9032
No log	11.5385	150	0.8280	0.4792	0.8280	0.9099
No log	11.6923	152	0.8217	0.4893	0.8217	0.9065
No log	11.8462	154	0.8358	0.4696	0.8358	0.9142
No log	12.0	156	0.7945	0.5375	0.7945	0.8913
No log	12.1538	158	0.7828	0.6107	0.7828	0.8847
No log	12.3077	160	0.8371	0.4992	0.8371	0.9149
No log	12.4615	162	0.9598	0.5189	0.9598	0.9797
No log	12.6154	164	0.9468	0.4878	0.9468	0.9730
No log	12.7692	166	0.9743	0.4574	0.9743	0.9871
No log	12.9231	168	0.8582	0.4696	0.8582	0.9264
No log	13.0769	170	0.8332	0.4434	0.8332	0.9128
No log	13.2308	172	0.8948	0.4408	0.8948	0.9459
No log	13.3846	174	0.8906	0.4368	0.8906	0.9437
No log	13.5385	176	0.8269	0.5358	0.8269	0.9093
No log	13.6923	178	0.8498	0.4816	0.8498	0.9218
No log	13.8462	180	0.8285	0.5375	0.8285	0.9102
No log	14.0	182	0.8865	0.3756	0.8865	0.9415
No log	14.1538	184	0.9150	0.4116	0.9150	0.9566
No log	14.3077	186	0.8737	0.3956	0.8737	0.9347
No log	14.4615	188	0.8405	0.4321	0.8405	0.9168
No log	14.6154	190	0.8338	0.4081	0.8338	0.9132
No log	14.7692	192	0.8229	0.4219	0.8229	0.9072
No log	14.9231	194	0.8178	0.4760	0.8178	0.9043
No log	15.0769	196	0.8896	0.4919	0.8896	0.9432
No log	15.2308	198	0.9077	0.5050	0.9077	0.9527
No log	15.3846	200	0.8666	0.4500	0.8666	0.9309
No log	15.5385	202	0.8213	0.4359	0.8213	0.9062
No log	15.6923	204	0.8390	0.4079	0.8390	0.9160
No log	15.8462	206	0.9096	0.4554	0.9096	0.9537
No log	16.0	208	0.8775	0.4350	0.8775	0.9367
No log	16.1538	210	0.8656	0.4157	0.8656	0.9304
No log	16.3077	212	0.9244	0.4624	0.9244	0.9615
No log	16.4615	214	0.9583	0.3644	0.9583	0.9789
No log	16.6154	216	0.8738	0.4337	0.8738	0.9348
No log	16.7692	218	0.8327	0.4033	0.8327	0.9125
No log	16.9231	220	0.8197	0.4033	0.8197	0.9054
No log	17.0769	222	0.8101	0.4140	0.8101	0.9001
No log	17.2308	224	0.8077	0.3884	0.8077	0.8987
No log	17.3846	226	0.8498	0.3756	0.8498	0.9218
No log	17.5385	228	0.8743	0.3846	0.8743	0.9350
No log	17.6923	230	0.8055	0.3814	0.8055	0.8975
No log	17.8462	232	0.8025	0.4962	0.8025	0.8958
No log	18.0	234	0.8197	0.5065	0.8197	0.9054
No log	18.1538	236	0.8278	0.4592	0.8278	0.9099
No log	18.3077	238	0.8498	0.4139	0.8498	0.9218
No log	18.4615	240	0.8694	0.3990	0.8694	0.9324
No log	18.6154	242	0.8686	0.3822	0.8686	0.9320
No log	18.7692	244	0.8814	0.3914	0.8814	0.9388
No log	18.9231	246	0.8564	0.4359	0.8564	0.9254
No log	19.0769	248	0.8484	0.4804	0.8484	0.9211
No log	19.2308	250	0.8474	0.4244	0.8474	0.9205
No log	19.3846	252	0.8488	0.4498	0.8488	0.9213
No log	19.5385	254	0.8522	0.4260	0.8522	0.9231
No log	19.6923	256	0.8301	0.4284	0.8301	0.9111
No log	19.8462	258	0.8280	0.4284	0.8280	0.9099
No log	20.0	260	0.8308	0.4140	0.8308	0.9115
No log	20.1538	262	0.8358	0.4140	0.8358	0.9142
No log	20.3077	264	0.8302	0.3933	0.8302	0.9112
No log	20.4615	266	0.8470	0.3970	0.8470	0.9203
No log	20.6154	268	0.8375	0.3822	0.8375	0.9151
No log	20.7692	270	0.8382	0.4098	0.8382	0.9155
No log	20.9231	272	0.9199	0.4123	0.9199	0.9591
No log	21.0769	274	0.9070	0.4123	0.9070	0.9524
No log	21.2308	276	0.8159	0.4733	0.8159	0.9033
No log	21.3846	278	0.7844	0.4324	0.7844	0.8857
No log	21.5385	280	0.8569	0.3709	0.8569	0.9257
No log	21.6923	282	0.8499	0.3572	0.8499	0.9219
No log	21.8462	284	0.7880	0.4737	0.7880	0.8877
No log	22.0	286	0.8152	0.5337	0.8152	0.9029
No log	22.1538	288	0.8064	0.5150	0.8064	0.8980
No log	22.3077	290	0.8493	0.3657	0.8493	0.9216
No log	22.4615	292	1.0355	0.4171	1.0355	1.0176
No log	22.6154	294	1.0872	0.4787	1.0872	1.0427
No log	22.7692	296	0.9445	0.4098	0.9445	0.9719
No log	22.9231	298	0.7978	0.4737	0.7978	0.8932
No log	23.0769	300	0.8248	0.4946	0.8248	0.9082
No log	23.2308	302	0.8383	0.4912	0.8383	0.9156
No log	23.3846	304	0.8153	0.4638	0.8153	0.9029
No log	23.5385	306	0.8110	0.4638	0.8110	0.9005
No log	23.6923	308	0.8101	0.4638	0.8101	0.9000
No log	23.8462	310	0.7960	0.4712	0.7960	0.8922
No log	24.0	312	0.7886	0.4534	0.7886	0.8881
No log	24.1538	314	0.8007	0.4494	0.8007	0.8948
No log	24.3077	316	0.8018	0.4434	0.8018	0.8954
No log	24.4615	318	0.8158	0.4466	0.8158	0.9032
No log	24.6154	320	0.8734	0.3941	0.8734	0.9346
No log	24.7692	322	0.9634	0.2917	0.9634	0.9815
No log	24.9231	324	0.9722	0.2917	0.9722	0.9860
No log	25.0769	326	0.9122	0.3074	0.9122	0.9551
No log	25.2308	328	0.8439	0.3734	0.8439	0.9187
No log	25.3846	330	0.8264	0.4397	0.8264	0.9091
No log	25.5385	332	0.8469	0.4434	0.8469	0.9203
No log	25.6923	334	0.8627	0.4578	0.8627	0.9288
No log	25.8462	336	0.8761	0.4401	0.8761	0.9360
No log	26.0	338	0.8836	0.4401	0.8836	0.9400
No log	26.1538	340	0.8809	0.4541	0.8809	0.9386
No log	26.3077	342	0.8683	0.4220	0.8683	0.9318
No log	26.4615	344	0.8561	0.3779	0.8561	0.9253
No log	26.6154	346	0.8437	0.4139	0.8437	0.9186
No log	26.7692	348	0.8252	0.4461	0.8252	0.9084
No log	26.9231	350	0.8317	0.4563	0.8317	0.9120
No log	27.0769	352	0.8389	0.4719	0.8389	0.9159
No log	27.2308	354	0.8243	0.4465	0.8243	0.9079
No log	27.3846	356	0.8226	0.4397	0.8226	0.9069
No log	27.5385	358	0.8337	0.4180	0.8337	0.9131
No log	27.6923	360	0.8487	0.3822	0.8487	0.9212
No log	27.8462	362	0.8762	0.3756	0.8762	0.9361
No log	28.0	364	0.9195	0.3798	0.9195	0.9589
No log	28.1538	366	0.9278	0.3798	0.9278	0.9632
No log	28.3077	368	0.8548	0.4	0.8548	0.9246
No log	28.4615	370	0.8528	0.4824	0.8528	0.9235
No log	28.6154	372	0.9167	0.4884	0.9167	0.9574
No log	28.7692	374	0.8821	0.4203	0.8821	0.9392
No log	28.9231	376	0.8577	0.4592	0.8577	0.9261
No log	29.0769	378	0.8321	0.4389	0.8321	0.9122
No log	29.2308	380	0.8326	0.4258	0.8326	0.9125
No log	29.3846	382	0.8386	0.4434	0.8386	0.9158
No log	29.5385	384	0.8335	0.4324	0.8335	0.9130
No log	29.6923	386	0.8561	0.4244	0.8561	0.9252
No log	29.8462	388	0.9183	0.4444	0.9183	0.9583
No log	30.0	390	0.9601	0.4123	0.9601	0.9798
No log	30.1538	392	0.9150	0.3700	0.9150	0.9566
No log	30.3077	394	0.8685	0.4428	0.8685	0.9319
No log	30.4615	396	0.9553	0.3782	0.9553	0.9774
No log	30.6154	398	1.0403	0.3682	1.0403	1.0200
No log	30.7692	400	0.9816	0.4321	0.9816	0.9907
No log	30.9231	402	0.8894	0.3462	0.8894	0.9431
No log	31.0769	404	0.8578	0.4466	0.8578	0.9261
No log	31.2308	406	0.8641	0.4733	0.8641	0.9296
No log	31.3846	408	0.8679	0.4733	0.8679	0.9316
No log	31.5385	410	0.8617	0.4221	0.8617	0.9283
No log	31.6923	412	0.8779	0.3992	0.8779	0.9370
No log	31.8462	414	0.8789	0.4033	0.8789	0.9375
No log	32.0	416	0.8493	0.4299	0.8493	0.9216
No log	32.1538	418	0.8342	0.4286	0.8342	0.9133
No log	32.3077	420	0.8371	0.4733	0.8371	0.9149
No log	32.4615	422	0.8623	0.4962	0.8623	0.9286
No log	32.6154	424	0.8793	0.4824	0.8793	0.9377
No log	32.7692	426	0.8748	0.4733	0.8748	0.9353
No log	32.9231	428	0.8847	0.3822	0.8847	0.9406
No log	33.0769	430	0.9311	0.3635	0.9311	0.9649
No log	33.2308	432	0.9375	0.3635	0.9375	0.9683
No log	33.3846	434	0.9043	0.3411	0.9043	0.9509
No log	33.5385	436	0.8776	0.4286	0.8776	0.9368
No log	33.6923	438	0.8580	0.4676	0.8580	0.9263
No log	33.8462	440	0.8430	0.5012	0.8430	0.9182
No log	34.0	442	0.8389	0.4923	0.8389	0.9159
No log	34.1538	444	0.8509	0.3855	0.8509	0.9224
No log	34.3077	446	0.8774	0.3992	0.8774	0.9367
No log	34.4615	448	0.8764	0.3992	0.8764	0.9361
No log	34.6154	450	0.8491	0.4367	0.8491	0.9215
No log	34.7692	452	0.8546	0.4638	0.8546	0.9244
No log	34.9231	454	0.8743	0.4733	0.8743	0.9350
No log	35.0769	456	0.8651	0.4244	0.8651	0.9301
No log	35.2308	458	0.8662	0.4327	0.8662	0.9307
No log	35.3846	460	0.9049	0.3590	0.9049	0.9513
No log	35.5385	462	0.9332	0.3230	0.9332	0.9660
No log	35.6923	464	0.9196	0.3679	0.9196	0.9590
No log	35.8462	466	0.8823	0.4157	0.8823	0.9393
No log	36.0	468	0.8516	0.4033	0.8516	0.9228
No log	36.1538	470	0.8688	0.3990	0.8688	0.9321
No log	36.3077	472	0.8766	0.4346	0.8766	0.9363
No log	36.4615	474	0.8762	0.3847	0.8762	0.9360
No log	36.6154	476	0.8760	0.3990	0.8760	0.9360
No log	36.7692	478	0.8833	0.3990	0.8833	0.9398
No log	36.9231	480	0.8739	0.4139	0.8739	0.9348
No log	37.0769	482	0.8755	0.4139	0.8755	0.9357
No log	37.2308	484	0.8851	0.4138	0.8851	0.9408
No log	37.3846	486	0.8995	0.4289	0.8995	0.9484
No log	37.5385	488	0.9054	0.4289	0.9054	0.9516
No log	37.6923	490	0.9099	0.4289	0.9099	0.9539
No log	37.8462	492	0.9066	0.3990	0.9066	0.9522
No log	38.0	494	0.8913	0.4139	0.8913	0.9441
No log	38.1538	496	0.8801	0.4180	0.8801	0.9381
No log	38.3077	498	0.8882	0.3544	0.8882	0.9424
0.2344	38.4615	500	0.8787	0.3855	0.8787	0.9374
0.2344	38.6154	502	0.8602	0.4221	0.8602	0.9275
0.2344	38.7692	504	0.8569	0.4139	0.8569	0.9257
0.2344	38.9231	506	0.8799	0.3990	0.8799	0.9381
0.2344	39.0769	508	0.9001	0.3840	0.9001	0.9487
0.2344	39.2308	510	0.8887	0.3840	0.8887	0.9427
0.2344	39.3846	512	0.8719	0.4139	0.8719	0.9338
0.2344	39.5385	514	0.8868	0.3394	0.8868	0.9417
0.2344	39.6923	516	0.9068	0.3602	0.9068	0.9523
0.2344	39.8462	518	0.9066	0.3291	0.9066	0.9521
0.2344	40.0	520	0.8916	0.3970	0.8916	0.9442
0.2344	40.1538	522	0.8964	0.4139	0.8964	0.9468
0.2344	40.3077	524	0.9266	0.3020	0.9266	0.9626
0.2344	40.4615	526	0.9286	0.3020	0.9286	0.9636
0.2344	40.6154	528	0.9288	0.3431	0.9288	0.9637
0.2344	40.7692	530	0.9093	0.4139	0.9093	0.9536
0.2344	40.9231	532	0.8998	0.3753	0.8998	0.9486
0.2344	41.0769	534	0.8954	0.3394	0.8954	0.9462
0.2344	41.2308	536	0.8757	0.3753	0.8757	0.9358
0.2344	41.3846	538	0.8642	0.3866	0.8642	0.9296
0.2344	41.5385	540	0.8600	0.3970	0.8600	0.9274
0.2344	41.6923	542	0.8598	0.3866	0.8598	0.9273
0.2344	41.8462	544	0.8722	0.3902	0.8722	0.9339
0.2344	42.0	546	0.8892	0.3902	0.8892	0.9430
0.2344	42.1538	548	0.8920	0.3902	0.8920	0.9445
0.2344	42.3077	550	0.8937	0.4008	0.8937	0.9453
0.2344	42.4615	552	0.9183	0.3544	0.9183	0.9583
0.2344	42.6154	554	0.9224	0.3487	0.9224	0.9604
0.2344	42.7692	556	0.9048	0.3590	0.9048	0.9512
0.2344	42.9231	558	0.8625	0.4012	0.8625	0.9287
0.2344	43.0769	560	0.8359	0.3866	0.8359	0.9143
0.2344	43.2308	562	0.8331	0.4286	0.8331	0.9127
0.2344	43.3846	564	0.8313	0.4286	0.8313	0.9117
0.2344	43.5385	566	0.8280	0.4180	0.8280	0.9100
0.2344	43.6923	568	0.8346	0.3965	0.8346	0.9136
0.2344	43.8462	570	0.8388	0.3648	0.8388	0.9159
0.2344	44.0	572	0.8309	0.3753	0.8309	0.9116
0.2344	44.1538	574	0.8338	0.3753	0.8338	0.9131
0.2344	44.3077	576	0.8344	0.3753	0.8344	0.9134
0.2344	44.4615	578	0.8510	0.3951	0.8510	0.9225
0.2344	44.6154	580	0.8794	0.3992	0.8794	0.9378
0.2344	44.7692	582	0.8900	0.3546	0.8900	0.9434
0.2344	44.9231	584	0.8742	0.3441	0.8742	0.9350
0.2344	45.0769	586	0.8670	0.3441	0.8670	0.9311
0.2344	45.2308	588	0.8590	0.3544	0.8590	0.9268
0.2344	45.3846	590	0.8609	0.3753	0.8609	0.9278

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1