ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k2_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6975
• Qwk: 0.4660
• Mse: 0.6975
• Rmse: 0.8352

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	4.0170	-0.0257	4.0170	2.0043
No log	0.4444	4	2.9441	-0.0166	2.9441	1.7158
No log	0.6667	6	1.3828	0.0380	1.3828	1.1759
No log	0.8889	8	1.2289	0.0760	1.2289	1.1085
No log	1.1111	10	1.0757	0.3666	1.0757	1.0372
No log	1.3333	12	1.0625	0.1908	1.0625	1.0308
No log	1.5556	14	1.0755	0.2794	1.0755	1.0371
No log	1.7778	16	1.2251	0.1142	1.2251	1.1069
No log	2.0	18	1.2930	0.0	1.2930	1.1371
No log	2.2222	20	1.2348	0.0	1.2348	1.1112
No log	2.4444	22	1.1272	0.1884	1.1272	1.0617
No log	2.6667	24	1.0602	0.3127	1.0602	1.0297
No log	2.8889	26	1.0216	0.3375	1.0216	1.0107
No log	3.1111	28	1.0313	0.4349	1.0313	1.0155
No log	3.3333	30	1.1107	0.2416	1.1107	1.0539
No log	3.5556	32	1.0808	0.2537	1.0808	1.0396
No log	3.7778	34	1.0395	0.2781	1.0395	1.0196
No log	4.0	36	0.9655	0.3604	0.9655	0.9826
No log	4.2222	38	0.9270	0.2291	0.9270	0.9628
No log	4.4444	40	0.9030	0.2441	0.9030	0.9503
No log	4.6667	42	0.8812	0.2716	0.8812	0.9387
No log	4.8889	44	0.8906	0.3814	0.8906	0.9437
No log	5.1111	46	0.8533	0.3564	0.8533	0.9237
No log	5.3333	48	0.8787	0.3424	0.8787	0.9374
No log	5.5556	50	0.9033	0.3974	0.9033	0.9504
No log	5.7778	52	0.9399	0.4465	0.9399	0.9695
No log	6.0	54	0.9145	0.4604	0.9145	0.9563
No log	6.2222	56	0.8788	0.4620	0.8788	0.9375
No log	6.4444	58	0.8847	0.4489	0.8847	0.9406
No log	6.6667	60	0.8930	0.4810	0.8930	0.9450
No log	6.8889	62	0.9512	0.4583	0.9512	0.9753
No log	7.1111	64	0.8489	0.4593	0.8489	0.9214
No log	7.3333	66	0.8961	0.4595	0.8961	0.9466
No log	7.5556	68	0.9647	0.4832	0.9647	0.9822
No log	7.7778	70	0.9600	0.4372	0.9600	0.9798
No log	8.0	72	0.9424	0.5050	0.9424	0.9708
No log	8.2222	74	1.0123	0.4832	1.0123	1.0061
No log	8.4444	76	0.8467	0.5350	0.8467	0.9202
No log	8.6667	78	0.7958	0.5646	0.7958	0.8921
No log	8.8889	80	0.7809	0.5784	0.7809	0.8837
No log	9.1111	82	0.8124	0.5279	0.8124	0.9013
No log	9.3333	84	0.9859	0.4217	0.9859	0.9929
No log	9.5556	86	0.8630	0.4708	0.8630	0.9290
No log	9.7778	88	0.7618	0.5594	0.7618	0.8728
No log	10.0	90	0.8097	0.4529	0.8097	0.8999
No log	10.2222	92	0.7783	0.4379	0.7783	0.8822
No log	10.4444	94	0.7675	0.5467	0.7675	0.8761
No log	10.6667	96	0.8522	0.4929	0.8522	0.9232
No log	10.8889	98	0.8125	0.5494	0.8125	0.9014
No log	11.1111	100	0.8146	0.5599	0.8146	0.9026
No log	11.3333	102	0.8049	0.5303	0.8049	0.8972
No log	11.5556	104	0.8192	0.4930	0.8192	0.9051
No log	11.7778	106	0.8259	0.4585	0.8259	0.9088
No log	12.0	108	0.8873	0.4609	0.8873	0.9420
No log	12.2222	110	0.8928	0.5140	0.8928	0.9449
No log	12.4444	112	0.8536	0.5067	0.8536	0.9239
No log	12.6667	114	0.8437	0.4835	0.8437	0.9185
No log	12.8889	116	0.8818	0.4617	0.8818	0.9390
No log	13.1111	118	0.8248	0.6151	0.8248	0.9082
No log	13.3333	120	1.0250	0.4034	1.0250	1.0124
No log	13.5556	122	1.0037	0.4503	1.0037	1.0019
No log	13.7778	124	0.8052	0.5577	0.8052	0.8973
No log	14.0	126	0.7440	0.6374	0.7440	0.8626
No log	14.2222	128	0.7682	0.6167	0.7682	0.8765
No log	14.4444	130	0.8038	0.5919	0.8038	0.8966
No log	14.6667	132	0.9235	0.5012	0.9235	0.9610
No log	14.8889	134	0.8752	0.5425	0.8752	0.9355
No log	15.1111	136	0.7594	0.5471	0.7594	0.8715
No log	15.3333	138	0.7811	0.5205	0.7811	0.8838
No log	15.5556	140	0.7606	0.4691	0.7606	0.8721
No log	15.7778	142	0.8856	0.4218	0.8856	0.9411
No log	16.0	144	1.0053	0.3846	1.0053	1.0027
No log	16.2222	146	0.9016	0.3954	0.9016	0.9495
No log	16.4444	148	0.7686	0.3556	0.7686	0.8767
No log	16.6667	150	0.7337	0.5288	0.7337	0.8566
No log	16.8889	152	0.7163	0.5529	0.7163	0.8463
No log	17.1111	154	0.7787	0.5076	0.7787	0.8824
No log	17.3333	156	0.8021	0.4489	0.8021	0.8956
No log	17.5556	158	0.7844	0.5395	0.7844	0.8857
No log	17.7778	160	0.7519	0.5671	0.7519	0.8671
No log	18.0	162	0.8129	0.4672	0.8129	0.9016
No log	18.2222	164	0.7866	0.5400	0.7866	0.8869
No log	18.4444	166	0.7746	0.5459	0.7746	0.8801
No log	18.6667	168	0.7742	0.5236	0.7742	0.8799
No log	18.8889	170	0.7777	0.4838	0.7777	0.8819
No log	19.1111	172	0.7823	0.4721	0.7823	0.8845
No log	19.3333	174	0.7770	0.5247	0.7770	0.8815
No log	19.5556	176	0.8407	0.5181	0.8407	0.9169
No log	19.7778	178	0.9197	0.4577	0.9197	0.9590
No log	20.0	180	0.8389	0.4812	0.8389	0.9159
No log	20.2222	182	0.7577	0.5467	0.7577	0.8705
No log	20.4444	184	0.7413	0.4936	0.7413	0.8610
No log	20.6667	186	0.7258	0.5274	0.7258	0.8519
No log	20.8889	188	0.7616	0.5410	0.7616	0.8727
No log	21.1111	190	0.7927	0.5482	0.7927	0.8903
No log	21.3333	192	0.7493	0.5752	0.7493	0.8656
No log	21.5556	194	0.7473	0.5424	0.7473	0.8645
No log	21.7778	196	0.7697	0.5719	0.7697	0.8773
No log	22.0	198	0.7638	0.5626	0.7638	0.8739
No log	22.2222	200	0.7647	0.4989	0.7647	0.8745
No log	22.4444	202	0.7549	0.4583	0.7549	0.8689
No log	22.6667	204	0.7444	0.4822	0.7444	0.8628
No log	22.8889	206	0.7293	0.5158	0.7293	0.8540
No log	23.1111	208	0.7387	0.5072	0.7387	0.8595
No log	23.3333	210	0.8540	0.4794	0.8540	0.9241
No log	23.5556	212	0.9652	0.4681	0.9652	0.9824
No log	23.7778	214	0.8668	0.4681	0.8668	0.9310
No log	24.0	216	0.7184	0.6032	0.7184	0.8476
No log	24.2222	218	0.7114	0.5188	0.7114	0.8435
No log	24.4444	220	0.7176	0.4938	0.7176	0.8471
No log	24.6667	222	0.7285	0.4888	0.7285	0.8535
No log	24.8889	224	0.7821	0.5048	0.7821	0.8844
No log	25.1111	226	0.7989	0.4926	0.7989	0.8938
No log	25.3333	228	0.8041	0.4695	0.8041	0.8967
No log	25.5556	230	0.7528	0.5455	0.7528	0.8677
No log	25.7778	232	0.7453	0.4583	0.7453	0.8633
No log	26.0	234	0.7470	0.4922	0.7470	0.8643
No log	26.2222	236	0.7536	0.5248	0.7536	0.8681
No log	26.4444	238	0.7791	0.5094	0.7791	0.8827
No log	26.6667	240	0.7764	0.5085	0.7764	0.8811
No log	26.8889	242	0.7472	0.5680	0.7472	0.8644
No log	27.1111	244	0.7404	0.5874	0.7404	0.8604
No log	27.3333	246	0.7360	0.5851	0.7360	0.8579
No log	27.5556	248	0.7268	0.5660	0.7268	0.8525
No log	27.7778	250	0.7157	0.5660	0.7157	0.8460
No log	28.0	252	0.7076	0.5463	0.7076	0.8412
No log	28.2222	254	0.7115	0.5446	0.7115	0.8435
No log	28.4444	256	0.7082	0.5107	0.7082	0.8415
No log	28.6667	258	0.7103	0.4691	0.7103	0.8428
No log	28.8889	260	0.7083	0.4944	0.7083	0.8416
No log	29.1111	262	0.7045	0.4989	0.7045	0.8394
No log	29.3333	264	0.7691	0.5622	0.7691	0.8770
No log	29.5556	266	0.8007	0.5356	0.8007	0.8948
No log	29.7778	268	0.7299	0.5740	0.7299	0.8544
No log	30.0	270	0.6797	0.5152	0.6797	0.8245
No log	30.2222	272	0.6720	0.5713	0.6720	0.8198
No log	30.4444	274	0.6702	0.6154	0.6702	0.8187
No log	30.6667	276	0.7211	0.5948	0.7211	0.8492
No log	30.8889	278	0.7990	0.5368	0.7990	0.8939
No log	31.1111	280	0.7496	0.5595	0.7496	0.8658
No log	31.3333	282	0.6599	0.6063	0.6599	0.8123
No log	31.5556	284	0.6286	0.6432	0.6286	0.7929
No log	31.7778	286	0.6234	0.6296	0.6234	0.7895
No log	32.0	288	0.6496	0.5883	0.6496	0.8060
No log	32.2222	290	0.6822	0.5206	0.6822	0.8260
No log	32.4444	292	0.6808	0.5218	0.6808	0.8251
No log	32.6667	294	0.6654	0.5618	0.6654	0.8157
No log	32.8889	296	0.6568	0.6096	0.6568	0.8104
No log	33.1111	298	0.6573	0.5485	0.6573	0.8108
No log	33.3333	300	0.6690	0.5996	0.6690	0.8179
No log	33.5556	302	0.6819	0.5954	0.6819	0.8258
No log	33.7778	304	0.6739	0.6509	0.6739	0.8209
No log	34.0	306	0.7019	0.5704	0.7019	0.8378
No log	34.2222	308	0.7202	0.5415	0.7202	0.8486
No log	34.4444	310	0.6986	0.6407	0.6986	0.8358
No log	34.6667	312	0.7276	0.5629	0.7276	0.8530
No log	34.8889	314	0.7393	0.5528	0.7393	0.8598
No log	35.1111	316	0.7249	0.4988	0.7249	0.8514
No log	35.3333	318	0.7166	0.5146	0.7166	0.8465
No log	35.5556	320	0.7177	0.5160	0.7177	0.8472
No log	35.7778	322	0.7045	0.5602	0.7045	0.8393
No log	36.0	324	0.7017	0.6084	0.7017	0.8377
No log	36.2222	326	0.7569	0.5740	0.7569	0.8700
No log	36.4444	328	0.7832	0.5622	0.7832	0.8850
No log	36.6667	330	0.7609	0.5622	0.7609	0.8723
No log	36.8889	332	0.7372	0.5528	0.7372	0.8586
No log	37.1111	334	0.7217	0.4828	0.7217	0.8495
No log	37.3333	336	0.7298	0.4828	0.7298	0.8543
No log	37.5556	338	0.7318	0.4550	0.7318	0.8555
No log	37.7778	340	0.7712	0.5292	0.7712	0.8782
No log	38.0	342	0.7961	0.5385	0.7961	0.8922
No log	38.2222	344	0.7524	0.5622	0.7524	0.8674
No log	38.4444	346	0.7024	0.4757	0.7024	0.8381
No log	38.6667	348	0.6944	0.5125	0.6944	0.8333
No log	38.8889	350	0.7067	0.5197	0.7067	0.8406
No log	39.1111	352	0.7143	0.5197	0.7143	0.8452
No log	39.3333	354	0.7259	0.5622	0.7259	0.8520
No log	39.5556	356	0.6987	0.5528	0.6987	0.8359
No log	39.7778	358	0.6826	0.6217	0.6826	0.8262
No log	40.0	360	0.6873	0.5626	0.6873	0.8290
No log	40.2222	362	0.6867	0.5735	0.6867	0.8287
No log	40.4444	364	0.6845	0.5558	0.6845	0.8274
No log	40.6667	366	0.6827	0.5565	0.6827	0.8263
No log	40.8889	368	0.7079	0.5642	0.7079	0.8414
No log	41.1111	370	0.7051	0.5642	0.7051	0.8397
No log	41.3333	372	0.6841	0.5751	0.6841	0.8271
No log	41.5556	374	0.6714	0.5751	0.6714	0.8194
No log	41.7778	376	0.6566	0.6632	0.6566	0.8103
No log	42.0	378	0.6559	0.6479	0.6559	0.8098
No log	42.2222	380	0.6636	0.5823	0.6636	0.8146
No log	42.4444	382	0.6851	0.5218	0.6851	0.8277
No log	42.6667	384	0.7160	0.5642	0.7160	0.8462
No log	42.8889	386	0.7582	0.5266	0.7582	0.8708
No log	43.1111	388	0.7280	0.5521	0.7280	0.8533
No log	43.3333	390	0.6824	0.5642	0.6824	0.8261
No log	43.5556	392	0.6411	0.5735	0.6411	0.8007
No log	43.7778	394	0.6386	0.6400	0.6386	0.7991
No log	44.0	396	0.6348	0.5902	0.6348	0.7968
No log	44.2222	398	0.6717	0.5964	0.6717	0.8196
No log	44.4444	400	0.7202	0.5383	0.7202	0.8486
No log	44.6667	402	0.6950	0.5622	0.6950	0.8337
No log	44.8889	404	0.6703	0.6291	0.6703	0.8187
No log	45.1111	406	0.6582	0.6066	0.6582	0.8113
No log	45.3333	408	0.6642	0.5587	0.6642	0.8150
No log	45.5556	410	0.6681	0.5808	0.6681	0.8174
No log	45.7778	412	0.6718	0.6278	0.6718	0.8196
No log	46.0	414	0.6880	0.5959	0.6880	0.8295
No log	46.2222	416	0.7112	0.5534	0.7112	0.8433
No log	46.4444	418	0.7160	0.5534	0.7160	0.8461
No log	46.6667	420	0.7021	0.5534	0.7021	0.8379
No log	46.8889	422	0.6993	0.5534	0.6993	0.8362
No log	47.1111	424	0.7171	0.5534	0.7171	0.8468
No log	47.3333	426	0.7539	0.5642	0.7539	0.8683
No log	47.5556	428	0.7657	0.5534	0.7657	0.8751
No log	47.7778	430	0.7405	0.5534	0.7405	0.8605
No log	48.0	432	0.7236	0.5345	0.7236	0.8506
No log	48.2222	434	0.7149	0.5044	0.7149	0.8455
No log	48.4444	436	0.7117	0.5044	0.7117	0.8436
No log	48.6667	438	0.7122	0.5345	0.7122	0.8439
No log	48.8889	440	0.7116	0.5084	0.7116	0.8436
No log	49.1111	442	0.7210	0.5534	0.7210	0.8491
No log	49.3333	444	0.7039	0.5642	0.7039	0.8390
No log	49.5556	446	0.6930	0.5642	0.6930	0.8324
No log	49.7778	448	0.6696	0.5206	0.6696	0.8183
No log	50.0	450	0.6575	0.4858	0.6575	0.8109
No log	50.2222	452	0.6573	0.5195	0.6573	0.8107
No log	50.4444	454	0.6566	0.5622	0.6566	0.8103
No log	50.6667	456	0.6694	0.5622	0.6694	0.8182
No log	50.8889	458	0.6931	0.5383	0.6931	0.8325
No log	51.1111	460	0.6807	0.5595	0.6807	0.8251
No log	51.3333	462	0.6610	0.5798	0.6610	0.8130
No log	51.5556	464	0.6699	0.5798	0.6699	0.8185
No log	51.7778	466	0.6890	0.5787	0.6890	0.8301
No log	52.0	468	0.6983	0.5809	0.6983	0.8356
No log	52.2222	470	0.7073	0.5498	0.7073	0.8410
No log	52.4444	472	0.6838	0.5944	0.6838	0.8269
No log	52.6667	474	0.6746	0.5534	0.6746	0.8213
No log	52.8889	476	0.6830	0.5751	0.6830	0.8264
No log	53.1111	478	0.7105	0.5614	0.7105	0.8429
No log	53.3333	480	0.7284	0.5150	0.7284	0.8534
No log	53.5556	482	0.7083	0.5595	0.7083	0.8416
No log	53.7778	484	0.6696	0.5510	0.6696	0.8183
No log	54.0	486	0.6479	0.6187	0.6479	0.8049
No log	54.2222	488	0.6461	0.6849	0.6461	0.8038
No log	54.4444	490	0.6612	0.5832	0.6612	0.8131
No log	54.6667	492	0.6812	0.5688	0.6812	0.8254
No log	54.8889	494	0.7014	0.5766	0.7014	0.8375
No log	55.1111	496	0.6999	0.5395	0.6999	0.8366
No log	55.3333	498	0.6824	0.5751	0.6824	0.8261
0.2171	55.5556	500	0.6658	0.5103	0.6658	0.8159
0.2171	55.7778	502	0.6616	0.5010	0.6616	0.8134
0.2171	56.0	504	0.6599	0.5010	0.6599	0.8123
0.2171	56.2222	506	0.6591	0.5121	0.6591	0.8119
0.2171	56.4444	508	0.6738	0.5084	0.6738	0.8208
0.2171	56.6667	510	0.7132	0.5642	0.7132	0.8445
0.2171	56.8889	512	0.7629	0.5356	0.7629	0.8735
0.2171	57.1111	514	0.7895	0.5356	0.7895	0.8885
0.2171	57.3333	516	0.7818	0.5356	0.7818	0.8842
0.2171	57.5556	518	0.7356	0.5400	0.7356	0.8576
0.2171	57.7778	520	0.6937	0.4869	0.6937	0.8329
0.2171	58.0	522	0.6907	0.4792	0.6907	0.8311
0.2171	58.2222	524	0.7059	0.4938	0.7059	0.8402
0.2171	58.4444	526	0.7029	0.4560	0.7029	0.8384
0.2171	58.6667	528	0.6975	0.4660	0.6975	0.8352

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1