ArabicNewSplits8_usingALLEssays_FineTuningAraBERT_run2_AugV5_k9_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7154
• Qwk: 0.6810
• Mse: 0.7154
• Rmse: 0.8458

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0444	2	5.3696	-0.0359	5.3696	2.3172
No log	0.0889	4	3.2209	0.0784	3.2209	1.7947
No log	0.1333	6	2.2435	-0.0611	2.2435	1.4978
No log	0.1778	8	1.6634	0.0221	1.6634	1.2897
No log	0.2222	10	1.2162	0.2199	1.2162	1.1028
No log	0.2667	12	1.2415	0.1693	1.2415	1.1142
No log	0.3111	14	1.3569	0.1507	1.3569	1.1648
No log	0.3556	16	1.4666	0.0519	1.4666	1.2110
No log	0.4	18	1.8664	0.0410	1.8664	1.3662
No log	0.4444	20	1.6103	0.0166	1.6103	1.2690
No log	0.4889	22	1.6096	0.0314	1.6096	1.2687
No log	0.5333	24	1.3214	0.2003	1.3214	1.1495
No log	0.5778	26	1.1771	0.2853	1.1771	1.0850
No log	0.6222	28	1.0364	0.3252	1.0364	1.0180
No log	0.6667	30	1.2435	0.3205	1.2435	1.1151
No log	0.7111	32	2.2234	0.2049	2.2234	1.4911
No log	0.7556	34	2.4899	0.2080	2.4899	1.5779
No log	0.8	36	1.9833	0.2512	1.9833	1.4083
No log	0.8444	38	1.2920	0.3261	1.2920	1.1367
No log	0.8889	40	0.8744	0.4693	0.8744	0.9351
No log	0.9333	42	0.8615	0.4556	0.8615	0.9282
No log	0.9778	44	1.1588	0.3183	1.1588	1.0765
No log	1.0222	46	1.3372	0.2156	1.3372	1.1564
No log	1.0667	48	1.1875	0.3150	1.1875	1.0897
No log	1.1111	50	0.9283	0.4133	0.9283	0.9635
No log	1.1556	52	0.7587	0.5268	0.7587	0.8711
No log	1.2	54	0.7438	0.5561	0.7438	0.8625
No log	1.2444	56	1.0215	0.4032	1.0215	1.0107
No log	1.2889	58	1.5119	0.2950	1.5119	1.2296
No log	1.3333	60	1.4272	0.3962	1.4272	1.1946
No log	1.3778	62	1.0809	0.4605	1.0809	1.0397
No log	1.4222	64	0.8713	0.5516	0.8713	0.9334
No log	1.4667	66	0.8557	0.6013	0.8557	0.9250
No log	1.5111	68	1.0821	0.5821	1.0821	1.0403
No log	1.5556	70	1.4233	0.4193	1.4233	1.1930
No log	1.6	72	1.4965	0.4374	1.4965	1.2233
No log	1.6444	74	1.0542	0.5597	1.0542	1.0267
No log	1.6889	76	0.7082	0.6842	0.7082	0.8416
No log	1.7333	78	1.0088	0.5005	1.0088	1.0044
No log	1.7778	80	1.1350	0.4250	1.1350	1.0654
No log	1.8222	82	0.8726	0.5762	0.8726	0.9341
No log	1.8667	84	0.7762	0.6411	0.7762	0.8810
No log	1.9111	86	0.9604	0.6141	0.9604	0.9800
No log	1.9556	88	1.0708	0.5783	1.0708	1.0348
No log	2.0	90	0.9300	0.5811	0.9300	0.9644
No log	2.0444	92	0.7581	0.6459	0.7581	0.8707
No log	2.0889	94	0.7518	0.6032	0.7518	0.8670
No log	2.1333	96	0.8357	0.5668	0.8357	0.9142
No log	2.1778	98	0.7701	0.5930	0.7701	0.8776
No log	2.2222	100	0.7185	0.6155	0.7185	0.8476
No log	2.2667	102	0.6707	0.6238	0.6707	0.8189
No log	2.3111	104	0.7092	0.6355	0.7092	0.8421
No log	2.3556	106	0.7982	0.5998	0.7982	0.8934
No log	2.4	108	0.7562	0.6612	0.7562	0.8696
No log	2.4444	110	0.7848	0.6355	0.7848	0.8859
No log	2.4889	112	0.7568	0.6673	0.7568	0.8700
No log	2.5333	114	0.7034	0.7120	0.7034	0.8387
No log	2.5778	116	0.7781	0.6433	0.7781	0.8821
No log	2.6222	118	0.7468	0.6742	0.7468	0.8642
No log	2.6667	120	0.6667	0.7295	0.6667	0.8165
No log	2.7111	122	0.6313	0.7141	0.6313	0.7945
No log	2.7556	124	0.6324	0.7419	0.6324	0.7952
No log	2.8	126	0.6631	0.7093	0.6631	0.8143
No log	2.8444	128	0.7281	0.6610	0.7281	0.8533
No log	2.8889	130	0.8785	0.6238	0.8785	0.9373
No log	2.9333	132	0.9052	0.5716	0.9052	0.9514
No log	2.9778	134	0.8213	0.6344	0.8213	0.9062
No log	3.0222	136	0.8518	0.6196	0.8518	0.9229
No log	3.0667	138	0.8991	0.6031	0.8991	0.9482
No log	3.1111	140	0.7911	0.6392	0.7911	0.8894
No log	3.1556	142	0.7024	0.6647	0.7024	0.8381
No log	3.2	144	0.6756	0.6805	0.6756	0.8219
No log	3.2444	146	0.7411	0.6013	0.7411	0.8609
No log	3.2889	148	0.9872	0.5584	0.9872	0.9936
No log	3.3333	150	1.2856	0.5047	1.2856	1.1339
No log	3.3778	152	1.1405	0.5276	1.1405	1.0679
No log	3.4222	154	0.7487	0.624	0.7487	0.8653
No log	3.4667	156	0.7301	0.6520	0.7301	0.8545
No log	3.5111	158	0.8439	0.5866	0.8439	0.9186
No log	3.5556	160	0.7574	0.6436	0.7574	0.8703
No log	3.6	162	0.6994	0.6989	0.6994	0.8363
No log	3.6444	164	0.9464	0.6024	0.9464	0.9728
No log	3.6889	166	1.4543	0.4856	1.4543	1.2059
No log	3.7333	168	1.5661	0.4299	1.5661	1.2514
No log	3.7778	170	1.2561	0.4886	1.2561	1.1208
No log	3.8222	172	0.8236	0.5773	0.8236	0.9075
No log	3.8667	174	0.6493	0.6995	0.6493	0.8058
No log	3.9111	176	0.7956	0.5977	0.7956	0.8919
No log	3.9556	178	0.8953	0.5941	0.8953	0.9462
No log	4.0	180	0.8078	0.6054	0.8078	0.8988
No log	4.0444	182	0.6690	0.6705	0.6690	0.8179
No log	4.0889	184	0.6785	0.6604	0.6785	0.8237
No log	4.1333	186	0.7313	0.6382	0.7313	0.8552
No log	4.1778	188	0.7688	0.5750	0.7688	0.8768
No log	4.2222	190	0.7007	0.6544	0.7007	0.8371
No log	4.2667	192	0.6654	0.6431	0.6654	0.8157
No log	4.3111	194	0.8103	0.5842	0.8103	0.9002
No log	4.3556	196	0.8579	0.5869	0.8579	0.9262
No log	4.4	198	0.7298	0.6056	0.7298	0.8543
No log	4.4444	200	0.6582	0.6648	0.6582	0.8113
No log	4.4889	202	0.7107	0.6129	0.7107	0.8430
No log	4.5333	204	0.8055	0.5815	0.8055	0.8975
No log	4.5778	206	0.7328	0.6064	0.7328	0.8560
No log	4.6222	208	0.6506	0.6678	0.6506	0.8066
No log	4.6667	210	0.6469	0.6970	0.6469	0.8043
No log	4.7111	212	0.6673	0.7407	0.6673	0.8169
No log	4.7556	214	0.6762	0.7237	0.6762	0.8223
No log	4.8	216	0.6628	0.7159	0.6628	0.8142
No log	4.8444	218	0.6428	0.7128	0.6428	0.8017
No log	4.8889	220	0.6960	0.6526	0.6960	0.8343
No log	4.9333	222	0.7284	0.6149	0.7284	0.8534
No log	4.9778	224	0.6932	0.6004	0.6932	0.8326
No log	5.0222	226	0.6555	0.6075	0.6555	0.8097
No log	5.0667	228	0.6491	0.6255	0.6491	0.8057
No log	5.1111	230	0.6372	0.6245	0.6372	0.7983
No log	5.1556	232	0.6780	0.6129	0.6780	0.8234
No log	5.2	234	0.6474	0.6472	0.6474	0.8046
No log	5.2444	236	0.5840	0.7290	0.5840	0.7642
No log	5.2889	238	0.6532	0.7092	0.6532	0.8082
No log	5.3333	240	0.6576	0.6821	0.6576	0.8109
No log	5.3778	242	0.6109	0.7282	0.6109	0.7816
No log	5.4222	244	0.6631	0.6379	0.6631	0.8143
No log	5.4667	246	0.8035	0.6109	0.8035	0.8964
No log	5.5111	248	0.7944	0.5882	0.7944	0.8913
No log	5.5556	250	0.6933	0.6394	0.6933	0.8327
No log	5.6	252	0.6464	0.6156	0.6464	0.8040
No log	5.6444	254	0.7370	0.5960	0.7370	0.8585
No log	5.6889	256	0.7617	0.5633	0.7617	0.8727
No log	5.7333	258	0.6456	0.6840	0.6456	0.8035
No log	5.7778	260	0.6167	0.6789	0.6167	0.7853
No log	5.8222	262	0.7499	0.6137	0.7499	0.8659
No log	5.8667	264	0.7993	0.6221	0.7993	0.8941
No log	5.9111	266	0.6564	0.6365	0.6564	0.8102
No log	5.9556	268	0.6028	0.7073	0.6028	0.7764
No log	6.0	270	0.7047	0.6741	0.7047	0.8394
No log	6.0444	272	0.6896	0.6704	0.6896	0.8304
No log	6.0889	274	0.6147	0.6868	0.6147	0.7840
No log	6.1333	276	0.6492	0.6796	0.6492	0.8057
No log	6.1778	278	0.7493	0.6339	0.7493	0.8656
No log	6.2222	280	0.7367	0.6538	0.7367	0.8583
No log	6.2667	282	0.6697	0.6704	0.6697	0.8183
No log	6.3111	284	0.6453	0.7134	0.6453	0.8033
No log	6.3556	286	0.6538	0.6769	0.6538	0.8086
No log	6.4	288	0.6389	0.7066	0.6389	0.7993
No log	6.4444	290	0.6292	0.6924	0.6292	0.7932
No log	6.4889	292	0.6964	0.6505	0.6964	0.8345
No log	6.5333	294	0.7746	0.6189	0.7746	0.8801
No log	6.5778	296	0.7559	0.6462	0.7559	0.8695
No log	6.6222	298	0.6702	0.7029	0.6702	0.8186
No log	6.6667	300	0.6253	0.7282	0.6253	0.7907
No log	6.7111	302	0.6160	0.7274	0.6160	0.7848
No log	6.7556	304	0.6025	0.7387	0.6025	0.7762
No log	6.8	306	0.5911	0.7434	0.5911	0.7688
No log	6.8444	308	0.6278	0.7035	0.6278	0.7923
No log	6.8889	310	0.6595	0.7035	0.6595	0.8121
No log	6.9333	312	0.6368	0.7058	0.6368	0.7980
No log	6.9778	314	0.6108	0.7367	0.6108	0.7815
No log	7.0222	316	0.6038	0.7413	0.6038	0.7771
No log	7.0667	318	0.6072	0.7352	0.6072	0.7793
No log	7.1111	320	0.6049	0.7443	0.6049	0.7777
No log	7.1556	322	0.6182	0.7129	0.6182	0.7863
No log	7.2	324	0.6340	0.6834	0.6340	0.7962
No log	7.2444	326	0.6045	0.7028	0.6045	0.7775
No log	7.2889	328	0.5833	0.7130	0.5833	0.7638
No log	7.3333	330	0.5985	0.6829	0.5985	0.7736
No log	7.3778	332	0.5947	0.7003	0.5947	0.7711
No log	7.4222	334	0.6250	0.7135	0.6250	0.7906
No log	7.4667	336	0.6694	0.6933	0.6694	0.8182
No log	7.5111	338	0.6935	0.7053	0.6935	0.8328
No log	7.5556	340	0.7125	0.7072	0.7125	0.8441
No log	7.6	342	0.6669	0.7053	0.6669	0.8166
No log	7.6444	344	0.6508	0.7055	0.6508	0.8067
No log	7.6889	346	0.6581	0.6935	0.6581	0.8112
No log	7.7333	348	0.6870	0.6603	0.6870	0.8289
No log	7.7778	350	0.6628	0.6953	0.6628	0.8141
No log	7.8222	352	0.6419	0.7004	0.6419	0.8012
No log	7.8667	354	0.6523	0.7113	0.6523	0.8076
No log	7.9111	356	0.6817	0.7209	0.6817	0.8256
No log	7.9556	358	0.6562	0.7197	0.6562	0.8101
No log	8.0	360	0.6346	0.7025	0.6346	0.7966
No log	8.0444	362	0.6476	0.6996	0.6476	0.8047
No log	8.0889	364	0.6791	0.6732	0.6791	0.8241
No log	8.1333	366	0.7240	0.6605	0.7240	0.8509
No log	8.1778	368	0.6734	0.6644	0.6734	0.8206
No log	8.2222	370	0.6399	0.6713	0.6399	0.7999
No log	8.2667	372	0.6304	0.7010	0.6304	0.7940
No log	8.3111	374	0.6153	0.6971	0.6153	0.7844
No log	8.3556	376	0.6193	0.6797	0.6193	0.7870
No log	8.4	378	0.6377	0.6759	0.6377	0.7986
No log	8.4444	380	0.6546	0.6654	0.6546	0.8091
No log	8.4889	382	0.6976	0.6675	0.6976	0.8352
No log	8.5333	384	0.7653	0.6357	0.7653	0.8748
No log	8.5778	386	0.7392	0.6441	0.7392	0.8598
No log	8.6222	388	0.7165	0.6390	0.7165	0.8465
No log	8.6667	390	0.6727	0.6376	0.6727	0.8202
No log	8.7111	392	0.6650	0.6467	0.6650	0.8155
No log	8.7556	394	0.6857	0.6357	0.6857	0.8281
No log	8.8	396	0.7317	0.6337	0.7317	0.8554
No log	8.8444	398	0.7414	0.6484	0.7414	0.8611
No log	8.8889	400	0.6756	0.6603	0.6756	0.8219
No log	8.9333	402	0.6071	0.7116	0.6071	0.7792
No log	8.9778	404	0.6147	0.7350	0.6147	0.7840
No log	9.0222	406	0.6091	0.7336	0.6091	0.7805
No log	9.0667	408	0.6083	0.7397	0.6083	0.7800
No log	9.1111	410	0.6066	0.7275	0.6066	0.7788
No log	9.1556	412	0.6152	0.7227	0.6152	0.7844
No log	9.2	414	0.6273	0.7211	0.6273	0.7920
No log	9.2444	416	0.6296	0.7211	0.6296	0.7935
No log	9.2889	418	0.6107	0.7329	0.6107	0.7815
No log	9.3333	420	0.6206	0.7181	0.6206	0.7878
No log	9.3778	422	0.6420	0.6820	0.6420	0.8012
No log	9.4222	424	0.6509	0.6871	0.6509	0.8068
No log	9.4667	426	0.6248	0.6921	0.6248	0.7904
No log	9.5111	428	0.5882	0.7450	0.5882	0.7670
No log	9.5556	430	0.6177	0.6952	0.6177	0.7860
No log	9.6	432	0.6285	0.6809	0.6285	0.7927
No log	9.6444	434	0.5954	0.7533	0.5954	0.7716
No log	9.6889	436	0.5793	0.7455	0.5793	0.7611
No log	9.7333	438	0.5859	0.7299	0.5859	0.7654
No log	9.7778	440	0.5855	0.7245	0.5855	0.7652
No log	9.8222	442	0.5820	0.7330	0.5820	0.7629
No log	9.8667	444	0.5988	0.7400	0.5988	0.7738
No log	9.9111	446	0.6021	0.7383	0.6021	0.7760
No log	9.9556	448	0.6064	0.7229	0.6064	0.7787
No log	10.0	450	0.6187	0.7396	0.6187	0.7865
No log	10.0444	452	0.6370	0.7593	0.6370	0.7981
No log	10.0889	454	0.6787	0.7413	0.6787	0.8238
No log	10.1333	456	0.6947	0.7027	0.6947	0.8335
No log	10.1778	458	0.6606	0.7239	0.6606	0.8128
No log	10.2222	460	0.6464	0.7090	0.6464	0.8040
No log	10.2667	462	0.6190	0.7074	0.6190	0.7868
No log	10.3111	464	0.6250	0.6954	0.6250	0.7906
No log	10.3556	466	0.6288	0.6548	0.6288	0.7930
No log	10.4	468	0.6585	0.6589	0.6585	0.8115
No log	10.4444	470	0.6837	0.6534	0.6837	0.8268
No log	10.4889	472	0.7032	0.6372	0.7032	0.8386
No log	10.5333	474	0.6733	0.6470	0.6733	0.8206
No log	10.5778	476	0.5946	0.7460	0.5946	0.7711
No log	10.6222	478	0.6200	0.7310	0.6200	0.7874
No log	10.6667	480	0.7136	0.6867	0.7136	0.8447
No log	10.7111	482	0.7199	0.6616	0.7199	0.8485
No log	10.7556	484	0.6562	0.6862	0.6562	0.8101
No log	10.8	486	0.6010	0.7358	0.6010	0.7752
No log	10.8444	488	0.6007	0.7292	0.6007	0.7750
No log	10.8889	490	0.6118	0.7412	0.6118	0.7822
No log	10.9333	492	0.6109	0.7164	0.6109	0.7816
No log	10.9778	494	0.6285	0.6928	0.6285	0.7928
No log	11.0222	496	0.7130	0.6563	0.7130	0.8444
No log	11.0667	498	0.7356	0.6765	0.7356	0.8577
0.4165	11.1111	500	0.6852	0.6882	0.6852	0.8278
0.4165	11.1556	502	0.6371	0.7032	0.6371	0.7982
0.4165	11.2	504	0.6078	0.7269	0.6078	0.7796
0.4165	11.2444	506	0.6067	0.7130	0.6067	0.7789
0.4165	11.2889	508	0.6502	0.6825	0.6502	0.8064
0.4165	11.3333	510	0.6813	0.6561	0.6813	0.8254
0.4165	11.3778	512	0.6876	0.6603	0.6876	0.8292
0.4165	11.4222	514	0.6213	0.7038	0.6213	0.7882
0.4165	11.4667	516	0.5909	0.7156	0.5909	0.7687
0.4165	11.5111	518	0.5876	0.7229	0.5876	0.7666
0.4165	11.5556	520	0.5967	0.7133	0.5967	0.7725
0.4165	11.6	522	0.5666	0.7308	0.5666	0.7527
0.4165	11.6444	524	0.5584	0.7473	0.5584	0.7473
0.4165	11.6889	526	0.5748	0.7409	0.5748	0.7581
0.4165	11.7333	528	0.5772	0.7483	0.5772	0.7597
0.4165	11.7778	530	0.6076	0.6755	0.6076	0.7795
0.4165	11.8222	532	0.6827	0.6768	0.6827	0.8263
0.4165	11.8667	534	0.6856	0.6904	0.6856	0.8280
0.4165	11.9111	536	0.6338	0.7239	0.6338	0.7961
0.4165	11.9556	538	0.5861	0.7454	0.5861	0.7655
0.4165	12.0	540	0.5677	0.7492	0.5677	0.7534
0.4165	12.0444	542	0.5678	0.7468	0.5678	0.7535
0.4165	12.0889	544	0.5833	0.7253	0.5833	0.7637
0.4165	12.1333	546	0.5819	0.7229	0.5819	0.7628
0.4165	12.1778	548	0.5766	0.7309	0.5766	0.7593
0.4165	12.2222	550	0.5743	0.7260	0.5743	0.7578
0.4165	12.2667	552	0.5821	0.7164	0.5821	0.7630
0.4165	12.3111	554	0.6132	0.6859	0.6132	0.7831
0.4165	12.3556	556	0.6550	0.6948	0.6550	0.8093
0.4165	12.4	558	0.6763	0.7037	0.6763	0.8224
0.4165	12.4444	560	0.6397	0.7068	0.6397	0.7998
0.4165	12.4889	562	0.6100	0.7062	0.6100	0.7810
0.4165	12.5333	564	0.5809	0.7220	0.5809	0.7622
0.4165	12.5778	566	0.5870	0.7308	0.5870	0.7662
0.4165	12.6222	568	0.5976	0.7217	0.5976	0.7731
0.4165	12.6667	570	0.6079	0.6973	0.6079	0.7797
0.4165	12.7111	572	0.6819	0.6775	0.6819	0.8257
0.4165	12.7556	574	0.7103	0.7015	0.7103	0.8428
0.4165	12.8	576	0.6758	0.7080	0.6758	0.8221
0.4165	12.8444	578	0.6081	0.7876	0.6081	0.7798
0.4165	12.8889	580	0.6127	0.7178	0.6127	0.7828
0.4165	12.9333	582	0.6883	0.6887	0.6883	0.8297
0.4165	12.9778	584	0.6730	0.6785	0.6730	0.8204
0.4165	13.0222	586	0.6018	0.7273	0.6018	0.7758
0.4165	13.0667	588	0.6080	0.7015	0.6080	0.7797
0.4165	13.1111	590	0.6562	0.6653	0.6562	0.8101
0.4165	13.1556	592	0.6914	0.6390	0.6914	0.8315
0.4165	13.2	594	0.7152	0.6443	0.7152	0.8457
0.4165	13.2444	596	0.7053	0.6715	0.7053	0.8398
0.4165	13.2889	598	0.7154	0.6810	0.7154	0.8458

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1