ArabicNewSplits8_usingWellWrittenEssays_FineTuningAraBERT_run3_AugV5_k18_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.8560
• Qwk: 0.5987
• Mse: 0.8560
• Rmse: 0.9252

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0227	2	5.4079	-0.0328	5.4079	2.3255
No log	0.0455	4	3.2515	0.0513	3.2515	1.8032
No log	0.0682	6	2.5613	-0.1467	2.5613	1.6004
No log	0.0909	8	2.9198	-0.1177	2.9198	1.7087
No log	0.1136	10	2.0352	-0.0999	2.0352	1.4266
No log	0.1364	12	1.3576	0.0690	1.3576	1.1652
No log	0.1591	14	1.1862	0.1747	1.1862	1.0891
No log	0.1818	16	1.2008	0.2038	1.2008	1.0958
No log	0.2045	18	1.2217	0.2121	1.2217	1.1053
No log	0.2273	20	1.1886	0.1887	1.1886	1.0902
No log	0.25	22	1.1400	0.2120	1.1400	1.0677
No log	0.2727	24	1.1028	0.2533	1.1028	1.0501
No log	0.2955	26	1.1191	0.3672	1.1191	1.0579
No log	0.3182	28	1.1239	0.3596	1.1239	1.0601
No log	0.3409	30	1.1404	0.3771	1.1404	1.0679
No log	0.3636	32	1.1150	0.3796	1.1150	1.0560
No log	0.3864	34	1.0899	0.3720	1.0899	1.0440
No log	0.4091	36	1.1281	0.3567	1.1281	1.0621
No log	0.4318	38	1.0783	0.3546	1.0783	1.0384
No log	0.4545	40	1.0635	0.3216	1.0635	1.0313
No log	0.4773	42	1.0124	0.4055	1.0124	1.0062
No log	0.5	44	1.0906	0.3489	1.0906	1.0443
No log	0.5227	46	1.3276	0.2536	1.3276	1.1522
No log	0.5455	48	1.3316	0.3185	1.3316	1.1539
No log	0.5682	50	1.3175	0.3571	1.3175	1.1478
No log	0.5909	52	0.9907	0.4163	0.9907	0.9953
No log	0.6136	54	0.8967	0.3856	0.8967	0.9469
No log	0.6364	56	1.1966	0.1843	1.1966	1.0939
No log	0.6591	58	1.3996	0.0782	1.3996	1.1830
No log	0.6818	60	1.4025	0.1531	1.4025	1.1843
No log	0.7045	62	1.3815	0.2312	1.3815	1.1754
No log	0.7273	64	1.2365	0.3309	1.2365	1.1120
No log	0.75	66	1.2859	0.3178	1.2859	1.1340
No log	0.7727	68	1.3093	0.3175	1.3093	1.1442
No log	0.7955	70	1.3463	0.3288	1.3463	1.1603
No log	0.8182	72	1.4607	0.2226	1.4607	1.2086
No log	0.8409	74	1.4820	0.2398	1.4820	1.2174
No log	0.8636	76	1.2842	0.1341	1.2842	1.1332
No log	0.8864	78	1.0843	0.3052	1.0843	1.0413
No log	0.9091	80	1.1270	0.4488	1.1270	1.0616
No log	0.9318	82	1.2116	0.4276	1.2116	1.1007
No log	0.9545	84	1.2988	0.3703	1.2988	1.1396
No log	0.9773	86	1.3662	0.3542	1.3662	1.1688
No log	1.0	88	1.3070	0.3611	1.3070	1.1433
No log	1.0227	90	1.2984	0.3593	1.2984	1.1395
No log	1.0455	92	1.1110	0.4730	1.1110	1.0541
No log	1.0682	94	0.9411	0.4963	0.9411	0.9701
No log	1.0909	96	0.9302	0.4580	0.9302	0.9645
No log	1.1136	98	0.9759	0.4811	0.9759	0.9879
No log	1.1364	100	1.1558	0.4026	1.1558	1.0751
No log	1.1591	102	1.3030	0.3777	1.3030	1.1415
No log	1.1818	104	1.3831	0.2966	1.3831	1.1761
No log	1.2045	106	1.2317	0.3548	1.2317	1.1098
No log	1.2273	108	1.0379	0.4760	1.0379	1.0188
No log	1.25	110	0.8902	0.5550	0.8902	0.9435
No log	1.2727	112	0.9011	0.5455	0.9011	0.9492
No log	1.2955	114	1.0035	0.5104	1.0035	1.0017
No log	1.3182	116	0.9861	0.5210	0.9861	0.9930
No log	1.3409	118	0.9376	0.5227	0.9376	0.9683
No log	1.3636	120	1.0253	0.4964	1.0253	1.0126
No log	1.3864	122	0.9157	0.5770	0.9157	0.9569
No log	1.4091	124	0.8870	0.5755	0.8870	0.9418
No log	1.4318	126	0.9997	0.5111	0.9997	0.9999
No log	1.4545	128	1.0889	0.4875	1.0889	1.0435
No log	1.4773	130	1.2022	0.4444	1.2022	1.0964
No log	1.5	132	1.3032	0.4464	1.3032	1.1416
No log	1.5227	134	1.4746	0.4062	1.4746	1.2143
No log	1.5455	136	1.3922	0.4141	1.3922	1.1799
No log	1.5682	138	1.1205	0.5077	1.1205	1.0585
No log	1.5909	140	0.9411	0.5892	0.9411	0.9701
No log	1.6136	142	0.8008	0.6243	0.8008	0.8949
No log	1.6364	144	0.8003	0.6213	0.8003	0.8946
No log	1.6591	146	0.9327	0.5861	0.9327	0.9657
No log	1.6818	148	0.9744	0.5872	0.9744	0.9871
No log	1.7045	150	0.9295	0.5849	0.9295	0.9641
No log	1.7273	152	0.9376	0.5613	0.9376	0.9683
No log	1.75	154	0.9858	0.5655	0.9858	0.9929
No log	1.7727	156	0.8994	0.5898	0.8994	0.9484
No log	1.7955	158	0.8093	0.6198	0.8093	0.8996
No log	1.8182	160	0.8028	0.6639	0.8028	0.8960
No log	1.8409	162	0.9927	0.5624	0.9927	0.9964
No log	1.8636	164	1.3959	0.4209	1.3959	1.1815
No log	1.8864	166	1.5506	0.3920	1.5506	1.2452
No log	1.9091	168	1.2273	0.4969	1.2273	1.1078
No log	1.9318	170	0.7966	0.6487	0.7966	0.8925
No log	1.9545	172	0.6861	0.6416	0.6861	0.8283
No log	1.9773	174	0.7719	0.6555	0.7719	0.8786
No log	2.0	176	1.1746	0.4940	1.1746	1.0838
No log	2.0227	178	1.3116	0.4485	1.3116	1.1453
No log	2.0455	180	1.1576	0.4842	1.1576	1.0759
No log	2.0682	182	0.8456	0.6277	0.8456	0.9195
No log	2.0909	184	0.7869	0.6385	0.7869	0.8871
No log	2.1136	186	0.7410	0.6242	0.7410	0.8608
No log	2.1364	188	0.6815	0.6258	0.6815	0.8255
No log	2.1591	190	0.6549	0.6325	0.6549	0.8092
No log	2.1818	192	0.7095	0.6414	0.7095	0.8423
No log	2.2045	194	0.8696	0.6409	0.8696	0.9325
No log	2.2273	196	0.9858	0.5608	0.9858	0.9929
No log	2.25	198	1.0217	0.5508	1.0217	1.0108
No log	2.2727	200	1.1419	0.4638	1.1419	1.0686
No log	2.2955	202	1.2412	0.4538	1.2412	1.1141
No log	2.3182	204	1.2575	0.4431	1.2575	1.1214
No log	2.3409	206	1.3040	0.4296	1.3040	1.1419
No log	2.3636	208	1.3459	0.4315	1.3459	1.1601
No log	2.3864	210	1.3834	0.4347	1.3834	1.1762
No log	2.4091	212	1.3071	0.4131	1.3071	1.1433
No log	2.4318	214	1.0131	0.5487	1.0131	1.0065
No log	2.4545	216	0.7963	0.6148	0.7963	0.8923
No log	2.4773	218	0.7557	0.6468	0.7557	0.8693
No log	2.5	220	0.7437	0.6468	0.7437	0.8624
No log	2.5227	222	0.8767	0.5911	0.8767	0.9363
No log	2.5455	224	0.8660	0.5683	0.8660	0.9306
No log	2.5682	226	0.8039	0.6158	0.8039	0.8966
No log	2.5909	228	0.8194	0.6341	0.8194	0.9052
No log	2.6136	230	0.8426	0.6429	0.8426	0.9179
No log	2.6364	232	0.9356	0.6280	0.9356	0.9673
No log	2.6591	234	0.9334	0.6296	0.9334	0.9661
No log	2.6818	236	0.9115	0.6280	0.9115	0.9547
No log	2.7045	238	0.9509	0.6098	0.9509	0.9752
No log	2.7273	240	0.8466	0.6526	0.8466	0.9201
No log	2.75	242	0.7961	0.6618	0.7961	0.8922
No log	2.7727	244	0.6971	0.6725	0.6971	0.8350
No log	2.7955	246	0.6515	0.6793	0.6515	0.8072
No log	2.8182	248	0.6640	0.6881	0.6640	0.8148
No log	2.8409	250	0.7982	0.6603	0.7982	0.8934
No log	2.8636	252	1.0345	0.5210	1.0345	1.0171
No log	2.8864	254	1.0485	0.4968	1.0485	1.0240
No log	2.9091	256	0.8874	0.6148	0.8874	0.9420
No log	2.9318	258	0.7269	0.6455	0.7269	0.8526
No log	2.9545	260	0.7025	0.6530	0.7025	0.8382
No log	2.9773	262	0.8315	0.6497	0.8315	0.9119
No log	3.0	264	1.0264	0.5314	1.0264	1.0131
No log	3.0227	266	1.0724	0.5417	1.0724	1.0355
No log	3.0455	268	0.9503	0.5933	0.9503	0.9748
No log	3.0682	270	0.8963	0.5911	0.8963	0.9468
No log	3.0909	272	0.8869	0.6095	0.8869	0.9418
No log	3.1136	274	0.9390	0.5841	0.9390	0.9690
No log	3.1364	276	0.8693	0.6135	0.8693	0.9324
No log	3.1591	278	0.7457	0.6530	0.7457	0.8636
No log	3.1818	280	0.6624	0.6663	0.6624	0.8139
No log	3.2045	282	0.6635	0.6633	0.6635	0.8146
No log	3.2273	284	0.7765	0.6468	0.7765	0.8812
No log	3.25	286	1.0061	0.5562	1.0061	1.0030
No log	3.2727	288	1.0736	0.5408	1.0736	1.0361
No log	3.2955	290	0.9570	0.5806	0.9570	0.9783
No log	3.3182	292	0.8155	0.6280	0.8155	0.9031
No log	3.3409	294	0.8347	0.6286	0.8347	0.9136
No log	3.3636	296	0.9082	0.5855	0.9082	0.9530
No log	3.3864	298	0.8471	0.6274	0.8471	0.9204
No log	3.4091	300	0.7744	0.6219	0.7744	0.8800
No log	3.4318	302	0.8041	0.6535	0.8041	0.8967
No log	3.4545	304	0.8914	0.6148	0.8914	0.9442
No log	3.4773	306	0.9636	0.6077	0.9636	0.9816
No log	3.5	308	0.8783	0.6269	0.8783	0.9372
No log	3.5227	310	0.7897	0.6408	0.7897	0.8886
No log	3.5455	312	0.7899	0.6471	0.7899	0.8887
No log	3.5682	314	0.8639	0.6143	0.8639	0.9295
No log	3.5909	316	0.9074	0.6079	0.9074	0.9526
No log	3.6136	318	0.8659	0.6109	0.8659	0.9305
No log	3.6364	320	0.7928	0.6372	0.7928	0.8904
No log	3.6591	322	0.7747	0.6508	0.7747	0.8802
No log	3.6818	324	0.7419	0.6261	0.7419	0.8613
No log	3.7045	326	0.7992	0.6109	0.7992	0.8940
No log	3.7273	328	0.8867	0.6129	0.8867	0.9416
No log	3.75	330	0.8966	0.6115	0.8966	0.9469
No log	3.7727	332	0.8708	0.6231	0.8708	0.9331
No log	3.7955	334	0.8308	0.6487	0.8308	0.9115
No log	3.8182	336	0.8484	0.6504	0.8484	0.9211
No log	3.8409	338	0.8167	0.6395	0.8167	0.9037
No log	3.8636	340	0.7764	0.6578	0.7764	0.8812
No log	3.8864	342	0.7160	0.6555	0.7160	0.8462
No log	3.9091	344	0.7619	0.6539	0.7619	0.8729
No log	3.9318	346	0.7948	0.6536	0.7948	0.8915
No log	3.9545	348	0.7665	0.6448	0.7665	0.8755
No log	3.9773	350	0.7779	0.6469	0.7779	0.8820
No log	4.0	352	0.8054	0.6526	0.8054	0.8974
No log	4.0227	354	0.7454	0.6442	0.7454	0.8634
No log	4.0455	356	0.6533	0.6505	0.6533	0.8083
No log	4.0682	358	0.6502	0.6533	0.6502	0.8064
No log	4.0909	360	0.6795	0.6705	0.6795	0.8243
No log	4.1136	362	0.7602	0.6502	0.7602	0.8719
No log	4.1364	364	0.7834	0.6477	0.7834	0.8851
No log	4.1591	366	0.8125	0.6497	0.8125	0.9014
No log	4.1818	368	0.7244	0.6637	0.7244	0.8511
No log	4.2045	370	0.7419	0.6628	0.7419	0.8613
No log	4.2273	372	0.7472	0.6529	0.7472	0.8644
No log	4.25	374	0.7438	0.6461	0.7438	0.8624
No log	4.2727	376	0.7062	0.6792	0.7062	0.8404
No log	4.2955	378	0.8154	0.6320	0.8154	0.9030
No log	4.3182	380	0.9308	0.5891	0.9308	0.9648
No log	4.3409	382	0.9011	0.6174	0.9011	0.9493
No log	4.3636	384	0.9015	0.6242	0.9015	0.9495
No log	4.3864	386	1.0031	0.5908	1.0031	1.0015
No log	4.4091	388	1.0697	0.5569	1.0697	1.0343
No log	4.4318	390	0.9672	0.5957	0.9672	0.9835
No log	4.4545	392	0.8173	0.6582	0.8173	0.9040
No log	4.4773	394	0.7922	0.6667	0.7922	0.8901
No log	4.5	396	0.9063	0.6010	0.9063	0.9520
No log	4.5227	398	1.0378	0.5501	1.0378	1.0187
No log	4.5455	400	0.9567	0.5939	0.9567	0.9781
No log	4.5682	402	0.8649	0.6296	0.8649	0.9300
No log	4.5909	404	0.7310	0.6458	0.7310	0.8550
No log	4.6136	406	0.7584	0.6585	0.7584	0.8708
No log	4.6364	408	0.8752	0.5957	0.8752	0.9355
No log	4.6591	410	0.9741	0.5591	0.9741	0.9870
No log	4.6818	412	0.8901	0.5828	0.8901	0.9434
No log	4.7045	414	0.7680	0.6695	0.7680	0.8764
No log	4.7273	416	0.7666	0.6705	0.7666	0.8756
No log	4.75	418	0.9048	0.5879	0.9048	0.9512
No log	4.7727	420	1.1266	0.4911	1.1266	1.0614
No log	4.7955	422	1.0965	0.4976	1.0965	1.0471
No log	4.8182	424	0.9801	0.5375	0.9801	0.9900
No log	4.8409	426	1.0405	0.5415	1.0405	1.0200
No log	4.8636	428	1.0208	0.5415	1.0208	1.0103
No log	4.8864	430	0.9323	0.5825	0.9323	0.9656
No log	4.9091	432	0.7639	0.675	0.7639	0.8740
No log	4.9318	434	0.7193	0.6740	0.7193	0.8481
No log	4.9545	436	0.7837	0.6601	0.7837	0.8853
No log	4.9773	438	0.9190	0.5696	0.9190	0.9586
No log	5.0	440	0.9385	0.5696	0.9385	0.9688
No log	5.0227	442	0.9337	0.5696	0.9337	0.9663
No log	5.0455	444	0.9708	0.5578	0.9708	0.9853
No log	5.0682	446	0.9171	0.5805	0.9171	0.9577
No log	5.0909	448	0.7909	0.6440	0.7909	0.8893
No log	5.1136	450	0.8311	0.6495	0.8311	0.9116
No log	5.1364	452	1.1075	0.5815	1.1075	1.0524
No log	5.1591	454	1.3902	0.5604	1.3902	1.1790
No log	5.1818	456	1.5227	0.4994	1.5227	1.2340
No log	5.2045	458	1.4060	0.4731	1.4060	1.1858
No log	5.2273	460	1.1126	0.4981	1.1126	1.0548
No log	5.25	462	0.9469	0.6237	0.9469	0.9731
No log	5.2727	464	0.9704	0.6237	0.9704	0.9851
No log	5.2955	466	1.1426	0.4754	1.1426	1.0689
No log	5.3182	468	1.4921	0.4016	1.4921	1.2215
No log	5.3409	470	1.7385	0.3637	1.7385	1.3185
No log	5.3636	472	1.6306	0.3954	1.6306	1.2770
No log	5.3864	474	1.3151	0.4622	1.3151	1.1468
No log	5.4091	476	1.0359	0.5355	1.0359	1.0178
No log	5.4318	478	0.9228	0.5694	0.9228	0.9606
No log	5.4545	480	0.9490	0.5863	0.9490	0.9742
No log	5.4773	482	1.0722	0.4974	1.0722	1.0355
No log	5.5	484	1.0933	0.5002	1.0933	1.0456
No log	5.5227	486	1.0793	0.5092	1.0793	1.0389
No log	5.5455	488	1.1090	0.5092	1.1090	1.0531
No log	5.5682	490	0.9714	0.5453	0.9714	0.9856
No log	5.5909	492	0.7807	0.6532	0.7807	0.8836
No log	5.6136	494	0.7625	0.6567	0.7625	0.8732
No log	5.6364	496	0.8261	0.6175	0.8261	0.9089
No log	5.6591	498	0.8687	0.5851	0.8687	0.9321
0.4177	5.6818	500	0.8680	0.6025	0.8680	0.9316
0.4177	5.7045	502	0.8806	0.6134	0.8806	0.9384
0.4177	5.7273	504	0.9185	0.5802	0.9185	0.9584
0.4177	5.75	506	0.8495	0.6063	0.8495	0.9217
0.4177	5.7727	508	0.7089	0.6355	0.7089	0.8420
0.4177	5.7955	510	0.6669	0.6603	0.6669	0.8167
0.4177	5.8182	512	0.6960	0.6472	0.6960	0.8342
0.4177	5.8409	514	0.7951	0.6408	0.7951	0.8917
0.4177	5.8636	516	0.8472	0.6335	0.8472	0.9204
0.4177	5.8864	518	0.8080	0.6474	0.8080	0.8989
0.4177	5.9091	520	0.7492	0.6476	0.7492	0.8656
0.4177	5.9318	522	0.7323	0.6360	0.7323	0.8557
0.4177	5.9545	524	0.7602	0.6337	0.7602	0.8719
0.4177	5.9773	526	0.7953	0.6106	0.7953	0.8918
0.4177	6.0	528	0.8135	0.5962	0.8135	0.9019
0.4177	6.0227	530	0.7599	0.6351	0.7599	0.8717
0.4177	6.0455	532	0.6378	0.6776	0.6378	0.7986
0.4177	6.0682	534	0.5869	0.7128	0.5869	0.7661
0.4177	6.0909	536	0.5975	0.7051	0.5975	0.7730
0.4177	6.1136	538	0.6656	0.6555	0.6656	0.8159
0.4177	6.1364	540	0.7541	0.6011	0.7541	0.8684
0.4177	6.1591	542	0.9163	0.5983	0.9163	0.9573
0.4177	6.1818	544	1.0202	0.5311	1.0202	1.0100
0.4177	6.2045	546	0.9166	0.5957	0.9166	0.9574
0.4177	6.2273	548	0.7497	0.6440	0.7497	0.8659
0.4177	6.25	550	0.6972	0.6485	0.6972	0.8350
0.4177	6.2727	552	0.7361	0.6213	0.7361	0.8580
0.4177	6.2955	554	0.8559	0.6130	0.8559	0.9252
0.4177	6.3182	556	0.9420	0.5530	0.9420	0.9705
0.4177	6.3409	558	0.9546	0.5463	0.9546	0.9770
0.4177	6.3636	560	0.8454	0.6459	0.8454	0.9195
0.4177	6.3864	562	0.7897	0.6696	0.7897	0.8887
0.4177	6.4091	564	0.8604	0.6193	0.8604	0.9276
0.4177	6.4318	566	0.9728	0.5374	0.9728	0.9863
0.4177	6.4545	568	0.9562	0.5510	0.9562	0.9779
0.4177	6.4773	570	0.8649	0.6215	0.8649	0.9300
0.4177	6.5	572	0.8267	0.6639	0.8267	0.9092
0.4177	6.5227	574	0.8272	0.6544	0.8272	0.9095
0.4177	6.5455	576	0.8357	0.6515	0.8357	0.9142
0.4177	6.5682	578	0.9143	0.6196	0.9143	0.9562
0.4177	6.5909	580	0.9670	0.6098	0.9670	0.9834
0.4177	6.6136	582	0.8679	0.6280	0.8679	0.9316
0.4177	6.6364	584	0.7024	0.6666	0.7024	0.8381
0.4177	6.6591	586	0.6680	0.6744	0.6680	0.8173
0.4177	6.6818	588	0.7698	0.6802	0.7698	0.8774
0.4177	6.7045	590	0.9445	0.5945	0.9445	0.9719
0.4177	6.7273	592	1.0088	0.5355	1.0088	1.0044
0.4177	6.75	594	0.9627	0.5767	0.9627	0.9812
0.4177	6.7727	596	0.7882	0.6678	0.7882	0.8878
0.4177	6.7955	598	0.7650	0.6438	0.7650	0.8746
0.4177	6.8182	600	0.8785	0.6220	0.8785	0.9373
0.4177	6.8409	602	0.8681	0.6220	0.8681	0.9317
0.4177	6.8636	604	0.7999	0.6540	0.7999	0.8944
0.4177	6.8864	606	0.7533	0.6618	0.7533	0.8679
0.4177	6.9091	608	0.7939	0.6219	0.7939	0.8910
0.4177	6.9318	610	0.8771	0.6248	0.8771	0.9365
0.4177	6.9545	612	0.9215	0.6221	0.9215	0.9599
0.4177	6.9773	614	0.8160	0.6421	0.8160	0.9033
0.4177	7.0	616	0.7291	0.6772	0.7291	0.8539
0.4177	7.0227	618	0.7018	0.6887	0.7018	0.8377
0.4177	7.0455	620	0.7530	0.6772	0.7530	0.8678
0.4177	7.0682	622	0.9044	0.6211	0.9044	0.9510
0.4177	7.0909	624	1.1654	0.5364	1.1654	1.0795
0.4177	7.1136	626	1.3049	0.5174	1.3049	1.1423
0.4177	7.1364	628	1.2257	0.5225	1.2257	1.1071
0.4177	7.1591	630	1.0412	0.5502	1.0412	1.0204
0.4177	7.1818	632	0.8215	0.6648	0.8215	0.9063
0.4177	7.2045	634	0.6940	0.6853	0.6940	0.8330
0.4177	7.2273	636	0.6722	0.6765	0.6722	0.8199
0.4177	7.25	638	0.7744	0.6619	0.7744	0.8800
0.4177	7.2727	640	0.9673	0.5914	0.9673	0.9835
0.4177	7.2955	642	1.1775	0.5228	1.1775	1.0851
0.4177	7.3182	644	1.1685	0.5228	1.1685	1.0810
0.4177	7.3409	646	1.0389	0.5342	1.0389	1.0193
0.4177	7.3636	648	0.8560	0.5987	0.8560	0.9252

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1