GIST-small-en-domain-classifier

A fine-tuned version of the bert architecture (BertForSequenceClassification) optimized for the text-classification task.

• Model type: bert
• Problem Type: single_label_classification
• Number of Labels: 26
• Vocabulary Size: 30522
• License: MIT

Use

To get started with this model in Python using the Hugging Face Transformers library, run the following code:

from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch

model_id = "agentlans/GIST-small-en-domain-classifier"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForSequenceClassification.from_pretrained(model_id)

text = "Replace this with your input text."
inputs = tokenizer(text, return_tensors="pt")

with torch.no_grad():
    logits = model(**inputs).logits

predicted_class_id = logits.argmax().item()
predicted_class_name = model.config.id2label[predicted_class_id]

print(f"Predicted Class ID: {predicted_class_id}")
print(f"Predicted Class Name: {predicted_class_name}")

Intended Uses & Limitations

Intended Use

This model is designed for sequence classification tasks. Below are the specific class labels mapped to their corresponding IDs:

Label ID	Label Name
0	Adult
1	Arts_and_Entertainment
2	Autos_and_Vehicles
3	Beauty_and_Fitness
4	Books_and_Literature
5	Business_and_Industrial
6	Computers_and_Electronics
7	Finance
8	Food_and_Drink
9	Games
10	Health
11	Hobbies_and_Leisure
12	Home_and_Garden
13	Internet_and_Telecom
14	Jobs_and_Education
15	Law_and_Government
16	News
17	Online_Communities
18	People_and_Society
19	Pets_and_Animals
20	Real_Estate
21	Science
22	Sensitive_Subjects
23	Shopping
24	Sports
25	Travel_and_Transportation

Training Details

Hyperparameters

The following hyperparameters were used during fine-tuning:

• Learning Rate: 5e-05
• Train Batch Size: 8
• Eval Batch Size: 8
• Optimizer: OptimizerNames.ADAMW_TORCH_FUSED
• Number of Epochs: 3.0
• Mixed Precision: BF16

Show Advanced Training Configuration

Optimization & Regularization

• Gradient Accumulation Steps: 1
• Learning Rate Scheduler: SchedulerType.LINEAR
• Warmup Steps: 0
• Warmup Ratio: None
• Weight Decay: 0.0
• Max Gradient Norm: 1.0

Hardware & Reproducibility

• Number of GPUs: 1
• Seed: 42

Training Results & Evaluation

During fine-tuning, the model achieved the following results on the evaluation set:

Metric	Value
Train Loss	0.4828
Validation Loss	0.604
Validation F1 Score	0.8488
Total FLOPs	3.9541e+16

Click here for detailed performance metrics on the test set.

Speed Performance

• Training Runtime: 5171.9832 seconds
• Train Samples per Second: 464.039
• Evaluation Runtime: 56.3341 seconds
• Eval Samples per Second: 1775.159

Show Detailed Training Logs

Training Logs History

Step	Epoch	Learning Rate	Training Loss	Validation Loss	Validation F1
500	0.005	4.9917e-05	2.4297	N/A	N/A
1000	0.01	4.9833e-05	1.579	N/A	N/A
1500	0.015	4.9750e-05	1.2235	N/A	N/A
2000	0.02	4.9667e-05	1.0655	N/A	N/A
2500	0.025	4.9584e-05	0.959	N/A	N/A
3000	0.03	4.9500e-05	0.9037	N/A	N/A
3500	0.035	4.9417e-05	0.8382	N/A	N/A
4000	0.04	4.9334e-05	0.8475	N/A	N/A
4500	0.045	4.9250e-05	0.7914	N/A	N/A
5000	0.05	4.9167e-05	0.816	N/A	N/A
5500	0.055	4.9084e-05	0.7864	N/A	N/A
6000	0.06	4.9000e-05	0.793	N/A	N/A
6500	0.065	4.8917e-05	0.78	N/A	N/A
7000	0.07	4.8834e-05	0.7597	N/A	N/A
7500	0.075	4.8750e-05	0.6943	N/A	N/A
8000	0.08	4.8667e-05	0.7981	N/A	N/A
8500	0.085	4.8584e-05	0.7573	N/A	N/A
9000	0.09	4.8500e-05	0.7047	N/A	N/A
9500	0.095	4.8417e-05	0.7318	N/A	N/A
10000	0.1	4.8334e-05	0.736	N/A	N/A
10500	0.105	4.8250e-05	0.7452	N/A	N/A
11000	0.11	4.8167e-05	0.7773	N/A	N/A
11500	0.115	4.8084e-05	0.7411	N/A	N/A
12000	0.12	4.8000e-05	0.7179	N/A	N/A
12500	0.125	4.7917e-05	0.7291	N/A	N/A
13000	0.13	4.7834e-05	0.7052	N/A	N/A
13500	0.135	4.7750e-05	0.7597	N/A	N/A
14000	0.14	4.7667e-05	0.6868	N/A	N/A
14500	0.145	4.7584e-05	0.7308	N/A	N/A
15000	0.15	4.7500e-05	0.7156	N/A	N/A
15500	0.155	4.7417e-05	0.6928	N/A	N/A
16000	0.16	4.7334e-05	0.6625	N/A	N/A
16500	0.165	4.7250e-05	0.6918	N/A	N/A
17000	0.17	4.7167e-05	0.7503	N/A	N/A
17500	0.175	4.7084e-05	0.6618	N/A	N/A
18000	0.18	4.7000e-05	0.7061	N/A	N/A
18500	0.185	4.6917e-05	0.708	N/A	N/A
19000	0.19	4.6834e-05	0.6947	N/A	N/A
19500	0.195	4.6750e-05	0.6782	N/A	N/A
20000	0.2	4.6667e-05	0.7005	N/A	N/A
20500	0.205	4.6583e-05	0.6967	N/A	N/A
21000	0.21	4.6500e-05	0.6531	N/A	N/A
21500	0.215	4.6417e-05	0.6621	N/A	N/A
22000	0.22	4.6333e-05	0.6503	N/A	N/A
22500	0.225	4.6250e-05	0.671	N/A	N/A
23000	0.23	4.6167e-05	0.6813	N/A	N/A
23500	0.235	4.6084e-05	0.6479	N/A	N/A
24000	0.24	4.6000e-05	0.6733	N/A	N/A
24500	0.245	4.5917e-05	0.6658	N/A	N/A
25000	0.25	4.5834e-05	0.6281	N/A	N/A
25500	0.255	4.5750e-05	0.6948	N/A	N/A
26000	0.26	4.5667e-05	0.6661	N/A	N/A
26500	0.265	4.5584e-05	0.6705	N/A	N/A
27000	0.27	4.5500e-05	0.6796	N/A	N/A
27500	0.275	4.5417e-05	0.681	N/A	N/A
28000	0.28	4.5334e-05	0.6765	N/A	N/A
28500	0.285	4.5250e-05	0.6147	N/A	N/A
29000	0.29	4.5167e-05	0.6619	N/A	N/A
29500	0.295	4.5084e-05	0.6675	N/A	N/A
30000	0.3	4.5000e-05	0.6696	N/A	N/A
30500	0.305	4.4917e-05	0.6938	N/A	N/A
31000	0.31	4.4834e-05	0.6511	N/A	N/A
31500	0.315	4.4750e-05	0.6564	N/A	N/A
32000	0.32	4.4667e-05	0.6753	N/A	N/A
32500	0.325	4.4583e-05	0.6304	N/A	N/A
33000	0.33	4.4500e-05	0.6513	N/A	N/A
33500	0.335	4.4417e-05	0.6525	N/A	N/A
34000	0.34	4.4333e-05	0.6191	N/A	N/A
34500	0.345	4.4250e-05	0.6476	N/A	N/A
35000	0.35	4.4167e-05	0.6464	N/A	N/A
35500	0.355	4.4083e-05	0.6483	N/A	N/A
36000	0.36	4.4000e-05	0.6822	N/A	N/A
36500	0.365	4.3917e-05	0.6257	N/A	N/A
37000	0.37	4.3833e-05	0.6654	N/A	N/A
37500	0.375	4.3750e-05	0.6338	N/A	N/A
38000	0.38	4.3667e-05	0.6457	N/A	N/A
38500	0.385	4.3584e-05	0.6404	N/A	N/A
39000	0.39	4.3500e-05	0.6238	N/A	N/A
39500	0.395	4.3417e-05	0.6041	N/A	N/A
40000	0.4	4.3334e-05	0.628	N/A	N/A
40500	0.405	4.3250e-05	0.6408	N/A	N/A
41000	0.41	4.3167e-05	0.6448	N/A	N/A
41500	0.415	4.3084e-05	0.6272	N/A	N/A
42000	0.42	4.3000e-05	0.6351	N/A	N/A
42500	0.425	4.2917e-05	0.6371	N/A	N/A
43000	0.43	4.2834e-05	0.6207	N/A	N/A
43500	0.435	4.2750e-05	0.6687	N/A	N/A
44000	0.44	4.2667e-05	0.6305	N/A	N/A
44500	0.445	4.2584e-05	0.6525	N/A	N/A
45000	0.45	4.2500e-05	0.6326	N/A	N/A
45500	0.455	4.2417e-05	0.6328	N/A	N/A
46000	0.46	4.2334e-05	0.6267	N/A	N/A
46500	0.465	4.2250e-05	0.585	N/A	N/A
47000	0.47	4.2167e-05	0.5971	N/A	N/A
47500	0.475	4.2084e-05	0.6254	N/A	N/A
48000	0.48	4.2000e-05	0.6442	N/A	N/A
48500	0.485	4.1917e-05	0.643	N/A	N/A
49000	0.49	4.1834e-05	0.6282	N/A	N/A
49500	0.495	4.1750e-05	0.6421	N/A	N/A
50000	0.5	4.1667e-05	0.5924	N/A	N/A
50500	0.505	4.1584e-05	0.599	N/A	N/A
51000	0.51	4.1500e-05	0.623	N/A	N/A
51500	0.515	4.1417e-05	0.5765	N/A	N/A
52000	0.52	4.1333e-05	0.6535	N/A	N/A
52500	0.525	4.1250e-05	0.5764	N/A	N/A
53000	0.53	4.1167e-05	0.5956	N/A	N/A
53500	0.535	4.1084e-05	0.6031	N/A	N/A
54000	0.54	4.1000e-05	0.6286	N/A	N/A
54500	0.545	4.0917e-05	0.5925	N/A	N/A
55000	0.55	4.0834e-05	0.6238	N/A	N/A
55500	0.555	4.0750e-05	0.5983	N/A	N/A
56000	0.56	4.0667e-05	0.6011	N/A	N/A
56500	0.565	4.0584e-05	0.6055	N/A	N/A
57000	0.57	4.0500e-05	0.6396	N/A	N/A
57500	0.575	4.0417e-05	0.5993	N/A	N/A
58000	0.58	4.0334e-05	0.5753	N/A	N/A
58500	0.585	4.0250e-05	0.5971	N/A	N/A
59000	0.59	4.0167e-05	0.6008	N/A	N/A
59500	0.595	4.0084e-05	0.6157	N/A	N/A
60000	0.6	4.0000e-05	0.586	N/A	N/A
60500	0.605	3.9917e-05	0.5975	N/A	N/A
61000	0.61	3.9834e-05	0.5958	N/A	N/A
61500	0.615	3.9750e-05	0.6024	N/A	N/A
62000	0.62	3.9667e-05	0.5805	N/A	N/A
62500	0.625	3.9583e-05	0.6198	N/A	N/A
63000	0.63	3.9500e-05	0.6045	N/A	N/A
63500	0.635	3.9417e-05	0.5971	N/A	N/A
64000	0.64	3.9333e-05	0.5686	N/A	N/A
64500	0.645	3.9250e-05	0.6418	N/A	N/A
65000	0.65	3.9167e-05	0.6085	N/A	N/A
65500	0.655	3.9083e-05	0.6069	N/A	N/A
66000	0.66	3.9000e-05	0.5735	N/A	N/A
66500	0.665	3.8917e-05	0.5869	N/A	N/A
67000	0.67	3.8834e-05	0.5938	N/A	N/A
67500	0.675	3.8750e-05	0.5869	N/A	N/A
68000	0.68	3.8667e-05	0.554	N/A	N/A
68500	0.685	3.8584e-05	0.6075	N/A	N/A
69000	0.69	3.8500e-05	0.5641	N/A	N/A
69500	0.695	3.8417e-05	0.6009	N/A	N/A
70000	0.7	3.8334e-05	0.5458	N/A	N/A
70500	0.705	3.8250e-05	0.6159	N/A	N/A
71000	0.71	3.8167e-05	0.5752	N/A	N/A
71500	0.715	3.8084e-05	0.6054	N/A	N/A
72000	0.72	3.8000e-05	0.59	N/A	N/A
72500	0.725	3.7917e-05	0.6229	N/A	N/A
73000	0.73	3.7833e-05	0.5686	N/A	N/A
73500	0.735	3.7750e-05	0.5784	N/A	N/A
74000	0.74	3.7667e-05	0.5949	N/A	N/A
74500	0.745	3.7583e-05	0.6286	N/A	N/A
75000	0.75	3.7500e-05	0.574	N/A	N/A
75500	0.755	3.7417e-05	0.5712	N/A	N/A
76000	0.76	3.7333e-05	0.602	N/A	N/A
76500	0.765	3.7250e-05	0.5679	N/A	N/A
77000	0.77	3.7167e-05	0.6188	N/A	N/A
77500	0.775	3.7084e-05	0.604	N/A	N/A
78000	0.78	3.7000e-05	0.5681	N/A	N/A
78500	0.785	3.6917e-05	0.5794	N/A	N/A
79000	0.79	3.6834e-05	0.5896	N/A	N/A
79500	0.795	3.6750e-05	0.5845	N/A	N/A
80000	0.8	3.6667e-05	0.6007	N/A	N/A
80500	0.805	3.6584e-05	0.6064	N/A	N/A
81000	0.81	3.6500e-05	0.5795	N/A	N/A
81500	0.815	3.6417e-05	0.5727	N/A	N/A
82000	0.82	3.6334e-05	0.5741	N/A	N/A
82500	0.825	3.6250e-05	0.6035	N/A	N/A
83000	0.83	3.6167e-05	0.5707	N/A	N/A
83500	0.835	3.6084e-05	0.6064	N/A	N/A
84000	0.84	3.6000e-05	0.5599	N/A	N/A
84500	0.845	3.5917e-05	0.5605	N/A	N/A
85000	0.85	3.5834e-05	0.5787	N/A	N/A
85500	0.855	3.5750e-05	0.6225	N/A	N/A
86000	0.86	3.5667e-05	0.5467	N/A	N/A
86500	0.865	3.5584e-05	0.5883	N/A	N/A
87000	0.87	3.5500e-05	0.57	N/A	N/A
87500	0.875	3.5417e-05	0.5995	N/A	N/A
88000	0.88	3.5334e-05	0.5757	N/A	N/A
88500	0.885	3.5250e-05	0.5465	N/A	N/A
89000	0.89	3.5167e-05	0.6029	N/A	N/A
89500	0.895	3.5084e-05	0.5766	N/A	N/A
90000	0.9	3.5000e-05	0.5659	N/A	N/A
90500	0.905	3.4917e-05	0.5859	N/A	N/A
91000	0.91	3.4834e-05	0.5721	N/A	N/A
91500	0.915	3.4750e-05	0.562	N/A	N/A
92000	0.92	3.4667e-05	0.5628	N/A	N/A
92500	0.925	3.4584e-05	0.5902	N/A	N/A
93000	0.93	3.4500e-05	0.5876	N/A	N/A
93500	0.935	3.4417e-05	0.5694	N/A	N/A
94000	0.94	3.4333e-05	0.5756	N/A	N/A
94500	0.945	3.4250e-05	0.5674	N/A	N/A
95000	0.95	3.4167e-05	0.561	N/A	N/A
95500	0.955	3.4083e-05	0.5723	N/A	N/A
96000	0.96	3.4000e-05	0.5709	N/A	N/A
96500	0.965	3.3917e-05	0.5759	N/A	N/A
97000	0.97	3.3834e-05	0.5684	N/A	N/A
97500	0.975	3.3750e-05	0.5649	N/A	N/A
98000	0.98	3.3667e-05	0.5728	N/A	N/A
98500	0.985	3.3584e-05	0.5603	N/A	N/A
99000	0.99	3.3500e-05	0.5899	N/A	N/A
99500	0.995	3.3417e-05	0.5595	N/A	N/A
100000	1.0	3.3334e-05	0.5802	0.5554	0.8237
100500	1.005	3.3250e-05	0.4723	N/A	N/A
101000	1.01	3.3167e-05	0.4725	N/A	N/A
101500	1.015	3.3084e-05	0.4807	N/A	N/A
102000	1.02	3.3000e-05	0.4402	N/A	N/A
102500	1.025	3.2917e-05	0.4636	N/A	N/A
103000	1.03	3.2834e-05	0.4428	N/A	N/A
103500	1.035	3.2750e-05	0.4789	N/A	N/A
104000	1.04	3.2667e-05	0.4363	N/A	N/A
104500	1.045	3.2583e-05	0.415	N/A	N/A
105000	1.05	3.2500e-05	0.4669	N/A	N/A
105500	1.055	3.2417e-05	0.4834	N/A	N/A
106000	1.06	3.2333e-05	0.4746	N/A	N/A
106500	1.065	3.2250e-05	0.4803	N/A	N/A
107000	1.07	3.2167e-05	0.4415	N/A	N/A
107500	1.075	3.2083e-05	0.4869	N/A	N/A
108000	1.08	3.2000e-05	0.4695	N/A	N/A
108500	1.085	3.1917e-05	0.4558	N/A	N/A
109000	1.09	3.1833e-05	0.4493	N/A	N/A
109500	1.095	3.1750e-05	0.4536	N/A	N/A
110000	1.1	3.1667e-05	0.4869	N/A	N/A
110500	1.105	3.1584e-05	0.472	N/A	N/A
111000	1.11	3.1500e-05	0.4622	N/A	N/A
111500	1.115	3.1417e-05	0.4644	N/A	N/A
112000	1.12	3.1334e-05	0.4766	N/A	N/A
112500	1.125	3.1250e-05	0.481	N/A	N/A
113000	1.13	3.1167e-05	0.4574	N/A	N/A
113500	1.135	3.1084e-05	0.4496	N/A	N/A
114000	1.14	3.1000e-05	0.4661	N/A	N/A
114500	1.145	3.0917e-05	0.4606	N/A	N/A
115000	1.15	3.0834e-05	0.4975	N/A	N/A
115500	1.155	3.0750e-05	0.4758	N/A	N/A
116000	1.16	3.0667e-05	0.4386	N/A	N/A
116500	1.165	3.0584e-05	0.4625	N/A	N/A
117000	1.17	3.0500e-05	0.4575	N/A	N/A
117500	1.175	3.0417e-05	0.4696	N/A	N/A
118000	1.18	3.0334e-05	0.4554	N/A	N/A
118500	1.185	3.0250e-05	0.469	N/A	N/A
119000	1.19	3.0167e-05	0.464	N/A	N/A
119500	1.195	3.0084e-05	0.471	N/A	N/A
120000	1.2	3.0000e-05	0.4396	N/A	N/A
120500	1.205	2.9917e-05	0.4755	N/A	N/A
121000	1.21	2.9834e-05	0.4896	N/A	N/A
121500	1.215	2.9750e-05	0.4428	N/A	N/A
122000	1.22	2.9667e-05	0.482	N/A	N/A
122500	1.225	2.9584e-05	0.4814	N/A	N/A
123000	1.23	2.9500e-05	0.4603	N/A	N/A
123500	1.235	2.9417e-05	0.4527	N/A	N/A
124000	1.24	2.9334e-05	0.4882	N/A	N/A
124500	1.245	2.9250e-05	0.5033	N/A	N/A
125000	1.25	2.9167e-05	0.4799	N/A	N/A
125500	1.255	2.9084e-05	0.4908	N/A	N/A
126000	1.26	2.9000e-05	0.4532	N/A	N/A
126500	1.265	2.8917e-05	0.4678	N/A	N/A
127000	1.27	2.8834e-05	0.4643	N/A	N/A
127500	1.275	2.8750e-05	0.475	N/A	N/A
128000	1.28	2.8667e-05	0.4685	N/A	N/A
128500	1.285	2.8584e-05	0.4577	N/A	N/A
129000	1.29	2.8500e-05	0.4702	N/A	N/A
129500	1.295	2.8417e-05	0.4526	N/A	N/A
130000	1.3	2.8334e-05	0.4324	N/A	N/A
130500	1.305	2.8250e-05	0.4639	N/A	N/A
131000	1.31	2.8167e-05	0.46	N/A	N/A
131500	1.315	2.8084e-05	0.4661	N/A	N/A
132000	1.32	2.8000e-05	0.4893	N/A	N/A
132500	1.325	2.7917e-05	0.4468	N/A	N/A
133000	1.33	2.7834e-05	0.4637	N/A	N/A
133500	1.335	2.7750e-05	0.4871	N/A	N/A
134000	1.34	2.7667e-05	0.4592	N/A	N/A
134500	1.345	2.7584e-05	0.4572	N/A	N/A
135000	1.35	2.7500e-05	0.4408	N/A	N/A
135500	1.355	2.7417e-05	0.4835	N/A	N/A
136000	1.36	2.7334e-05	0.4941	N/A	N/A
136500	1.365	2.7250e-05	0.4756	N/A	N/A
137000	1.37	2.7167e-05	0.4664	N/A	N/A
137500	1.375	2.7083e-05	0.436	N/A	N/A
138000	1.38	2.7000e-05	0.4507	N/A	N/A
138500	1.385	2.6917e-05	0.4762	N/A	N/A
139000	1.39	2.6833e-05	0.471	N/A	N/A
139500	1.395	2.6750e-05	0.4494	N/A	N/A
140000	1.4	2.6667e-05	0.4825	N/A	N/A
140500	1.405	2.6584e-05	0.4485	N/A	N/A
141000	1.41	2.6500e-05	0.4586	N/A	N/A
141500	1.415	2.6417e-05	0.4774	N/A	N/A
142000	1.42	2.6334e-05	0.4681	N/A	N/A
142500	1.425	2.6250e-05	0.4465	N/A	N/A
143000	1.43	2.6167e-05	0.4951	N/A	N/A
143500	1.435	2.6083e-05	0.4769	N/A	N/A
144000	1.44	2.6000e-05	0.4546	N/A	N/A
144500	1.445	2.5917e-05	0.4326	N/A	N/A
145000	1.45	2.5833e-05	0.4488	N/A	N/A
145500	1.455	2.5750e-05	0.4515	N/A	N/A
146000	1.46	2.5667e-05	0.4692	N/A	N/A
146500	1.465	2.5583e-05	0.4371	N/A	N/A
147000	1.47	2.5500e-05	0.4534	N/A	N/A
147500	1.475	2.5417e-05	0.4534	N/A	N/A
148000	1.48	2.5333e-05	0.4809	N/A	N/A
148500	1.485	2.5250e-05	0.4823	N/A	N/A
149000	1.49	2.5167e-05	0.4648	N/A	N/A
149500	1.495	2.5083e-05	0.4764	N/A	N/A
150000	1.5	2.5000e-05	0.4785	N/A	N/A
150500	1.505	2.4917e-05	0.4403	N/A	N/A
151000	1.51	2.4834e-05	0.4596	N/A	N/A
151500	1.515	2.4750e-05	0.4643	N/A	N/A
152000	1.52	2.4667e-05	0.4711	N/A	N/A
152500	1.525	2.4583e-05	0.463	N/A	N/A
153000	1.53	2.4500e-05	0.4618	N/A	N/A
153500	1.535	2.4417e-05	0.4612	N/A	N/A
154000	1.54	2.4334e-05	0.4539	N/A	N/A
154500	1.545	2.4250e-05	0.4202	N/A	N/A
155000	1.55	2.4167e-05	0.4284	N/A	N/A
155500	1.555	2.4084e-05	0.4792	N/A	N/A
156000	1.56	2.4000e-05	0.492	N/A	N/A
156500	1.565	2.3917e-05	0.4999	N/A	N/A
157000	1.57	2.3834e-05	0.4562	N/A	N/A
157500	1.575	2.3750e-05	0.4622	N/A	N/A
158000	1.58	2.3667e-05	0.4276	N/A	N/A
158500	1.585	2.3583e-05	0.4651	N/A	N/A
159000	1.59	2.3500e-05	0.47	N/A	N/A
159500	1.595	2.3417e-05	0.4545	N/A	N/A
160000	1.6	2.3333e-05	0.4532	N/A	N/A
160500	1.605	2.3250e-05	0.4635	N/A	N/A
161000	1.61	2.3167e-05	0.4498	N/A	N/A
161500	1.615	2.3084e-05	0.4569	N/A	N/A
162000	1.62	2.3000e-05	0.4951	N/A	N/A
162500	1.625	2.2917e-05	0.4629	N/A	N/A
163000	1.63	2.2834e-05	0.4812	N/A	N/A
163500	1.635	2.2750e-05	0.4406	N/A	N/A
164000	1.64	2.2667e-05	0.4329	N/A	N/A
164500	1.645	2.2584e-05	0.4518	N/A	N/A
165000	1.65	2.2500e-05	0.4716	N/A	N/A
165500	1.655	2.2417e-05	0.4502	N/A	N/A
166000	1.66	2.2334e-05	0.458	N/A	N/A
166500	1.665	2.2250e-05	0.4721	N/A	N/A
167000	1.67	2.2167e-05	0.4828	N/A	N/A
167500	1.675	2.2084e-05	0.4405	N/A	N/A
168000	1.68	2.2000e-05	0.4396	N/A	N/A
168500	1.685	2.1917e-05	0.426	N/A	N/A
169000	1.69	2.1834e-05	0.4805	N/A	N/A
169500	1.695	2.1750e-05	0.449	N/A	N/A
170000	1.7	2.1667e-05	0.4258	N/A	N/A
170500	1.705	2.1584e-05	0.4891	N/A	N/A
171000	1.71	2.1500e-05	0.4511	N/A	N/A
171500	1.715	2.1417e-05	0.4567	N/A	N/A
172000	1.72	2.1334e-05	0.471	N/A	N/A
172500	1.725	2.1250e-05	0.4347	N/A	N/A
173000	1.73	2.1167e-05	0.4436	N/A	N/A
173500	1.735	2.1083e-05	0.4443	N/A	N/A
174000	1.74	2.1000e-05	0.4498	N/A	N/A
174500	1.745	2.0917e-05	0.4521	N/A	N/A
175000	1.75	2.0833e-05	0.4584	N/A	N/A
175500	1.755	2.0750e-05	0.4655	N/A	N/A
176000	1.76	2.0667e-05	0.4368	N/A	N/A
176500	1.765	2.0584e-05	0.4602	N/A	N/A
177000	1.77	2.0500e-05	0.4507	N/A	N/A
177500	1.775	2.0417e-05	0.4757	N/A	N/A
178000	1.78	2.0334e-05	0.4474	N/A	N/A
178500	1.785	2.0250e-05	0.4355	N/A	N/A
179000	1.79	2.0167e-05	0.4584	N/A	N/A
179500	1.795	2.0084e-05	0.4112	N/A	N/A
180000	1.8	2.0000e-05	0.4733	N/A	N/A
180500	1.805	1.9917e-05	0.4626	N/A	N/A
181000	1.81	1.9834e-05	0.4742	N/A	N/A
181500	1.815	1.9750e-05	0.4417	N/A	N/A
182000	1.82	1.9667e-05	0.4683	N/A	N/A
182500	1.825	1.9584e-05	0.4554	N/A	N/A
183000	1.83	1.9500e-05	0.444	N/A	N/A
183500	1.835	1.9417e-05	0.4396	N/A	N/A
184000	1.84	1.9334e-05	0.4595	N/A	N/A
184500	1.845	1.9250e-05	0.4756	N/A	N/A
185000	1.85	1.9167e-05	0.4398	N/A	N/A
185500	1.855	1.9084e-05	0.4269	N/A	N/A
186000	1.86	1.9000e-05	0.4395	N/A	N/A
186500	1.865	1.8917e-05	0.4108	N/A	N/A
187000	1.87	1.8834e-05	0.4531	N/A	N/A
187500	1.875	1.8750e-05	0.474	N/A	N/A
188000	1.88	1.8667e-05	0.4754	N/A	N/A
188500	1.885	1.8584e-05	0.4457	N/A	N/A
189000	1.89	1.8500e-05	0.4154	N/A	N/A
189500	1.895	1.8417e-05	0.4648	N/A	N/A
190000	1.9	1.8333e-05	0.449	N/A	N/A
190500	1.905	1.8250e-05	0.4292	N/A	N/A
191000	1.91	1.8167e-05	0.487	N/A	N/A
191500	1.915	1.8084e-05	0.4174	N/A	N/A
192000	1.92	1.8000e-05	0.4438	N/A	N/A
192500	1.925	1.7917e-05	0.4219	N/A	N/A
193000	1.93	1.7834e-05	0.4186	N/A	N/A
193500	1.935	1.7750e-05	0.4549	N/A	N/A
194000	1.94	1.7667e-05	0.4293	N/A	N/A
194500	1.945	1.7583e-05	0.4714	N/A	N/A
195000	1.95	1.7500e-05	0.4374	N/A	N/A
195500	1.955	1.7417e-05	0.4569	N/A	N/A
196000	1.96	1.7333e-05	0.4331	N/A	N/A
196500	1.965	1.7250e-05	0.4368	N/A	N/A
197000	1.97	1.7167e-05	0.47	N/A	N/A
197500	1.975	1.7083e-05	0.4326	N/A	N/A
198000	1.98	1.7000e-05	0.4231	N/A	N/A
198500	1.985	1.6917e-05	0.4372	N/A	N/A
199000	1.99	1.6834e-05	0.4684	N/A	N/A
199500	1.995	1.6750e-05	0.4428	N/A	N/A
200000	2.0	1.6667e-05	0.4204	0.5193	0.8423
200500	2.005	1.6584e-05	0.3163	N/A	N/A
201000	2.01	1.6500e-05	0.3197	N/A	N/A
201500	2.015	1.6417e-05	0.344	N/A	N/A
202000	2.02	1.6334e-05	0.3491	N/A	N/A
202500	2.025	1.6250e-05	0.3559	N/A	N/A
203000	2.03	1.6167e-05	0.3454	N/A	N/A
203500	2.035	1.6084e-05	0.3363	N/A	N/A
204000	2.04	1.6000e-05	0.3456	N/A	N/A
204500	2.045	1.5917e-05	0.3811	N/A	N/A
205000	2.05	1.5834e-05	0.328	N/A	N/A
205500	2.055	1.5750e-05	0.3589	N/A	N/A
206000	2.06	1.5667e-05	0.3693	N/A	N/A
206500	2.065	1.5584e-05	0.3411	N/A	N/A
207000	2.07	1.5500e-05	0.3599	N/A	N/A
207500	2.075	1.5417e-05	0.3591	N/A	N/A
208000	2.08	1.5334e-05	0.3395	N/A	N/A
208500	2.085	1.5250e-05	0.3329	N/A	N/A
209000	2.09	1.5167e-05	0.3455	N/A	N/A
209500	2.095	1.5084e-05	0.347	N/A	N/A
210000	2.1	1.5000e-05	0.3359	N/A	N/A
210500	2.105	1.4917e-05	0.351	N/A	N/A
211000	2.11	1.4833e-05	0.3409	N/A	N/A
211500	2.115	1.4750e-05	0.3481	N/A	N/A
212000	2.12	1.4667e-05	0.3393	N/A	N/A
212500	2.125	1.4584e-05	0.334	N/A	N/A
213000	2.13	1.4500e-05	0.3334	N/A	N/A
213500	2.135	1.4417e-05	0.3252	N/A	N/A
214000	2.14	1.4333e-05	0.3535	N/A	N/A
214500	2.145	1.4250e-05	0.3492	N/A	N/A
215000	2.15	1.4167e-05	0.3583	N/A	N/A
215500	2.155	1.4083e-05	0.3362	N/A	N/A
216000	2.16	1.4000e-05	0.3534	N/A	N/A
216500	2.165	1.3917e-05	0.3229	N/A	N/A
217000	2.17	1.3834e-05	0.3689	N/A	N/A
217500	2.175	1.3750e-05	0.3353	N/A	N/A
218000	2.18	1.3667e-05	0.3386	N/A	N/A
218500	2.185	1.3584e-05	0.3306	N/A	N/A
219000	2.19	1.3500e-05	0.3526	N/A	N/A
219500	2.195	1.3417e-05	0.3602	N/A	N/A
220000	2.2	1.3334e-05	0.3299	N/A	N/A
220500	2.205	1.3250e-05	0.3518	N/A	N/A
221000	2.21	1.3167e-05	0.3485	N/A	N/A
221500	2.215	1.3084e-05	0.3225	N/A	N/A
222000	2.22	1.3000e-05	0.3387	N/A	N/A
222500	2.225	1.2917e-05	0.372	N/A	N/A
223000	2.23	1.2834e-05	0.3595	N/A	N/A
223500	2.235	1.2750e-05	0.3788	N/A	N/A
224000	2.24	1.2667e-05	0.3238	N/A	N/A
224500	2.245	1.2584e-05	0.3439	N/A	N/A
225000	2.25	1.2500e-05	0.3346	N/A	N/A
225500	2.255	1.2417e-05	0.3341	N/A	N/A
226000	2.26	1.2334e-05	0.3475	N/A	N/A
226500	2.265	1.2250e-05	0.3486	N/A	N/A
227000	2.27	1.2167e-05	0.3324	N/A	N/A
227500	2.275	1.2084e-05	0.3296	N/A	N/A
228000	2.28	1.2000e-05	0.3266	N/A	N/A
228500	2.285	1.1917e-05	0.3542	N/A	N/A
229000	2.29	1.1833e-05	0.3445	N/A	N/A
229500	2.295	1.1750e-05	0.3524	N/A	N/A
230000	2.3	1.1667e-05	0.3633	N/A	N/A
230500	2.305	1.1584e-05	0.3659	N/A	N/A
231000	2.31	1.1500e-05	0.3813	N/A	N/A
231500	2.315	1.1417e-05	0.3662	N/A	N/A
232000	2.32	1.1334e-05	0.3577	N/A	N/A
232500	2.325	1.1250e-05	0.3451	N/A	N/A
233000	2.33	1.1167e-05	0.3138	N/A	N/A
233500	2.335	1.1084e-05	0.3438	N/A	N/A
234000	2.34	1.1000e-05	0.3548	N/A	N/A
234500	2.345	1.0917e-05	0.3271	N/A	N/A
235000	2.35	1.0834e-05	0.34	N/A	N/A
235500	2.355	1.0750e-05	0.3353	N/A	N/A
236000	2.36	1.0667e-05	0.3252	N/A	N/A
236500	2.365	1.0583e-05	0.3131	N/A	N/A
237000	2.37	1.0500e-05	0.3182	N/A	N/A
237500	2.375	1.0417e-05	0.3462	N/A	N/A
238000	2.38	1.0334e-05	0.3521	N/A	N/A
238500	2.385	1.0250e-05	0.3427	N/A	N/A
239000	2.39	1.0167e-05	0.3414	N/A	N/A
239500	2.395	1.0083e-05	0.3471	N/A	N/A
240000	2.4	1.0000e-05	0.3349	N/A	N/A
240500	2.405	9.9168e-06	0.34	N/A	N/A
241000	2.41	9.8335e-06	0.328	N/A	N/A
241500	2.415	9.7502e-06	0.3617	N/A	N/A
242000	2.42	9.6668e-06	0.3435	N/A	N/A
242500	2.425	9.5835e-06	0.3286	N/A	N/A
243000	2.43	9.5002e-06	0.3336	N/A	N/A
243500	2.435	9.4168e-06	0.3278	N/A	N/A
244000	2.44	9.3335e-06	0.3395	N/A	N/A
244500	2.445	9.2502e-06	0.3517	N/A	N/A
245000	2.45	9.1668e-06	0.3048	N/A	N/A
245500	2.455	9.0835e-06	0.3382	N/A	N/A
246000	2.46	9.0002e-06	0.3899	N/A	N/A
246500	2.465	8.9168e-06	0.3488	N/A	N/A
247000	2.47	8.8335e-06	0.3461	N/A	N/A
247500	2.475	8.7502e-06	0.2971	N/A	N/A
248000	2.48	8.6668e-06	0.3375	N/A	N/A
248500	2.485	8.5835e-06	0.3413	N/A	N/A
249000	2.49	8.5002e-06	0.3274	N/A	N/A
249500	2.495	8.4168e-06	0.3239	N/A	N/A
250000	2.5	8.3335e-06	0.3393	N/A	N/A
250500	2.505	8.2502e-06	0.3607	N/A	N/A
251000	2.51	8.1668e-06	0.3408	N/A	N/A
251500	2.515	8.0835e-06	0.3277	N/A	N/A
252000	2.52	8.0002e-06	0.3651	N/A	N/A
252500	2.525	7.9168e-06	0.2939	N/A	N/A
253000	2.53	7.8335e-06	0.3414	N/A	N/A
253500	2.535	7.7502e-06	0.3085	N/A	N/A
254000	2.54	7.6668e-06	0.3216	N/A	N/A
254500	2.545	7.5835e-06	0.3341	N/A	N/A
255000	2.55	7.5002e-06	0.3252	N/A	N/A
255500	2.555	7.4168e-06	0.333	N/A	N/A
256000	2.56	7.3335e-06	0.3375	N/A	N/A
256500	2.565	7.2502e-06	0.3491	N/A	N/A
257000	2.57	7.1668e-06	0.3446	N/A	N/A
257500	2.575	7.0835e-06	0.3324	N/A	N/A
258000	2.58	7.0002e-06	0.362	N/A	N/A
258500	2.585	6.9168e-06	0.3208	N/A	N/A
259000	2.59	6.8335e-06	0.3669	N/A	N/A
259500	2.595	6.7502e-06	0.3303	N/A	N/A
260000	2.6	6.6668e-06	0.3464	N/A	N/A
260500	2.605	6.5835e-06	0.3421	N/A	N/A
261000	2.61	6.5002e-06	0.3549	N/A	N/A
261500	2.615	6.4168e-06	0.3237	N/A	N/A
262000	2.62	6.3335e-06	0.3189	N/A	N/A
262500	2.625	6.2502e-06	0.3579	N/A	N/A
263000	2.63	6.1668e-06	0.3358	N/A	N/A
263500	2.635	6.0835e-06	0.3148	N/A	N/A
264000	2.64	6.0002e-06	0.3182	N/A	N/A
264500	2.645	5.9168e-06	0.3292	N/A	N/A
265000	2.65	5.8335e-06	0.3388	N/A	N/A
265500	2.655	5.7502e-06	0.3536	N/A	N/A
266000	2.66	5.6668e-06	0.3184	N/A	N/A
266500	2.665	5.5835e-06	0.3124	N/A	N/A
267000	2.67	5.5002e-06	0.3342	N/A	N/A
267500	2.675	5.4168e-06	0.3139	N/A	N/A
268000	2.68	5.3335e-06	0.304	N/A	N/A
268500	2.685	5.2502e-06	0.3406	N/A	N/A
269000	2.69	5.1668e-06	0.3589	N/A	N/A
269500	2.695	5.0835e-06	0.3327	N/A	N/A
270000	2.7	5.0002e-06	0.3391	N/A	N/A
270500	2.705	4.9168e-06	0.32	N/A	N/A
271000	2.71	4.8335e-06	0.3	N/A	N/A
271500	2.715	4.7502e-06	0.3082	N/A	N/A
272000	2.72	4.6668e-06	0.3312	N/A	N/A
272500	2.725	4.5835e-06	0.3196	N/A	N/A
273000	2.73	4.5002e-06	0.3107	N/A	N/A
273500	2.735	4.4168e-06	0.3328	N/A	N/A
274000	2.74	4.3335e-06	0.3492	N/A	N/A
274500	2.745	4.2502e-06	0.3162	N/A	N/A
275000	2.75	4.1668e-06	0.3204	N/A	N/A
275500	2.755	4.0835e-06	0.3187	N/A	N/A
276000	2.76	4.0002e-06	0.334	N/A	N/A
276500	2.765	3.9168e-06	0.3318	N/A	N/A
277000	2.77	3.8335e-06	0.3189	N/A	N/A
277500	2.775	3.7502e-06	0.3331	N/A	N/A
278000	2.78	3.6668e-06	0.2959	N/A	N/A
278500	2.785	3.5835e-06	0.3177	N/A	N/A
279000	2.79	3.5002e-06	0.3417	N/A	N/A
279500	2.795	3.4168e-06	0.3507	N/A	N/A
280000	2.8	3.3335e-06	0.3248	N/A	N/A
280500	2.805	3.2502e-06	0.3262	N/A	N/A
281000	2.81	3.1668e-06	0.3095	N/A	N/A
281500	2.815	3.0835e-06	0.3513	N/A	N/A
282000	2.82	3.0002e-06	0.3019	N/A	N/A
282500	2.825	2.9168e-06	0.3312	N/A	N/A
283000	2.83	2.8335e-06	0.3257	N/A	N/A
283500	2.835	2.7502e-06	0.3172	N/A	N/A
284000	2.84	2.6668e-06	0.3417	N/A	N/A
284500	2.845	2.5835e-06	0.3005	N/A	N/A
285000	2.85	2.5002e-06	0.3219	N/A	N/A
285500	2.855	2.4168e-06	0.3002	N/A	N/A
286000	2.86	2.3335e-06	0.3385	N/A	N/A
286500	2.865	2.2502e-06	0.304	N/A	N/A
287000	2.87	2.1668e-06	0.3207	N/A	N/A
287500	2.875	2.0835e-06	0.3178	N/A	N/A
288000	2.88	2.0002e-06	0.3287	N/A	N/A
288500	2.885	1.9168e-06	0.3179	N/A	N/A
289000	2.89	1.8335e-06	0.3274	N/A	N/A
289500	2.895	1.7502e-06	0.3418	N/A	N/A
290000	2.9	1.6668e-06	0.3229	N/A	N/A
290500	2.905	1.5835e-06	0.3374	N/A	N/A
291000	2.91	1.5002e-06	0.3502	N/A	N/A
291500	2.915	1.4168e-06	0.3148	N/A	N/A
292000	2.92	1.3335e-06	0.3471	N/A	N/A
292500	2.925	1.2502e-06	0.3164	N/A	N/A
293000	2.93	1.1668e-06	0.3601	N/A	N/A
293500	2.935	1.0835e-06	0.3149	N/A	N/A
294000	2.94	1.0002e-06	0.3071	N/A	N/A
294500	2.945	9.1683e-07	0.3273	N/A	N/A
295000	2.95	8.3350e-07	0.3174	N/A	N/A
295500	2.955	7.5017e-07	0.347	N/A	N/A
296000	2.96	6.6683e-07	0.3137	N/A	N/A
296500	2.965	5.8350e-07	0.3122	N/A	N/A
297000	2.97	5.0017e-07	0.3273	N/A	N/A
297500	2.975	4.1683e-07	0.3206	N/A	N/A
298000	2.98	3.3350e-07	0.3067	N/A	N/A
298500	2.985	2.5017e-07	0.3037	N/A	N/A
299000	2.99	1.6683e-07	0.2974	N/A	N/A
299500	2.995	8.3500e-08	0.3189	N/A	N/A
300000	3.0	1.6667e-10	0.3187	0.604	0.8488

Framework Versions

• Transformers: 5.0.0.dev0
• PyTorch: 2.9.1+cu128