GIST-small-c4-en-doc_type_v1_primary

A fine-tuned version of the bert architecture (BertForSequenceClassification) optimized for the text-classification task.

• Model type: bert
• Problem Type: single_label_classification
• Number of Labels: 17
• Vocabulary Size: 30522
• License: MIT

Use

To get started with this model in Python using the Hugging Face Transformers library, run the following code:

from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch

model_id = "agentlans/GIST-small-c4-en-doc_type_v1_primary"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForSequenceClassification.from_pretrained(model_id)

text = "Replace this with your input text."
inputs = tokenizer(text, return_tensors="pt")

with torch.no_grad():
    logits = model(**inputs).logits

predicted_class_id = logits.argmax().item()
predicted_class_name = model.config.id2label[predicted_class_id]

print(f"Predicted Class ID: {predicted_class_id}")
print(f"Predicted Class Name: {predicted_class_name}")

Intended Uses & Limitations

Intended Use

This model is designed for sequence classification tasks. Below are the specific class labels mapped to their corresponding IDs:

Label ID	Label Name
0	Academic/Research
1	Adult
2	Code
3	E-Commerce
4	Government
5	Legal
6	Literary
7	Machine-Generated
8	Media
9	News/Editorial
10	Other
11	Personal
12	Promotional
13	Reference
14	Reviews
15	Search
16	Social

Training Details

Hyperparameters

The following hyperparameters were used during fine-tuning:

• Learning Rate: 5e-05
• Train Batch Size: 8
• Eval Batch Size: 8
• Optimizer: OptimizerNames.ADAMW_TORCH_FUSED
• Number of Epochs: 3.0
• Mixed Precision: BF16

Show Advanced Training Configuration

Optimization & Regularization

• Gradient Accumulation Steps: 1
• Learning Rate Scheduler: SchedulerType.LINEAR
• Warmup Steps: 0
• Warmup Ratio: None
• Weight Decay: 0.0
• Max Gradient Norm: 1.0

Hardware & Reproducibility

• Number of GPUs: 1
• Seed: 42

Training Results & Evaluation

During fine-tuning, the model achieved the following results on the evaluation set:

Metric	Value
Train Loss	0.4844
Validation Loss	0.6053
Validation F1 Score	0.8285
Total FLOPs	3.4616e+16

For performance on the test set, click here.

Speed Performance

• Training Runtime: 4506.3268 seconds
• Train Samples per Second: 466.332
• Evaluation Runtime: 49.397 seconds
• Eval Samples per Second: 1772.619

Show Detailed Training Logs

Training Logs History

Step	Epoch	Learning Rate	Training Loss	Validation Loss	Validation F1
500	0.006	4.9905e-05	1.4487	N/A	N/A
1000	0.011	4.9810e-05	1.033	N/A	N/A
1500	0.017	4.9715e-05	0.875	N/A	N/A
2000	0.023	4.9620e-05	0.8459	N/A	N/A
2500	0.029	4.9524e-05	0.7989	N/A	N/A
3000	0.034	4.9429e-05	0.7678	N/A	N/A
3500	0.04	4.9334e-05	0.769	N/A	N/A
4000	0.046	4.9239e-05	0.7334	N/A	N/A
4500	0.051	4.9144e-05	0.7291	N/A	N/A
5000	0.057	4.9048e-05	0.7444	N/A	N/A
5500	0.063	4.8953e-05	0.7234	N/A	N/A
6000	0.069	4.8858e-05	0.7226	N/A	N/A
6500	0.074	4.8763e-05	0.7182	N/A	N/A
7000	0.08	4.8668e-05	0.7001	N/A	N/A
7500	0.086	4.8573e-05	0.6859	N/A	N/A
8000	0.091	4.8477e-05	0.6822	N/A	N/A
8500	0.097	4.8382e-05	0.6736	N/A	N/A
9000	0.103	4.8287e-05	0.6614	N/A	N/A
9500	0.108	4.8192e-05	0.686	N/A	N/A
10000	0.114	4.8097e-05	0.6509	N/A	N/A
10500	0.12	4.8002e-05	0.674	N/A	N/A
11000	0.126	4.7906e-05	0.664	N/A	N/A
11500	0.131	4.7811e-05	0.6841	N/A	N/A
12000	0.137	4.7716e-05	0.6716	N/A	N/A
12500	0.143	4.7621e-05	0.6555	N/A	N/A
13000	0.148	4.7526e-05	0.6541	N/A	N/A
13500	0.154	4.7431e-05	0.666	N/A	N/A
14000	0.16	4.7335e-05	0.6702	N/A	N/A
14500	0.166	4.7240e-05	0.6338	N/A	N/A
15000	0.171	4.7145e-05	0.6399	N/A	N/A
15500	0.177	4.7050e-05	0.6705	N/A	N/A
16000	0.183	4.6955e-05	0.6275	N/A	N/A
16500	0.188	4.6860e-05	0.6613	N/A	N/A
17000	0.194	4.6764e-05	0.6287	N/A	N/A
17500	0.2	4.6669e-05	0.6105	N/A	N/A
18000	0.206	4.6574e-05	0.5996	N/A	N/A
18500	0.211	4.6479e-05	0.6427	N/A	N/A
19000	0.217	4.6384e-05	0.6395	N/A	N/A
19500	0.223	4.6288e-05	0.6265	N/A	N/A
20000	0.228	4.6193e-05	0.6405	N/A	N/A
20500	0.234	4.6098e-05	0.643	N/A	N/A
21000	0.24	4.6003e-05	0.625	N/A	N/A
21500	0.246	4.5908e-05	0.6197	N/A	N/A
22000	0.251	4.5813e-05	0.6234	N/A	N/A
22500	0.257	4.5717e-05	0.6074	N/A	N/A
23000	0.263	4.5622e-05	0.6164	N/A	N/A
23500	0.268	4.5527e-05	0.6144	N/A	N/A
24000	0.274	4.5432e-05	0.6389	N/A	N/A
24500	0.28	4.5337e-05	0.6488	N/A	N/A
25000	0.286	4.5242e-05	0.6127	N/A	N/A
25500	0.291	4.5146e-05	0.6212	N/A	N/A
26000	0.297	4.5051e-05	0.6174	N/A	N/A
26500	0.303	4.4956e-05	0.616	N/A	N/A
27000	0.308	4.4861e-05	0.5878	N/A	N/A
27500	0.314	4.4766e-05	0.6315	N/A	N/A
28000	0.32	4.4671e-05	0.6224	N/A	N/A
28500	0.325	4.4575e-05	0.6158	N/A	N/A
29000	0.331	4.4480e-05	0.6215	N/A	N/A
29500	0.337	4.4385e-05	0.625	N/A	N/A
30000	0.343	4.4290e-05	0.6029	N/A	N/A
30500	0.348	4.4195e-05	0.6036	N/A	N/A
31000	0.354	4.4100e-05	0.6003	N/A	N/A
31500	0.36	4.4004e-05	0.6256	N/A	N/A
32000	0.365	4.3909e-05	0.5832	N/A	N/A
32500	0.371	4.3814e-05	0.6269	N/A	N/A
33000	0.377	4.3719e-05	0.6225	N/A	N/A
33500	0.383	4.3624e-05	0.6161	N/A	N/A
34000	0.388	4.3529e-05	0.5963	N/A	N/A
34500	0.394	4.3433e-05	0.6236	N/A	N/A
35000	0.4	4.3338e-05	0.6264	N/A	N/A
35500	0.405	4.3243e-05	0.5882	N/A	N/A
36000	0.411	4.3148e-05	0.6064	N/A	N/A
36500	0.417	4.3053e-05	0.6128	N/A	N/A
37000	0.423	4.2957e-05	0.6055	N/A	N/A
37500	0.428	4.2862e-05	0.6089	N/A	N/A
38000	0.434	4.2767e-05	0.5829	N/A	N/A
38500	0.44	4.2672e-05	0.6474	N/A	N/A
39000	0.445	4.2577e-05	0.5873	N/A	N/A
39500	0.451	4.2482e-05	0.5993	N/A	N/A
40000	0.457	4.2386e-05	0.5784	N/A	N/A
40500	0.463	4.2291e-05	0.598	N/A	N/A
41000	0.468	4.2196e-05	0.5981	N/A	N/A
41500	0.474	4.2101e-05	0.6087	N/A	N/A
42000	0.48	4.2006e-05	0.5989	N/A	N/A
42500	0.485	4.1911e-05	0.59	N/A	N/A
43000	0.491	4.1815e-05	0.5964	N/A	N/A
43500	0.497	4.1720e-05	0.6105	N/A	N/A
44000	0.503	4.1625e-05	0.5943	N/A	N/A
44500	0.508	4.1530e-05	0.6199	N/A	N/A
45000	0.514	4.1435e-05	0.6054	N/A	N/A
45500	0.52	4.1340e-05	0.5972	N/A	N/A
46000	0.525	4.1244e-05	0.597	N/A	N/A
46500	0.531	4.1149e-05	0.603	N/A	N/A
47000	0.537	4.1054e-05	0.6045	N/A	N/A
47500	0.542	4.0959e-05	0.6076	N/A	N/A
48000	0.548	4.0864e-05	0.6	N/A	N/A
48500	0.554	4.0769e-05	0.5848	N/A	N/A
49000	0.56	4.0673e-05	0.5909	N/A	N/A
49500	0.565	4.0578e-05	0.5814	N/A	N/A
50000	0.571	4.0483e-05	0.6191	N/A	N/A
50500	0.577	4.0388e-05	0.5565	N/A	N/A
51000	0.582	4.0293e-05	0.5708	N/A	N/A
51500	0.588	4.0198e-05	0.5918	N/A	N/A
52000	0.594	4.0102e-05	0.5843	N/A	N/A
52500	0.6	4.0007e-05	0.6055	N/A	N/A
53000	0.605	3.9912e-05	0.6055	N/A	N/A
53500	0.611	3.9817e-05	0.5667	N/A	N/A
54000	0.617	3.9722e-05	0.5779	N/A	N/A
54500	0.622	3.9626e-05	0.5848	N/A	N/A
55000	0.628	3.9531e-05	0.577	N/A	N/A
55500	0.634	3.9436e-05	0.5632	N/A	N/A
56000	0.64	3.9341e-05	0.5595	N/A	N/A
56500	0.645	3.9246e-05	0.578	N/A	N/A
57000	0.651	3.9151e-05	0.5738	N/A	N/A
57500	0.657	3.9055e-05	0.589	N/A	N/A
58000	0.662	3.8960e-05	0.5659	N/A	N/A
58500	0.668	3.8865e-05	0.5549	N/A	N/A
59000	0.674	3.8770e-05	0.5664	N/A	N/A
59500	0.68	3.8675e-05	0.6038	N/A	N/A
60000	0.685	3.8580e-05	0.5676	N/A	N/A
60500	0.691	3.8484e-05	0.5568	N/A	N/A
61000	0.697	3.8389e-05	0.5656	N/A	N/A
61500	0.702	3.8294e-05	0.5842	N/A	N/A
62000	0.708	3.8199e-05	0.5564	N/A	N/A
62500	0.714	3.8104e-05	0.5956	N/A	N/A
63000	0.719	3.8009e-05	0.5514	N/A	N/A
63500	0.725	3.7913e-05	0.5578	N/A	N/A
64000	0.731	3.7818e-05	0.5718	N/A	N/A
64500	0.737	3.7723e-05	0.5796	N/A	N/A
65000	0.742	3.7628e-05	0.5589	N/A	N/A
65500	0.748	3.7533e-05	0.5556	N/A	N/A
66000	0.754	3.7438e-05	0.572	N/A	N/A
66500	0.759	3.7342e-05	0.5736	N/A	N/A
67000	0.765	3.7247e-05	0.5817	N/A	N/A
67500	0.771	3.7152e-05	0.5576	N/A	N/A
68000	0.777	3.7057e-05	0.5678	N/A	N/A
68500	0.782	3.6962e-05	0.548	N/A	N/A
69000	0.788	3.6866e-05	0.5631	N/A	N/A
69500	0.794	3.6771e-05	0.5828	N/A	N/A
70000	0.799	3.6676e-05	0.5352	N/A	N/A
70500	0.805	3.6581e-05	0.5383	N/A	N/A
71000	0.811	3.6486e-05	0.5528	N/A	N/A
71500	0.817	3.6391e-05	0.5974	N/A	N/A
72000	0.822	3.6295e-05	0.5532	N/A	N/A
72500	0.828	3.6200e-05	0.5504	N/A	N/A
73000	0.834	3.6105e-05	0.5713	N/A	N/A
73500	0.839	3.6010e-05	0.5736	N/A	N/A
74000	0.845	3.5915e-05	0.5584	N/A	N/A
74500	0.851	3.5820e-05	0.5749	N/A	N/A
75000	0.857	3.5724e-05	0.5672	N/A	N/A
75500	0.862	3.5629e-05	0.5906	N/A	N/A
76000	0.868	3.5534e-05	0.5851	N/A	N/A
76500	0.874	3.5439e-05	0.5505	N/A	N/A
77000	0.879	3.5344e-05	0.5619	N/A	N/A
77500	0.885	3.5249e-05	0.5527	N/A	N/A
78000	0.891	3.5153e-05	0.5481	N/A	N/A
78500	0.897	3.5058e-05	0.556	N/A	N/A
79000	0.902	3.4963e-05	0.5622	N/A	N/A
79500	0.908	3.4868e-05	0.5662	N/A	N/A
80000	0.914	3.4773e-05	0.5616	N/A	N/A
80500	0.919	3.4678e-05	0.5593	N/A	N/A
81000	0.925	3.4582e-05	0.5545	N/A	N/A
81500	0.931	3.4487e-05	0.5594	N/A	N/A
82000	0.936	3.4392e-05	0.5533	N/A	N/A
82500	0.942	3.4297e-05	0.5524	N/A	N/A
83000	0.948	3.4202e-05	0.5786	N/A	N/A
83500	0.954	3.4107e-05	0.5463	N/A	N/A
84000	0.959	3.4011e-05	0.5627	N/A	N/A
84500	0.965	3.3916e-05	0.5724	N/A	N/A
85000	0.971	3.3821e-05	0.5491	N/A	N/A
85500	0.976	3.3726e-05	0.5509	N/A	N/A
86000	0.982	3.3631e-05	0.5799	N/A	N/A
86500	0.988	3.3535e-05	0.5763	N/A	N/A
87000	0.994	3.3440e-05	0.5706	N/A	N/A
87500	0.999	3.3345e-05	0.5494	N/A	N/A
87561	1.0	N/A	N/A	0.5452	0.8109
88000	1.005	3.3250e-05	0.4812	N/A	N/A
88500	1.011	3.3155e-05	0.4893	N/A	N/A
89000	1.016	3.3060e-05	0.4712	N/A	N/A
89500	1.022	3.2964e-05	0.4702	N/A	N/A
90000	1.028	3.2869e-05	0.4584	N/A	N/A
90500	1.034	3.2774e-05	0.4614	N/A	N/A
91000	1.039	3.2679e-05	0.4871	N/A	N/A
91500	1.045	3.2584e-05	0.4916	N/A	N/A
92000	1.051	3.2489e-05	0.47	N/A	N/A
92500	1.056	3.2393e-05	0.4697	N/A	N/A
93000	1.062	3.2298e-05	0.4745	N/A	N/A
93500	1.068	3.2203e-05	0.4676	N/A	N/A
94000	1.074	3.2108e-05	0.4836	N/A	N/A
94500	1.079	3.2013e-05	0.4902	N/A	N/A
95000	1.085	3.1918e-05	0.4716	N/A	N/A
95500	1.091	3.1822e-05	0.4881	N/A	N/A
96000	1.096	3.1727e-05	0.4814	N/A	N/A
96500	1.102	3.1632e-05	0.464	N/A	N/A
97000	1.108	3.1537e-05	0.4654	N/A	N/A
97500	1.114	3.1442e-05	0.472	N/A	N/A
98000	1.119	3.1347e-05	0.4845	N/A	N/A
98500	1.125	3.1251e-05	0.4723	N/A	N/A
99000	1.131	3.1156e-05	0.4782	N/A	N/A
99500	1.136	3.1061e-05	0.46	N/A	N/A
100000	1.142	3.0966e-05	0.4906	N/A	N/A
100500	1.148	3.0871e-05	0.4735	N/A	N/A
101000	1.153	3.0775e-05	0.4714	N/A	N/A
101500	1.159	3.0680e-05	0.488	N/A	N/A
102000	1.165	3.0585e-05	0.4639	N/A	N/A
102500	1.171	3.0490e-05	0.5033	N/A	N/A
103000	1.176	3.0395e-05	0.4937	N/A	N/A
103500	1.182	3.0300e-05	0.4842	N/A	N/A
104000	1.188	3.0204e-05	0.4763	N/A	N/A
104500	1.193	3.0109e-05	0.4802	N/A	N/A
105000	1.199	3.0014e-05	0.4924	N/A	N/A
105500	1.205	2.9919e-05	0.4778	N/A	N/A
106000	1.211	2.9824e-05	0.4786	N/A	N/A
106500	1.216	2.9729e-05	0.4832	N/A	N/A
107000	1.222	2.9633e-05	0.4849	N/A	N/A
107500	1.228	2.9538e-05	0.4864	N/A	N/A
108000	1.233	2.9443e-05	0.5035	N/A	N/A
108500	1.239	2.9348e-05	0.4622	N/A	N/A
109000	1.245	2.9253e-05	0.4667	N/A	N/A
109500	1.251	2.9158e-05	0.4746	N/A	N/A
110000	1.256	2.9062e-05	0.4611	N/A	N/A
110500	1.262	2.8967e-05	0.4686	N/A	N/A
111000	1.268	2.8872e-05	0.4528	N/A	N/A
111500	1.273	2.8777e-05	0.4916	N/A	N/A
112000	1.279	2.8682e-05	0.4879	N/A	N/A
112500	1.285	2.8587e-05	0.4843	N/A	N/A
113000	1.291	2.8491e-05	0.4626	N/A	N/A
113500	1.296	2.8396e-05	0.4601	N/A	N/A
114000	1.302	2.8301e-05	0.4958	N/A	N/A
114500	1.308	2.8206e-05	0.4735	N/A	N/A
115000	1.313	2.8111e-05	0.4848	N/A	N/A
115500	1.319	2.8016e-05	0.507	N/A	N/A
116000	1.325	2.7920e-05	0.4551	N/A	N/A
116500	1.331	2.7825e-05	0.4869	N/A	N/A
117000	1.336	2.7730e-05	0.4978	N/A	N/A
117500	1.342	2.7635e-05	0.4487	N/A	N/A
118000	1.348	2.7540e-05	0.4923	N/A	N/A
118500	1.353	2.7444e-05	0.4925	N/A	N/A
119000	1.359	2.7349e-05	0.4722	N/A	N/A
119500	1.365	2.7254e-05	0.4799	N/A	N/A
120000	1.37	2.7159e-05	0.4821	N/A	N/A
120500	1.376	2.7064e-05	0.4891	N/A	N/A
121000	1.382	2.6969e-05	0.4887	N/A	N/A
121500	1.388	2.6873e-05	0.4829	N/A	N/A
122000	1.393	2.6778e-05	0.4872	N/A	N/A
122500	1.399	2.6683e-05	0.4528	N/A	N/A
123000	1.405	2.6588e-05	0.4553	N/A	N/A
123500	1.41	2.6493e-05	0.4937	N/A	N/A
124000	1.416	2.6398e-05	0.4874	N/A	N/A
124500	1.422	2.6302e-05	0.4752	N/A	N/A
125000	1.428	2.6207e-05	0.5021	N/A	N/A
125500	1.433	2.6112e-05	0.4694	N/A	N/A
126000	1.439	2.6017e-05	0.4708	N/A	N/A
126500	1.445	2.5922e-05	0.4744	N/A	N/A
127000	1.45	2.5827e-05	0.4612	N/A	N/A
127500	1.456	2.5731e-05	0.4707	N/A	N/A
128000	1.462	2.5636e-05	0.5065	N/A	N/A
128500	1.468	2.5541e-05	0.4571	N/A	N/A
129000	1.473	2.5446e-05	0.4915	N/A	N/A
129500	1.479	2.5351e-05	0.4768	N/A	N/A
130000	1.485	2.5256e-05	0.4705	N/A	N/A
130500	1.49	2.5160e-05	0.4705	N/A	N/A
131000	1.496	2.5065e-05	0.4687	N/A	N/A
131500	1.502	2.4970e-05	0.4754	N/A	N/A
132000	1.508	2.4875e-05	0.4569	N/A	N/A
132500	1.513	2.4780e-05	0.4835	N/A	N/A
133000	1.519	2.4685e-05	0.4721	N/A	N/A
133500	1.525	2.4589e-05	0.4739	N/A	N/A
134000	1.53	2.4494e-05	0.4797	N/A	N/A
134500	1.536	2.4399e-05	0.4605	N/A	N/A
135000	1.542	2.4304e-05	0.4595	N/A	N/A
135500	1.547	2.4209e-05	0.4693	N/A	N/A
136000	1.553	2.4113e-05	0.4697	N/A	N/A
136500	1.559	2.4018e-05	0.4587	N/A	N/A
137000	1.565	2.3923e-05	0.4657	N/A	N/A
137500	1.57	2.3828e-05	0.4455	N/A	N/A
138000	1.576	2.3733e-05	0.4634	N/A	N/A
138500	1.582	2.3638e-05	0.4871	N/A	N/A
139000	1.587	2.3542e-05	0.4528	N/A	N/A
139500	1.593	2.3447e-05	0.4651	N/A	N/A
140000	1.599	2.3352e-05	0.4717	N/A	N/A
140500	1.605	2.3257e-05	0.47	N/A	N/A
141000	1.61	2.3162e-05	0.4482	N/A	N/A
141500	1.616	2.3067e-05	0.4595	N/A	N/A
142000	1.622	2.2971e-05	0.4802	N/A	N/A
142500	1.627	2.2876e-05	0.4778	N/A	N/A
143000	1.633	2.2781e-05	0.4786	N/A	N/A
143500	1.639	2.2686e-05	0.4656	N/A	N/A
144000	1.645	2.2591e-05	0.4567	N/A	N/A
144500	1.65	2.2496e-05	0.4905	N/A	N/A
145000	1.656	2.2400e-05	0.4661	N/A	N/A
145500	1.662	2.2305e-05	0.4515	N/A	N/A
146000	1.667	2.2210e-05	0.4886	N/A	N/A
146500	1.673	2.2115e-05	0.4508	N/A	N/A
147000	1.679	2.2020e-05	0.4628	N/A	N/A
147500	1.685	2.1925e-05	0.4417	N/A	N/A
148000	1.69	2.1829e-05	0.432	N/A	N/A
148500	1.696	2.1734e-05	0.4533	N/A	N/A
149000	1.702	2.1639e-05	0.4396	N/A	N/A
149500	1.707	2.1544e-05	0.4555	N/A	N/A
150000	1.713	2.1449e-05	0.493	N/A	N/A
150500	1.719	2.1353e-05	0.4477	N/A	N/A
151000	1.725	2.1258e-05	0.4519	N/A	N/A
151500	1.73	2.1163e-05	0.4638	N/A	N/A
152000	1.736	2.1068e-05	0.4461	N/A	N/A
152500	1.742	2.0973e-05	0.4611	N/A	N/A
153000	1.747	2.0878e-05	0.4452	N/A	N/A
153500	1.753	2.0782e-05	0.4843	N/A	N/A
154000	1.759	2.0687e-05	0.4895	N/A	N/A
154500	1.764	2.0592e-05	0.4434	N/A	N/A
155000	1.77	2.0497e-05	0.449	N/A	N/A
155500	1.776	2.0402e-05	0.4875	N/A	N/A
156000	1.782	2.0307e-05	0.4694	N/A	N/A
156500	1.787	2.0211e-05	0.4714	N/A	N/A
157000	1.793	2.0116e-05	0.4611	N/A	N/A
157500	1.799	2.0021e-05	0.4716	N/A	N/A
158000	1.804	1.9926e-05	0.4257	N/A	N/A
158500	1.81	1.9831e-05	0.453	N/A	N/A
159000	1.816	1.9736e-05	0.4511	N/A	N/A
159500	1.822	1.9640e-05	0.4679	N/A	N/A
160000	1.827	1.9545e-05	0.4641	N/A	N/A
160500	1.833	1.9450e-05	0.4493	N/A	N/A
161000	1.839	1.9355e-05	0.4512	N/A	N/A
161500	1.844	1.9260e-05	0.4487	N/A	N/A
162000	1.85	1.9165e-05	0.4604	N/A	N/A
162500	1.856	1.9069e-05	0.4471	N/A	N/A
163000	1.862	1.8974e-05	0.452	N/A	N/A
163500	1.867	1.8879e-05	0.465	N/A	N/A
164000	1.873	1.8784e-05	0.453	N/A	N/A
164500	1.879	1.8689e-05	0.4472	N/A	N/A
165000	1.884	1.8594e-05	0.48	N/A	N/A
165500	1.89	1.8498e-05	0.4671	N/A	N/A
166000	1.896	1.8403e-05	0.4563	N/A	N/A
166500	1.902	1.8308e-05	0.4476	N/A	N/A
167000	1.907	1.8213e-05	0.4556	N/A	N/A
167500	1.913	1.8118e-05	0.4519	N/A	N/A
168000	1.919	1.8022e-05	0.4433	N/A	N/A
168500	1.924	1.7927e-05	0.4703	N/A	N/A
169000	1.93	1.7832e-05	0.4761	N/A	N/A
169500	1.936	1.7737e-05	0.4636	N/A	N/A
170000	1.942	1.7642e-05	0.4569	N/A	N/A
170500	1.947	1.7547e-05	0.4726	N/A	N/A
171000	1.953	1.7451e-05	0.4696	N/A	N/A
171500	1.959	1.7356e-05	0.4562	N/A	N/A
172000	1.964	1.7261e-05	0.4461	N/A	N/A
172500	1.97	1.7166e-05	0.4584	N/A	N/A
173000	1.976	1.7071e-05	0.4559	N/A	N/A
173500	1.981	1.6976e-05	0.4686	N/A	N/A
174000	1.987	1.6880e-05	0.4381	N/A	N/A
174500	1.993	1.6785e-05	0.4345	N/A	N/A
175000	1.999	1.6690e-05	0.4277	N/A	N/A
175122	2.0	N/A	N/A	0.5446	0.8239
175500	2.004	1.6595e-05	0.4027	N/A	N/A
176000	2.01	1.6500e-05	0.3582	N/A	N/A
176500	2.016	1.6405e-05	0.3758	N/A	N/A
177000	2.021	1.6309e-05	0.3858	N/A	N/A
177500	2.027	1.6214e-05	0.361	N/A	N/A
178000	2.033	1.6119e-05	0.378	N/A	N/A
178500	2.039	1.6024e-05	0.3945	N/A	N/A
179000	2.044	1.5929e-05	0.358	N/A	N/A
179500	2.05	1.5834e-05	0.36	N/A	N/A
180000	2.056	1.5738e-05	0.3896	N/A	N/A
180500	2.061	1.5643e-05	0.3502	N/A	N/A
181000	2.067	1.5548e-05	0.3762	N/A	N/A
181500	2.073	1.5453e-05	0.3791	N/A	N/A
182000	2.079	1.5358e-05	0.3775	N/A	N/A
182500	2.084	1.5263e-05	0.3973	N/A	N/A
183000	2.09	1.5167e-05	0.3737	N/A	N/A
183500	2.096	1.5072e-05	0.3759	N/A	N/A
184000	2.101	1.4977e-05	0.3679	N/A	N/A
184500	2.107	1.4882e-05	0.3893	N/A	N/A
185000	2.113	1.4787e-05	0.3815	N/A	N/A
185500	2.119	1.4691e-05	0.3867	N/A	N/A
186000	2.124	1.4596e-05	0.3492	N/A	N/A
186500	2.13	1.4501e-05	0.3892	N/A	N/A
187000	2.136	1.4406e-05	0.3855	N/A	N/A
187500	2.141	1.4311e-05	0.3621	N/A	N/A
188000	2.147	1.4216e-05	0.3613	N/A	N/A
188500	2.153	1.4120e-05	0.3755	N/A	N/A
189000	2.158	1.4025e-05	0.38	N/A	N/A
189500	2.164	1.3930e-05	0.3507	N/A	N/A
190000	2.17	1.3835e-05	0.3671	N/A	N/A
190500	2.176	1.3740e-05	0.3662	N/A	N/A
191000	2.181	1.3645e-05	0.3894	N/A	N/A
191500	2.187	1.3549e-05	0.3693	N/A	N/A
192000	2.193	1.3454e-05	0.3519	N/A	N/A
192500	2.198	1.3359e-05	0.3861	N/A	N/A
193000	2.204	1.3264e-05	0.3896	N/A	N/A
193500	2.21	1.3169e-05	0.3879	N/A	N/A
194000	2.216	1.3074e-05	0.3571	N/A	N/A
194500	2.221	1.2978e-05	0.3824	N/A	N/A
195000	2.227	1.2883e-05	0.3488	N/A	N/A
195500	2.233	1.2788e-05	0.4107	N/A	N/A
196000	2.238	1.2693e-05	0.3748	N/A	N/A
196500	2.244	1.2598e-05	0.3864	N/A	N/A
197000	2.25	1.2503e-05	0.3309	N/A	N/A
197500	2.256	1.2407e-05	0.3729	N/A	N/A
198000	2.261	1.2312e-05	0.4041	N/A	N/A
198500	2.267	1.2217e-05	0.3764	N/A	N/A
199000	2.273	1.2122e-05	0.395	N/A	N/A
199500	2.278	1.2027e-05	0.3856	N/A	N/A
200000	2.284	1.1931e-05	0.3826	N/A	N/A
200500	2.29	1.1836e-05	0.356	N/A	N/A
201000	2.296	1.1741e-05	0.3729	N/A	N/A
201500	2.301	1.1646e-05	0.3854	N/A	N/A
202000	2.307	1.1551e-05	0.3559	N/A	N/A
202500	2.313	1.1456e-05	0.3878	N/A	N/A
203000	2.318	1.1360e-05	0.3981	N/A	N/A
203500	2.324	1.1265e-05	0.3876	N/A	N/A
204000	2.33	1.1170e-05	0.3967	N/A	N/A
204500	2.336	1.1075e-05	0.3558	N/A	N/A
205000	2.341	1.0980e-05	0.3721	N/A	N/A
205500	2.347	1.0885e-05	0.3805	N/A	N/A
206000	2.353	1.0789e-05	0.3583	N/A	N/A
206500	2.358	1.0694e-05	0.3859	N/A	N/A
207000	2.364	1.0599e-05	0.3716	N/A	N/A
207500	2.37	1.0504e-05	0.3865	N/A	N/A
208000	2.375	1.0409e-05	0.391	N/A	N/A
208500	2.381	1.0314e-05	0.3384	N/A	N/A
209000	2.387	1.0218e-05	0.3591	N/A	N/A
209500	2.393	1.0123e-05	0.3987	N/A	N/A
210000	2.398	1.0028e-05	0.3516	N/A	N/A
210500	2.404	9.9329e-06	0.3696	N/A	N/A
211000	2.41	9.8377e-06	0.3825	N/A	N/A
211500	2.415	9.7425e-06	0.3894	N/A	N/A
212000	2.421	9.6474e-06	0.3534	N/A	N/A
212500	2.427	9.5522e-06	0.3621	N/A	N/A
213000	2.433	9.4570e-06	0.3863	N/A	N/A
213500	2.438	9.3619e-06	0.3661	N/A	N/A
214000	2.444	9.2667e-06	0.3733	N/A	N/A
214500	2.45	9.1715e-06	0.3567	N/A	N/A
215000	2.455	9.0763e-06	0.3715	N/A	N/A
215500	2.461	8.9812e-06	0.3568	N/A	N/A
216000	2.467	8.8860e-06	0.3669	N/A	N/A
216500	2.473	8.7908e-06	0.3854	N/A	N/A
217000	2.478	8.6957e-06	0.366	N/A	N/A
217500	2.484	8.6005e-06	0.377	N/A	N/A
218000	2.49	8.5053e-06	0.3699	N/A	N/A
218500	2.495	8.4101e-06	0.3784	N/A	N/A
219000	2.501	8.3150e-06	0.3786	N/A	N/A
219500	2.507	8.2198e-06	0.3788	N/A	N/A
220000	2.513	8.1246e-06	0.396	N/A	N/A
220500	2.518	8.0294e-06	0.3685	N/A	N/A
221000	2.524	7.9343e-06	0.3981	N/A	N/A
221500	2.53	7.8391e-06	0.3769	N/A	N/A
222000	2.535	7.7439e-06	0.3923	N/A	N/A
222500	2.541	7.6488e-06	0.3565	N/A	N/A
223000	2.547	7.5536e-06	0.383	N/A	N/A
223500	2.553	7.4584e-06	0.3621	N/A	N/A
224000	2.558	7.3632e-06	0.3496	N/A	N/A
224500	2.564	7.2681e-06	0.3536	N/A	N/A
225000	2.57	7.1729e-06	0.3574	N/A	N/A
225500	2.575	7.0777e-06	0.3467	N/A	N/A
226000	2.581	6.9826e-06	0.3689	N/A	N/A
226500	2.587	6.8874e-06	0.3466	N/A	N/A
227000	2.592	6.7922e-06	0.3563	N/A	N/A
227500	2.598	6.6970e-06	0.3823	N/A	N/A
228000	2.604	6.6019e-06	0.3616	N/A	N/A
228500	2.61	6.5067e-06	0.3349	N/A	N/A
229000	2.615	6.4115e-06	0.3809	N/A	N/A
229500	2.621	6.3164e-06	0.3652	N/A	N/A
230000	2.627	6.2212e-06	0.3698	N/A	N/A
230500	2.632	6.1260e-06	0.3355	N/A	N/A
231000	2.638	6.0308e-06	0.3759	N/A	N/A
231500	2.644	5.9357e-06	0.3796	N/A	N/A
232000	2.65	5.8405e-06	0.3669	N/A	N/A
232500	2.655	5.7453e-06	0.3617	N/A	N/A
233000	2.661	5.6502e-06	0.3637	N/A	N/A
233500	2.667	5.5550e-06	0.3872	N/A	N/A
234000	2.672	5.4598e-06	0.3403	N/A	N/A
234500	2.678	5.3646e-06	0.3538	N/A	N/A
235000	2.684	5.2695e-06	0.3637	N/A	N/A
235500	2.69	5.1743e-06	0.3474	N/A	N/A
236000	2.695	5.0791e-06	0.3837	N/A	N/A
236500	2.701	4.9840e-06	0.3911	N/A	N/A
237000	2.707	4.8888e-06	0.3443	N/A	N/A
237500	2.712	4.7936e-06	0.3783	N/A	N/A
238000	2.718	4.6984e-06	0.3625	N/A	N/A
238500	2.724	4.6033e-06	0.3233	N/A	N/A
239000	2.73	4.5081e-06	0.3656	N/A	N/A
239500	2.735	4.4129e-06	0.3754	N/A	N/A
240000	2.741	4.3178e-06	0.3671	N/A	N/A
240500	2.747	4.2226e-06	0.3611	N/A	N/A
241000	2.752	4.1274e-06	0.3807	N/A	N/A
241500	2.758	4.0322e-06	0.33	N/A	N/A
242000	2.764	3.9371e-06	0.3941	N/A	N/A
242500	2.769	3.8419e-06	0.3459	N/A	N/A
243000	2.775	3.7467e-06	0.3826	N/A	N/A
243500	2.781	3.6515e-06	0.3601	N/A	N/A
244000	2.787	3.5564e-06	0.3714	N/A	N/A
244500	2.792	3.4612e-06	0.3679	N/A	N/A
245000	2.798	3.3660e-06	0.3819	N/A	N/A
245500	2.804	3.2709e-06	0.3638	N/A	N/A
246000	2.809	3.1757e-06	0.3657	N/A	N/A
246500	2.815	3.0805e-06	0.3409	N/A	N/A
247000	2.821	2.9853e-06	0.3792	N/A	N/A
247500	2.827	2.8902e-06	0.3502	N/A	N/A
248000	2.832	2.7950e-06	0.3648	N/A	N/A
248500	2.838	2.6998e-06	0.3346	N/A	N/A
249000	2.844	2.6047e-06	0.419	N/A	N/A
249500	2.849	2.5095e-06	0.3644	N/A	N/A
250000	2.855	2.4143e-06	0.3726	N/A	N/A
250500	2.861	2.3191e-06	0.3561	N/A	N/A
251000	2.867	2.2240e-06	0.3456	N/A	N/A
251500	2.872	2.1288e-06	0.339	N/A	N/A
252000	2.878	2.0336e-06	0.373	N/A	N/A
252500	2.884	1.9385e-06	0.3712	N/A	N/A
253000	2.889	1.8433e-06	0.3313	N/A	N/A
253500	2.895	1.7481e-06	0.3329	N/A	N/A
254000	2.901	1.6529e-06	0.3392	N/A	N/A
254500	2.907	1.5578e-06	0.3687	N/A	N/A
255000	2.912	1.4626e-06	0.3394	N/A	N/A
255500	2.918	1.3674e-06	0.3276	N/A	N/A
256000	2.924	1.2723e-06	0.3687	N/A	N/A
256500	2.929	1.1771e-06	0.3545	N/A	N/A
257000	2.935	1.0819e-06	0.3818	N/A	N/A
257500	2.941	9.8674e-07	0.3758	N/A	N/A
258000	2.947	8.9157e-07	0.3559	N/A	N/A
258500	2.952	7.9640e-07	0.3885	N/A	N/A
259000	2.958	7.0123e-07	0.3473	N/A	N/A
259500	2.964	6.0605e-07	0.3593	N/A	N/A
260000	2.969	5.1088e-07	0.3702	N/A	N/A
260500	2.975	4.1571e-07	0.3614	N/A	N/A
261000	2.981	3.2054e-07	0.3607	N/A	N/A
261500	2.986	2.2537e-07	0.3123	N/A	N/A
262000	2.992	1.3019e-07	0.3572	N/A	N/A
262500	2.998	3.5023e-08	0.3545	N/A	N/A
262683	3.0	N/A	N/A	0.6053	0.8285

Framework Versions

• Transformers: 5.0.0.dev0
• PyTorch: 2.6.0+cu124