GIST-small-c4-en-doc_type_v2_primary

A fine-tuned version of the bert architecture (BertForSequenceClassification) optimized for the text-classification task.

• Model type: bert
• Problem Type: single_label_classification
• Number of Labels: 25
• Vocabulary Size: 30522
• License: MIT

Use

To get started with this model in Python using the Hugging Face Transformers library, run the following code:

from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch

model_id = "agentlans/GIST-small-c4-en-doc_type_v2_primary"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForSequenceClassification.from_pretrained(model_id)

text = "Replace this with your input text."
inputs = tokenizer(text, return_tensors="pt")

with torch.no_grad():
    logits = model(**inputs).logits

predicted_class_id = logits.argmax().item()
predicted_class_name = model.config.id2label[predicted_class_id]

print(f"Predicted Class ID: {predicted_class_id}")
print(f"Predicted Class Name: {predicted_class_name}")

Intended Uses & Limitations

Intended Use

This model is designed for sequence classification tasks. Below are the specific class labels mapped to their corresponding IDs:

Label ID	Label Name
0	About (Org.)
1	About (Personal)
2	Academic Writing
3	Audio Transcript
4	Comment Section
5	Content Listing
6	Creative Writing
7	Customer Support
8	Documentation
9	FAQ
10	Knowledge Article
11	Legal Notices
12	Listicle
13	News (Org.)
14	News Article
15	Nonfiction Writing
16	Other/Unclassified
17	Personal Blog
18	Product Page
19	Q&A Forum
20	Spam / Ads
21	Structured Data
22	Truncated
23	Tutorial
24	User Review

Training Details

Hyperparameters

The following hyperparameters were used during fine-tuning:

• Learning Rate: 5e-05
• Train Batch Size: 8
• Eval Batch Size: 8
• Optimizer: OptimizerNames.ADAMW_TORCH_FUSED
• Number of Epochs: 3.0
• Mixed Precision: BF16

Show Advanced Training Configuration

Optimization & Regularization

• Gradient Accumulation Steps: 1
• Learning Rate Scheduler: SchedulerType.LINEAR
• Warmup Steps: 0
• Warmup Ratio: None
• Weight Decay: 0.0
• Max Gradient Norm: 1.0

Hardware & Reproducibility

• Number of GPUs: 1
• Seed: 42

Training Results & Evaluation

During fine-tuning, the model achieved the following results on the evaluation set:

Metric	Value
Train Loss	0.6613
Validation Loss	0.7511
Validation F1 Score	0.7784
Total FLOPs	3.4624e+16

For performance on the test set, click here.

Speed Performance

• Training Runtime: 4513.963 seconds
• Train Samples per Second: 465.583
• Evaluation Runtime: 49.7968 seconds
• Eval Samples per Second: 1758.588

Show Detailed Training Logs

Training Logs History

Step	Epoch	Learning Rate	Training Loss	Validation Loss	Validation F1
500	0.006	4.9905e-05	2.1096	N/A	N/A
1000	0.011	4.9810e-05	1.4648	N/A	N/A
1500	0.017	4.9715e-05	1.3621	N/A	N/A
2000	0.023	4.9620e-05	1.2406	N/A	N/A
2500	0.029	4.9524e-05	1.1532	N/A	N/A
3000	0.034	4.9429e-05	1.0964	N/A	N/A
3500	0.04	4.9334e-05	1.0586	N/A	N/A
4000	0.046	4.9239e-05	1.0608	N/A	N/A
4500	0.051	4.9144e-05	1.0335	N/A	N/A
5000	0.057	4.9049e-05	1.0439	N/A	N/A
5500	0.063	4.8953e-05	0.9611	N/A	N/A
6000	0.069	4.8858e-05	0.9918	N/A	N/A
6500	0.074	4.8763e-05	0.9632	N/A	N/A
7000	0.08	4.8668e-05	0.9615	N/A	N/A
7500	0.086	4.8573e-05	0.957	N/A	N/A
8000	0.091	4.8478e-05	0.9505	N/A	N/A
8500	0.097	4.8382e-05	0.9517	N/A	N/A
9000	0.103	4.8287e-05	0.9335	N/A	N/A
9500	0.108	4.8192e-05	0.9379	N/A	N/A
10000	0.114	4.8097e-05	0.9304	N/A	N/A
10500	0.12	4.8002e-05	0.8961	N/A	N/A
11000	0.126	4.7907e-05	0.934	N/A	N/A
11500	0.131	4.7811e-05	0.8942	N/A	N/A
12000	0.137	4.7716e-05	0.9017	N/A	N/A
12500	0.143	4.7621e-05	0.8932	N/A	N/A
13000	0.148	4.7526e-05	0.9261	N/A	N/A
13500	0.154	4.7431e-05	0.8984	N/A	N/A
14000	0.16	4.7336e-05	0.9197	N/A	N/A
14500	0.166	4.7240e-05	0.8839	N/A	N/A
15000	0.171	4.7145e-05	0.9165	N/A	N/A
15500	0.177	4.7050e-05	0.9321	N/A	N/A
16000	0.183	4.6955e-05	0.9121	N/A	N/A
16500	0.188	4.6860e-05	0.925	N/A	N/A
17000	0.194	4.6765e-05	0.9058	N/A	N/A
17500	0.2	4.6669e-05	0.8676	N/A	N/A
18000	0.206	4.6574e-05	0.8977	N/A	N/A
18500	0.211	4.6479e-05	0.8639	N/A	N/A
19000	0.217	4.6384e-05	0.8852	N/A	N/A
19500	0.223	4.6289e-05	0.8676	N/A	N/A
20000	0.228	4.6194e-05	0.8666	N/A	N/A
20500	0.234	4.6098e-05	0.8814	N/A	N/A
21000	0.24	4.6003e-05	0.8668	N/A	N/A
21500	0.246	4.5908e-05	0.9004	N/A	N/A
22000	0.251	4.5813e-05	0.8746	N/A	N/A
22500	0.257	4.5718e-05	0.8618	N/A	N/A
23000	0.263	4.5623e-05	0.8505	N/A	N/A
23500	0.268	4.5527e-05	0.8469	N/A	N/A
24000	0.274	4.5432e-05	0.8396	N/A	N/A
24500	0.28	4.5337e-05	0.8524	N/A	N/A
25000	0.285	4.5242e-05	0.8757	N/A	N/A
25500	0.291	4.5147e-05	0.844	N/A	N/A
26000	0.297	4.5052e-05	0.8615	N/A	N/A
26500	0.303	4.4956e-05	0.8535	N/A	N/A
27000	0.308	4.4861e-05	0.8748	N/A	N/A
27500	0.314	4.4766e-05	0.8306	N/A	N/A
28000	0.32	4.4671e-05	0.8397	N/A	N/A
28500	0.325	4.4576e-05	0.8358	N/A	N/A
29000	0.331	4.4481e-05	0.8313	N/A	N/A
29500	0.337	4.4386e-05	0.8421	N/A	N/A
30000	0.343	4.4290e-05	0.8237	N/A	N/A
30500	0.348	4.4195e-05	0.857	N/A	N/A
31000	0.354	4.4100e-05	0.8299	N/A	N/A
31500	0.36	4.4005e-05	0.8107	N/A	N/A
32000	0.365	4.3910e-05	0.859	N/A	N/A
32500	0.371	4.3815e-05	0.8118	N/A	N/A
33000	0.377	4.3719e-05	0.8823	N/A	N/A
33500	0.383	4.3624e-05	0.8124	N/A	N/A
34000	0.388	4.3529e-05	0.8124	N/A	N/A
34500	0.394	4.3434e-05	0.8366	N/A	N/A
35000	0.4	4.3339e-05	0.8472	N/A	N/A
35500	0.405	4.3244e-05	0.8791	N/A	N/A
36000	0.411	4.3148e-05	0.8294	N/A	N/A
36500	0.417	4.3053e-05	0.8002	N/A	N/A
37000	0.423	4.2958e-05	0.8211	N/A	N/A
37500	0.428	4.2863e-05	0.8238	N/A	N/A
38000	0.434	4.2768e-05	0.8395	N/A	N/A
38500	0.44	4.2673e-05	0.8094	N/A	N/A
39000	0.445	4.2577e-05	0.8337	N/A	N/A
39500	0.451	4.2482e-05	0.8428	N/A	N/A
40000	0.457	4.2387e-05	0.8389	N/A	N/A
40500	0.462	4.2292e-05	0.8384	N/A	N/A
41000	0.468	4.2197e-05	0.8262	N/A	N/A
41500	0.474	4.2102e-05	0.7977	N/A	N/A
42000	0.48	4.2006e-05	0.7937	N/A	N/A
42500	0.485	4.1911e-05	0.8428	N/A	N/A
43000	0.491	4.1816e-05	0.8098	N/A	N/A
43500	0.497	4.1721e-05	0.8144	N/A	N/A
44000	0.502	4.1626e-05	0.8079	N/A	N/A
44500	0.508	4.1531e-05	0.8154	N/A	N/A
45000	0.514	4.1435e-05	0.8292	N/A	N/A
45500	0.52	4.1340e-05	0.7955	N/A	N/A
46000	0.525	4.1245e-05	0.7873	N/A	N/A
46500	0.531	4.1150e-05	0.7844	N/A	N/A
47000	0.537	4.1055e-05	0.7829	N/A	N/A
47500	0.542	4.0960e-05	0.814	N/A	N/A
48000	0.548	4.0864e-05	0.823	N/A	N/A
48500	0.554	4.0769e-05	0.8049	N/A	N/A
49000	0.56	4.0674e-05	0.7987	N/A	N/A
49500	0.565	4.0579e-05	0.7752	N/A	N/A
50000	0.571	4.0484e-05	0.813	N/A	N/A
50500	0.577	4.0389e-05	0.8187	N/A	N/A
51000	0.582	4.0293e-05	0.8087	N/A	N/A
51500	0.588	4.0198e-05	0.8138	N/A	N/A
52000	0.594	4.0103e-05	0.7928	N/A	N/A
52500	0.6	4.0008e-05	0.794	N/A	N/A
53000	0.605	3.9913e-05	0.819	N/A	N/A
53500	0.611	3.9818e-05	0.7804	N/A	N/A
54000	0.617	3.9722e-05	0.8267	N/A	N/A
54500	0.622	3.9627e-05	0.8193	N/A	N/A
55000	0.628	3.9532e-05	0.8122	N/A	N/A
55500	0.634	3.9437e-05	0.7854	N/A	N/A
56000	0.64	3.9342e-05	0.7966	N/A	N/A
56500	0.645	3.9247e-05	0.7814	N/A	N/A
57000	0.651	3.9151e-05	0.789	N/A	N/A
57500	0.657	3.9056e-05	0.7847	N/A	N/A
58000	0.662	3.8961e-05	0.7974	N/A	N/A
58500	0.668	3.8866e-05	0.7799	N/A	N/A
59000	0.674	3.8771e-05	0.8121	N/A	N/A
59500	0.679	3.8676e-05	0.7623	N/A	N/A
60000	0.685	3.8580e-05	0.7822	N/A	N/A
60500	0.691	3.8485e-05	0.8195	N/A	N/A
61000	0.697	3.8390e-05	0.7913	N/A	N/A
61500	0.702	3.8295e-05	0.7926	N/A	N/A
62000	0.708	3.8200e-05	0.8098	N/A	N/A
62500	0.714	3.8105e-05	0.7863	N/A	N/A
63000	0.719	3.8010e-05	0.7441	N/A	N/A
63500	0.725	3.7914e-05	0.7828	N/A	N/A
64000	0.731	3.7819e-05	0.7994	N/A	N/A
64500	0.737	3.7724e-05	0.7636	N/A	N/A
65000	0.742	3.7629e-05	0.7768	N/A	N/A
65500	0.748	3.7534e-05	0.7668	N/A	N/A
66000	0.754	3.7439e-05	0.7687	N/A	N/A
66500	0.759	3.7343e-05	0.7926	N/A	N/A
67000	0.765	3.7248e-05	0.7738	N/A	N/A
67500	0.771	3.7153e-05	0.8065	N/A	N/A
68000	0.777	3.7058e-05	0.7875	N/A	N/A
68500	0.782	3.6963e-05	0.7764	N/A	N/A
69000	0.788	3.6868e-05	0.7859	N/A	N/A
69500	0.794	3.6772e-05	0.7931	N/A	N/A
70000	0.799	3.6677e-05	0.782	N/A	N/A
70500	0.805	3.6582e-05	0.7724	N/A	N/A
71000	0.811	3.6487e-05	0.7762	N/A	N/A
71500	0.817	3.6392e-05	0.7556	N/A	N/A
72000	0.822	3.6297e-05	0.7461	N/A	N/A
72500	0.828	3.6201e-05	0.7626	N/A	N/A
73000	0.834	3.6106e-05	0.7635	N/A	N/A
73500	0.839	3.6011e-05	0.7642	N/A	N/A
74000	0.845	3.5916e-05	0.7867	N/A	N/A
74500	0.851	3.5821e-05	0.7846	N/A	N/A
75000	0.856	3.5726e-05	0.78	N/A	N/A
75500	0.862	3.5630e-05	0.7641	N/A	N/A
76000	0.868	3.5535e-05	0.7566	N/A	N/A
76500	0.874	3.5440e-05	0.761	N/A	N/A
77000	0.879	3.5345e-05	0.7636	N/A	N/A
77500	0.885	3.5250e-05	0.7825	N/A	N/A
78000	0.891	3.5155e-05	0.7937	N/A	N/A
78500	0.896	3.5059e-05	0.762	N/A	N/A
79000	0.902	3.4964e-05	0.7663	N/A	N/A
79500	0.908	3.4869e-05	0.7361	N/A	N/A
80000	0.914	3.4774e-05	0.7795	N/A	N/A
80500	0.919	3.4679e-05	0.7127	N/A	N/A
81000	0.925	3.4584e-05	0.7826	N/A	N/A
81500	0.931	3.4488e-05	0.7546	N/A	N/A
82000	0.936	3.4393e-05	0.7815	N/A	N/A
82500	0.942	3.4298e-05	0.7852	N/A	N/A
83000	0.948	3.4203e-05	0.7558	N/A	N/A
83500	0.954	3.4108e-05	0.7699	N/A	N/A
84000	0.959	3.4013e-05	0.736	N/A	N/A
84500	0.965	3.3917e-05	0.7546	N/A	N/A
85000	0.971	3.3822e-05	0.7477	N/A	N/A
85500	0.976	3.3727e-05	0.7401	N/A	N/A
86000	0.982	3.3632e-05	0.7825	N/A	N/A
86500	0.988	3.3537e-05	0.7471	N/A	N/A
87000	0.994	3.3442e-05	0.7953	N/A	N/A
87500	0.999	3.3346e-05	0.7437	N/A	N/A
87568	1.0	N/A	N/A	0.722	0.7581
88000	1.005	3.3251e-05	0.659	N/A	N/A
88500	1.011	3.3156e-05	0.6486	N/A	N/A
89000	1.016	3.3061e-05	0.6383	N/A	N/A
89500	1.022	3.2966e-05	0.6392	N/A	N/A
90000	1.028	3.2871e-05	0.6435	N/A	N/A
90500	1.033	3.2775e-05	0.6805	N/A	N/A
91000	1.039	3.2680e-05	0.6469	N/A	N/A
91500	1.045	3.2585e-05	0.6631	N/A	N/A
92000	1.051	3.2490e-05	0.6404	N/A	N/A
92500	1.056	3.2395e-05	0.6524	N/A	N/A
93000	1.062	3.2300e-05	0.6435	N/A	N/A
93500	1.068	3.2204e-05	0.672	N/A	N/A
94000	1.073	3.2109e-05	0.6613	N/A	N/A
94500	1.079	3.2014e-05	0.6243	N/A	N/A
95000	1.085	3.1919e-05	0.6519	N/A	N/A
95500	1.091	3.1824e-05	0.6402	N/A	N/A
96000	1.096	3.1729e-05	0.6828	N/A	N/A
96500	1.102	3.1634e-05	0.6734	N/A	N/A
97000	1.108	3.1538e-05	0.6624	N/A	N/A
97500	1.113	3.1443e-05	0.6281	N/A	N/A
98000	1.119	3.1348e-05	0.6617	N/A	N/A
98500	1.125	3.1253e-05	0.6485	N/A	N/A
99000	1.131	3.1158e-05	0.6495	N/A	N/A
99500	1.136	3.1063e-05	0.6656	N/A	N/A
100000	1.142	3.0967e-05	0.6832	N/A	N/A
100500	1.148	3.0872e-05	0.6636	N/A	N/A
101000	1.153	3.0777e-05	0.6556	N/A	N/A
101500	1.159	3.0682e-05	0.648	N/A	N/A
102000	1.165	3.0587e-05	0.6398	N/A	N/A
102500	1.171	3.0492e-05	0.663	N/A	N/A
103000	1.176	3.0396e-05	0.6625	N/A	N/A
103500	1.182	3.0301e-05	0.6615	N/A	N/A
104000	1.188	3.0206e-05	0.6512	N/A	N/A
104500	1.193	3.0111e-05	0.663	N/A	N/A
105000	1.199	3.0016e-05	0.6651	N/A	N/A
105500	1.205	2.9921e-05	0.6601	N/A	N/A
106000	1.21	2.9825e-05	0.6512	N/A	N/A
106500	1.216	2.9730e-05	0.6577	N/A	N/A
107000	1.222	2.9635e-05	0.6278	N/A	N/A
107500	1.228	2.9540e-05	0.6594	N/A	N/A
108000	1.233	2.9445e-05	0.6825	N/A	N/A
108500	1.239	2.9350e-05	0.6594	N/A	N/A
109000	1.245	2.9254e-05	0.6717	N/A	N/A
109500	1.25	2.9159e-05	0.6645	N/A	N/A
110000	1.256	2.9064e-05	0.6347	N/A	N/A
110500	1.262	2.8969e-05	0.6409	N/A	N/A
111000	1.268	2.8874e-05	0.6612	N/A	N/A
111500	1.273	2.8779e-05	0.6824	N/A	N/A
112000	1.279	2.8683e-05	0.6656	N/A	N/A
112500	1.285	2.8588e-05	0.634	N/A	N/A
113000	1.29	2.8493e-05	0.6445	N/A	N/A
113500	1.296	2.8398e-05	0.6339	N/A	N/A
114000	1.302	2.8303e-05	0.6437	N/A	N/A
114500	1.308	2.8208e-05	0.6335	N/A	N/A
115000	1.313	2.8112e-05	0.6377	N/A	N/A
115500	1.319	2.8017e-05	0.6234	N/A	N/A
116000	1.325	2.7922e-05	0.6359	N/A	N/A
116500	1.33	2.7827e-05	0.6504	N/A	N/A
117000	1.336	2.7732e-05	0.6286	N/A	N/A
117500	1.342	2.7637e-05	0.6481	N/A	N/A
118000	1.348	2.7541e-05	0.6516	N/A	N/A
118500	1.353	2.7446e-05	0.6493	N/A	N/A
119000	1.359	2.7351e-05	0.634	N/A	N/A
119500	1.365	2.7256e-05	0.6497	N/A	N/A
120000	1.37	2.7161e-05	0.627	N/A	N/A
120500	1.376	2.7066e-05	0.6659	N/A	N/A
121000	1.382	2.6970e-05	0.6184	N/A	N/A
121500	1.387	2.6875e-05	0.6332	N/A	N/A
122000	1.393	2.6780e-05	0.6281	N/A	N/A
122500	1.399	2.6685e-05	0.6542	N/A	N/A
123000	1.405	2.6590e-05	0.6455	N/A	N/A
123500	1.41	2.6495e-05	0.6248	N/A	N/A
124000	1.416	2.6399e-05	0.6468	N/A	N/A
124500	1.422	2.6304e-05	0.6635	N/A	N/A
125000	1.427	2.6209e-05	0.6441	N/A	N/A
125500	1.433	2.6114e-05	0.6369	N/A	N/A
126000	1.439	2.6019e-05	0.6569	N/A	N/A
126500	1.445	2.5924e-05	0.6708	N/A	N/A
127000	1.45	2.5828e-05	0.6348	N/A	N/A
127500	1.456	2.5733e-05	0.6337	N/A	N/A
128000	1.462	2.5638e-05	0.6317	N/A	N/A
128500	1.467	2.5543e-05	0.6391	N/A	N/A
129000	1.473	2.5448e-05	0.6351	N/A	N/A
129500	1.479	2.5353e-05	0.6481	N/A	N/A
130000	1.485	2.5258e-05	0.6466	N/A	N/A
130500	1.49	2.5162e-05	0.64	N/A	N/A
131000	1.496	2.5067e-05	0.611	N/A	N/A
131500	1.502	2.4972e-05	0.6497	N/A	N/A
132000	1.507	2.4877e-05	0.6564	N/A	N/A
132500	1.513	2.4782e-05	0.6225	N/A	N/A
133000	1.519	2.4687e-05	0.6661	N/A	N/A
133500	1.525	2.4591e-05	0.6548	N/A	N/A
134000	1.53	2.4496e-05	0.6521	N/A	N/A
134500	1.536	2.4401e-05	0.6498	N/A	N/A
135000	1.542	2.4306e-05	0.6381	N/A	N/A
135500	1.547	2.4211e-05	0.6415	N/A	N/A
136000	1.553	2.4116e-05	0.6379	N/A	N/A
136500	1.559	2.4020e-05	0.6393	N/A	N/A
137000	1.564	2.3925e-05	0.6446	N/A	N/A
137500	1.57	2.3830e-05	0.671	N/A	N/A
138000	1.576	2.3735e-05	0.6055	N/A	N/A
138500	1.582	2.3640e-05	0.6551	N/A	N/A
139000	1.587	2.3545e-05	0.6315	N/A	N/A
139500	1.593	2.3449e-05	0.6614	N/A	N/A
140000	1.599	2.3354e-05	0.6866	N/A	N/A
140500	1.604	2.3259e-05	0.6231	N/A	N/A
141000	1.61	2.3164e-05	0.623	N/A	N/A
141500	1.616	2.3069e-05	0.6352	N/A	N/A
142000	1.622	2.2974e-05	0.6648	N/A	N/A
142500	1.627	2.2878e-05	0.6145	N/A	N/A
143000	1.633	2.2783e-05	0.6563	N/A	N/A
143500	1.639	2.2688e-05	0.6508	N/A	N/A
144000	1.644	2.2593e-05	0.6351	N/A	N/A
144500	1.65	2.2498e-05	0.6427	N/A	N/A
145000	1.656	2.2403e-05	0.6498	N/A	N/A
145500	1.662	2.2307e-05	0.606	N/A	N/A
146000	1.667	2.2212e-05	0.6561	N/A	N/A
146500	1.673	2.2117e-05	0.6608	N/A	N/A
147000	1.679	2.2022e-05	0.6519	N/A	N/A
147500	1.684	2.1927e-05	0.6234	N/A	N/A
148000	1.69	2.1832e-05	0.6215	N/A	N/A
148500	1.696	2.1736e-05	0.6312	N/A	N/A
149000	1.702	2.1641e-05	0.6238	N/A	N/A
149500	1.707	2.1546e-05	0.6492	N/A	N/A
150000	1.713	2.1451e-05	0.6585	N/A	N/A
150500	1.719	2.1356e-05	0.649	N/A	N/A
151000	1.724	2.1261e-05	0.6313	N/A	N/A
151500	1.73	2.1165e-05	0.6383	N/A	N/A
152000	1.736	2.1070e-05	0.6315	N/A	N/A
152500	1.742	2.0975e-05	0.6738	N/A	N/A
153000	1.747	2.0880e-05	0.643	N/A	N/A
153500	1.753	2.0785e-05	0.602	N/A	N/A
154000	1.759	2.0690e-05	0.6264	N/A	N/A
154500	1.764	2.0594e-05	0.6519	N/A	N/A
155000	1.77	2.0499e-05	0.6283	N/A	N/A
155500	1.776	2.0404e-05	0.6311	N/A	N/A
156000	1.781	2.0309e-05	0.5985	N/A	N/A
156500	1.787	2.0214e-05	0.6448	N/A	N/A
157000	1.793	2.0119e-05	0.6223	N/A	N/A
157500	1.799	2.0023e-05	0.63	N/A	N/A
158000	1.804	1.9928e-05	0.6233	N/A	N/A
158500	1.81	1.9833e-05	0.6232	N/A	N/A
159000	1.816	1.9738e-05	0.5908	N/A	N/A
159500	1.821	1.9643e-05	0.6251	N/A	N/A
160000	1.827	1.9548e-05	0.6112	N/A	N/A
160500	1.833	1.9453e-05	0.5847	N/A	N/A
161000	1.839	1.9357e-05	0.637	N/A	N/A
161500	1.844	1.9262e-05	0.6167	N/A	N/A
162000	1.85	1.9167e-05	0.6244	N/A	N/A
162500	1.856	1.9072e-05	0.642	N/A	N/A
163000	1.861	1.8977e-05	0.6376	N/A	N/A
163500	1.867	1.8882e-05	0.6274	N/A	N/A
164000	1.873	1.8786e-05	0.6179	N/A	N/A
164500	1.879	1.8691e-05	0.6112	N/A	N/A
165000	1.884	1.8596e-05	0.6363	N/A	N/A
165500	1.89	1.8501e-05	0.6505	N/A	N/A
166000	1.896	1.8406e-05	0.5786	N/A	N/A
166500	1.901	1.8311e-05	0.6278	N/A	N/A
167000	1.907	1.8215e-05	0.6252	N/A	N/A
167500	1.913	1.8120e-05	0.6246	N/A	N/A
168000	1.919	1.8025e-05	0.5948	N/A	N/A
168500	1.924	1.7930e-05	0.6307	N/A	N/A
169000	1.93	1.7835e-05	0.6297	N/A	N/A
169500	1.936	1.7740e-05	0.5957	N/A	N/A
170000	1.941	1.7644e-05	0.6069	N/A	N/A
170500	1.947	1.7549e-05	0.6206	N/A	N/A
171000	1.953	1.7454e-05	0.6349	N/A	N/A
171500	1.958	1.7359e-05	0.6087	N/A	N/A
172000	1.964	1.7264e-05	0.6057	N/A	N/A
172500	1.97	1.7169e-05	0.6345	N/A	N/A
173000	1.976	1.7073e-05	0.6136	N/A	N/A
173500	1.981	1.6978e-05	0.6153	N/A	N/A
174000	1.987	1.6883e-05	0.618	N/A	N/A
174500	1.993	1.6788e-05	0.5829	N/A	N/A
175000	1.998	1.6693e-05	0.6237	N/A	N/A
175136	2.0	N/A	N/A	0.7202	0.7665
175500	2.004	1.6598e-05	0.5356	N/A	N/A
176000	2.01	1.6502e-05	0.4917	N/A	N/A
176500	2.016	1.6407e-05	0.4878	N/A	N/A
177000	2.021	1.6312e-05	0.5695	N/A	N/A
177500	2.027	1.6217e-05	0.487	N/A	N/A
178000	2.033	1.6122e-05	0.5238	N/A	N/A
178500	2.038	1.6027e-05	0.5138	N/A	N/A
179000	2.044	1.5931e-05	0.4774	N/A	N/A
179500	2.05	1.5836e-05	0.5282	N/A	N/A
180000	2.056	1.5741e-05	0.5048	N/A	N/A
180500	2.061	1.5646e-05	0.5413	N/A	N/A
181000	2.067	1.5551e-05	0.5132	N/A	N/A
181500	2.073	1.5456e-05	0.4966	N/A	N/A
182000	2.078	1.5360e-05	0.4817	N/A	N/A
182500	2.084	1.5265e-05	0.5095	N/A	N/A
183000	2.09	1.5170e-05	0.5062	N/A	N/A
183500	2.096	1.5075e-05	0.516	N/A	N/A
184000	2.101	1.4980e-05	0.5008	N/A	N/A
184500	2.107	1.4885e-05	0.4807	N/A	N/A
185000	2.113	1.4789e-05	0.4864	N/A	N/A
185500	2.118	1.4694e-05	0.5285	N/A	N/A
186000	2.124	1.4599e-05	0.5184	N/A	N/A
186500	2.13	1.4504e-05	0.4782	N/A	N/A
187000	2.135	1.4409e-05	0.531	N/A	N/A
187500	2.141	1.4314e-05	0.4952	N/A	N/A
188000	2.147	1.4218e-05	0.5107	N/A	N/A
188500	2.153	1.4123e-05	0.504	N/A	N/A
189000	2.158	1.4028e-05	0.5031	N/A	N/A
189500	2.164	1.3933e-05	0.4969	N/A	N/A
190000	2.17	1.3838e-05	0.5095	N/A	N/A
190500	2.175	1.3743e-05	0.487	N/A	N/A
191000	2.181	1.3647e-05	0.4987	N/A	N/A
191500	2.187	1.3552e-05	0.5399	N/A	N/A
192000	2.193	1.3457e-05	0.5181	N/A	N/A
192500	2.198	1.3362e-05	0.5188	N/A	N/A
193000	2.204	1.3267e-05	0.4914	N/A	N/A
193500	2.21	1.3172e-05	0.4977	N/A	N/A
194000	2.215	1.3077e-05	0.5281	N/A	N/A
194500	2.221	1.2981e-05	0.5216	N/A	N/A
195000	2.227	1.2886e-05	0.5007	N/A	N/A
195500	2.233	1.2791e-05	0.5345	N/A	N/A
196000	2.238	1.2696e-05	0.5089	N/A	N/A
196500	2.244	1.2601e-05	0.5231	N/A	N/A
197000	2.25	1.2506e-05	0.4953	N/A	N/A
197500	2.255	1.2410e-05	0.4989	N/A	N/A
198000	2.261	1.2315e-05	0.4903	N/A	N/A
198500	2.267	1.2220e-05	0.5088	N/A	N/A
199000	2.273	1.2125e-05	0.4875	N/A	N/A
199500	2.278	1.2030e-05	0.5118	N/A	N/A
200000	2.284	1.1935e-05	0.5184	N/A	N/A
200500	2.29	1.1839e-05	0.4807	N/A	N/A
201000	2.295	1.1744e-05	0.5112	N/A	N/A
201500	2.301	1.1649e-05	0.5064	N/A	N/A
202000	2.307	1.1554e-05	0.5246	N/A	N/A
202500	2.312	1.1459e-05	0.496	N/A	N/A
203000	2.318	1.1364e-05	0.5101	N/A	N/A
203500	2.324	1.1268e-05	0.5184	N/A	N/A
204000	2.33	1.1173e-05	0.5134	N/A	N/A
204500	2.335	1.1078e-05	0.4875	N/A	N/A
205000	2.341	1.0983e-05	0.4975	N/A	N/A
205500	2.347	1.0888e-05	0.5156	N/A	N/A
206000	2.352	1.0793e-05	0.4994	N/A	N/A
206500	2.358	1.0697e-05	0.5309	N/A	N/A
207000	2.364	1.0602e-05	0.4896	N/A	N/A
207500	2.37	1.0507e-05	0.5013	N/A	N/A
208000	2.375	1.0412e-05	0.4921	N/A	N/A
208500	2.381	1.0317e-05	0.5007	N/A	N/A
209000	2.387	1.0222e-05	0.4899	N/A	N/A
209500	2.392	1.0126e-05	0.4943	N/A	N/A
210000	2.398	1.0031e-05	0.5005	N/A	N/A
210500	2.404	9.9361e-06	0.4829	N/A	N/A
211000	2.41	9.8409e-06	0.518	N/A	N/A
211500	2.415	9.7458e-06	0.488	N/A	N/A
212000	2.421	9.6506e-06	0.5206	N/A	N/A
212500	2.427	9.5554e-06	0.5191	N/A	N/A
213000	2.432	9.4603e-06	0.5082	N/A	N/A
213500	2.438	9.3651e-06	0.4815	N/A	N/A
214000	2.444	9.2699e-06	0.4982	N/A	N/A
214500	2.45	9.1748e-06	0.5104	N/A	N/A
215000	2.455	9.0796e-06	0.5283	N/A	N/A
215500	2.461	8.9844e-06	0.5583	N/A	N/A
216000	2.467	8.8893e-06	0.4807	N/A	N/A
216500	2.472	8.7941e-06	0.4798	N/A	N/A
217000	2.478	8.6990e-06	0.5315	N/A	N/A
217500	2.484	8.6038e-06	0.4787	N/A	N/A
218000	2.489	8.5086e-06	0.4636	N/A	N/A
218500	2.495	8.4135e-06	0.4542	N/A	N/A
219000	2.501	8.3183e-06	0.5046	N/A	N/A
219500	2.507	8.2231e-06	0.4901	N/A	N/A
220000	2.512	8.1280e-06	0.5143	N/A	N/A
220500	2.518	8.0328e-06	0.5058	N/A	N/A
221000	2.524	7.9376e-06	0.5047	N/A	N/A
221500	2.529	7.8425e-06	0.4844	N/A	N/A
222000	2.535	7.7473e-06	0.5217	N/A	N/A
222500	2.541	7.6521e-06	0.4538	N/A	N/A
223000	2.547	7.5570e-06	0.5075	N/A	N/A
223500	2.552	7.4618e-06	0.4616	N/A	N/A
224000	2.558	7.3667e-06	0.4933	N/A	N/A
224500	2.564	7.2715e-06	0.5003	N/A	N/A
225000	2.569	7.1763e-06	0.4879	N/A	N/A
225500	2.575	7.0812e-06	0.4931	N/A	N/A
226000	2.581	6.9860e-06	0.5156	N/A	N/A
226500	2.587	6.8908e-06	0.5031	N/A	N/A
227000	2.592	6.7957e-06	0.4983	N/A	N/A
227500	2.598	6.7005e-06	0.4943	N/A	N/A
228000	2.604	6.6053e-06	0.4487	N/A	N/A
228500	2.609	6.5102e-06	0.4816	N/A	N/A
229000	2.615	6.4150e-06	0.5101	N/A	N/A
229500	2.621	6.3199e-06	0.4756	N/A	N/A
230000	2.627	6.2247e-06	0.4904	N/A	N/A
230500	2.632	6.1295e-06	0.4607	N/A	N/A
231000	2.638	6.0344e-06	0.4957	N/A	N/A
231500	2.644	5.9392e-06	0.478	N/A	N/A
232000	2.649	5.8440e-06	0.5147	N/A	N/A
232500	2.655	5.7489e-06	0.4972	N/A	N/A
233000	2.661	5.6537e-06	0.4959	N/A	N/A
233500	2.666	5.5585e-06	0.4734	N/A	N/A
234000	2.672	5.4634e-06	0.5072	N/A	N/A
234500	2.678	5.3682e-06	0.5031	N/A	N/A
235000	2.684	5.2730e-06	0.4865	N/A	N/A
235500	2.689	5.1779e-06	0.4752	N/A	N/A
236000	2.695	5.0827e-06	0.492	N/A	N/A
236500	2.701	4.9876e-06	0.4619	N/A	N/A
237000	2.706	4.8924e-06	0.4456	N/A	N/A
237500	2.712	4.7972e-06	0.4891	N/A	N/A
238000	2.718	4.7021e-06	0.467	N/A	N/A
238500	2.724	4.6069e-06	0.4767	N/A	N/A
239000	2.729	4.5117e-06	0.4795	N/A	N/A
239500	2.735	4.4166e-06	0.4836	N/A	N/A
240000	2.741	4.3214e-06	0.5013	N/A	N/A
240500	2.746	4.2262e-06	0.4696	N/A	N/A
241000	2.752	4.1311e-06	0.4954	N/A	N/A
241500	2.758	4.0359e-06	0.4884	N/A	N/A
242000	2.764	3.9407e-06	0.4777	N/A	N/A
242500	2.769	3.8456e-06	0.4897	N/A	N/A
243000	2.775	3.7504e-06	0.4867	N/A	N/A
243500	2.781	3.6553e-06	0.4891	N/A	N/A
244000	2.786	3.5601e-06	0.4855	N/A	N/A
244500	2.792	3.4649e-06	0.4863	N/A	N/A
245000	2.798	3.3698e-06	0.4832	N/A	N/A
245500	2.804	3.2746e-06	0.4976	N/A	N/A
246000	2.809	3.1794e-06	0.4946	N/A	N/A
246500	2.815	3.0843e-06	0.4699	N/A	N/A
247000	2.821	2.9891e-06	0.4818	N/A	N/A
247500	2.826	2.8939e-06	0.4643	N/A	N/A
248000	2.832	2.7988e-06	0.4848	N/A	N/A
248500	2.838	2.7036e-06	0.4887	N/A	N/A
249000	2.844	2.6084e-06	0.4957	N/A	N/A
249500	2.849	2.5133e-06	0.4544	N/A	N/A
250000	2.855	2.4181e-06	0.4918	N/A	N/A
250500	2.861	2.3230e-06	0.4396	N/A	N/A
251000	2.866	2.2278e-06	0.4775	N/A	N/A
251500	2.872	2.1326e-06	0.5189	N/A	N/A
252000	2.878	2.0375e-06	0.5059	N/A	N/A
252500	2.883	1.9423e-06	0.4876	N/A	N/A
253000	2.889	1.8471e-06	0.4754	N/A	N/A
253500	2.895	1.7520e-06	0.5116	N/A	N/A
254000	2.901	1.6568e-06	0.4644	N/A	N/A
254500	2.906	1.5616e-06	0.4642	N/A	N/A
255000	2.912	1.4665e-06	0.4747	N/A	N/A
255500	2.918	1.3713e-06	0.4719	N/A	N/A
256000	2.923	1.2762e-06	0.4858	N/A	N/A
256500	2.929	1.1810e-06	0.4804	N/A	N/A
257000	2.935	1.0858e-06	0.4858	N/A	N/A
257500	2.941	9.9066e-07	0.4857	N/A	N/A
258000	2.946	8.9549e-07	0.4913	N/A	N/A
258500	2.952	8.0033e-07	0.4589	N/A	N/A
259000	2.958	7.0517e-07	0.5143	N/A	N/A
259500	2.963	6.1000e-07	0.484	N/A	N/A
260000	2.969	5.1484e-07	0.5094	N/A	N/A
260500	2.975	4.1967e-07	0.4875	N/A	N/A
261000	2.981	3.2451e-07	0.4676	N/A	N/A
261500	2.986	2.2935e-07	0.4857	N/A	N/A
262000	2.992	1.3418e-07	0.4703	N/A	N/A
262500	2.998	3.9017e-08	0.4785	N/A	N/A
262704	3.0	N/A	N/A	0.7511	0.7784

Framework Versions

• Transformers: 5.0.0.dev0
• PyTorch: 2.6.0+cu124