GIST-small-c4-en-fdc_label

A fine-tuned version of the bert architecture (BertForSequenceClassification) optimized for the text-classification task.

• Model type: bert
• Problem Type: single_label_classification
• Number of Labels: 97
• Vocabulary Size: 30522
• License: MIT

Use

To get started with this model in Python using the Hugging Face Transformers library, run the following code:

from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch

model_id = "agentlans/GIST-small-c4-en-fdc_label"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForSequenceClassification.from_pretrained(model_id)

text = "Replace this with your input text."
inputs = tokenizer(text, return_tensors="pt")

with torch.no_grad():
    logits = model(**inputs).logits

predicted_class_id = logits.argmax().item()
predicted_class_name = model.config.id2label[predicted_class_id]

print(f"Predicted Class ID: {predicted_class_id}")
print(f"Predicted Class Name: {predicted_class_name}")

Intended Uses & Limitations

Intended Use

This model is designed for sequence classification tasks. Below are the specific class labels mapped to their corresponding IDs:

Label ID	Label Name
0	000 General works, books and libraries, information sciences
1	010 Bibliography
2	020 Library science
3	030 Encyclopedias
4	060 Associations, institutions, etc.
5	070 Journalism + Newspapers
6	090 Rare books
7	100 Philosophy and psychology
8	110 Metaphysics
9	120 Special metaphysical topics
10	130 Mind and body + Parapsychology
11	150 Psychology
12	160 Logic
13	170 Ethics
14	180 Philosophy, Ancient
15	190 Philosophy, Modern + Modern philosophy
16	200 Religion
17	210 Natural theology + Secularism
18	220 Bible
19	230 Theology, Doctrinal
20	240 Devotional literature + Theology, Practical
21	250 Pastoral theology
22	260 Church + Church work
23	270 Church history
24	280 Christian sects
25	290 Religions
26	300 Social sciences
27	310 Statistics
28	320 Political science
29	330 Economics
30	340 Law
31	350 Public administration + Military art and science
32	360 Social service + Societies
33	370 Education
34	380 Commerce + Communication and traffic
35	390 Ethnology
36	400 (Philology + Language and languages)
37	410 Linguistics
38	420 English language
39	430 German language + Germanic languages
40	440 French language
41	450 Italian language + Romanian language
42	460 Spanish language + Portuguese language
43	470 Latin language + Latin philology
44	480 Greek language + Greek philology
45	490 Other languages
46	500 Science + Natural history
47	510 Mathematics
48	520 Astronomy
49	530 Physics
50	540 Chemistry
51	550 Geology + Earth sciences
52	560 Paleontology
53	570 Biology + Anthropology
54	580 Botany
55	590 Zoology
56	600 Industrial arts + Technology + Engineering
57	610 Medicine
58	620 Engineering
59	630 Agriculture
60	640 Home economics
61	650 Business
62	660 Chemistry, Technical + Chemical engineering
63	670 Manufactures
64	680 Handicraft + Occupations
65	690 Building
66	700 Arts
67	710 Gardening (ornamental) + Parks + Forests and forestry (in conservation applications)
68	720 Architecture
69	730 Sculpture
70	740 Drawing + Decoration and ornament + Design
71	750 Painting + Art
72	760 Engraving + Graphic arts
73	770 Photography
74	780 Music
75	790 Amusements + Recreation
76	800 Literature
77	810 American literature
78	820 English literature
79	830 German literature
80	840 French literature
81	850 Italian literature + Romanian literature
82	860 Spanish literature
83	870 Latin literature
84	880 Greek literature + Classical literature
85	890 Literature of other languages
86	900 History + Geography
87	910 Geography + Voyages and travels
88	920 Biography
89	930 History, Ancient
90	940 Europe
91	950 Asia
92	960 Africa
93	970 America + North America
94	980 South America + Latin America
95	990 Oceania + Polar regions
96	No numerical value found

Training Details

Hyperparameters

The following hyperparameters were used during fine-tuning:

• Learning Rate: 5e-05
• Train Batch Size: 8
• Eval Batch Size: 8
• Optimizer: OptimizerNames.ADAMW_TORCH_FUSED
• Number of Epochs: 3.0
• Mixed Precision: BF16

Show Advanced Training Configuration

Optimization & Regularization

• Gradient Accumulation Steps: 1
• Learning Rate Scheduler: SchedulerType.LINEAR
• Warmup Steps: 0
• Warmup Ratio: None
• Weight Decay: 0.0
• Max Gradient Norm: 1.0

Hardware & Reproducibility

• Number of GPUs: 1
• Seed: 42

Training Results & Evaluation

During fine-tuning, the model achieved the following results on the evaluation set:

Metric	Value
Train Loss	0.6757
Validation Loss	0.7441
Validation F1 Score	0.7959
Total FLOPs	3.4669e+16

For performance on the test set, click here.

Speed Performance

• Training Runtime: 4481.1778 seconds
• Train Samples per Second: 468.994
• Evaluation Runtime: 50.5304 seconds
• Eval Samples per Second: 1733.153

Show Detailed Training Logs

Training Logs History

Step	Epoch	Learning Rate	Training Loss	Validation Loss	Validation F1
500	0.006	4.9905e-05	3.2484	N/A	N/A
1000	0.011	4.9810e-05	2.2234	N/A	N/A
1500	0.017	4.9715e-05	1.8096	N/A	N/A
2000	0.023	4.9620e-05	1.6278	N/A	N/A
2500	0.029	4.9524e-05	1.4821	N/A	N/A
3000	0.034	4.9429e-05	1.3918	N/A	N/A
3500	0.04	4.9334e-05	1.3422	N/A	N/A
4000	0.046	4.9239e-05	1.311	N/A	N/A
4500	0.051	4.9144e-05	1.2493	N/A	N/A
5000	0.057	4.9049e-05	1.2252	N/A	N/A
5500	0.063	4.8953e-05	1.1714	N/A	N/A
6000	0.069	4.8858e-05	1.1694	N/A	N/A
6500	0.074	4.8763e-05	1.1149	N/A	N/A
7000	0.08	4.8668e-05	1.1245	N/A	N/A
7500	0.086	4.8573e-05	1.1109	N/A	N/A
8000	0.091	4.8478e-05	1.1026	N/A	N/A
8500	0.097	4.8382e-05	1.1071	N/A	N/A
9000	0.103	4.8287e-05	1.0828	N/A	N/A
9500	0.108	4.8192e-05	1.0552	N/A	N/A
10000	0.114	4.8097e-05	1.049	N/A	N/A
10500	0.12	4.8002e-05	1.0768	N/A	N/A
11000	0.126	4.7907e-05	1.044	N/A	N/A
11500	0.131	4.7811e-05	1.0157	N/A	N/A
12000	0.137	4.7716e-05	1.0245	N/A	N/A
12500	0.143	4.7621e-05	0.9937	N/A	N/A
13000	0.148	4.7526e-05	1.052	N/A	N/A
13500	0.154	4.7431e-05	1.0253	N/A	N/A
14000	0.16	4.7336e-05	0.9805	N/A	N/A
14500	0.166	4.7240e-05	0.9739	N/A	N/A
15000	0.171	4.7145e-05	0.9618	N/A	N/A
15500	0.177	4.7050e-05	1.0021	N/A	N/A
16000	0.183	4.6955e-05	1.0157	N/A	N/A
16500	0.188	4.6860e-05	0.9787	N/A	N/A
17000	0.194	4.6765e-05	1.0204	N/A	N/A
17500	0.2	4.6669e-05	0.9366	N/A	N/A
18000	0.206	4.6574e-05	0.9935	N/A	N/A
18500	0.211	4.6479e-05	0.9627	N/A	N/A
19000	0.217	4.6384e-05	0.9181	N/A	N/A
19500	0.223	4.6289e-05	0.9936	N/A	N/A
20000	0.228	4.6194e-05	0.9355	N/A	N/A
20500	0.234	4.6099e-05	0.8799	N/A	N/A
21000	0.24	4.6003e-05	0.9656	N/A	N/A
21500	0.246	4.5908e-05	0.9449	N/A	N/A
22000	0.251	4.5813e-05	0.9686	N/A	N/A
22500	0.257	4.5718e-05	0.9941	N/A	N/A
23000	0.263	4.5623e-05	0.9444	N/A	N/A
23500	0.268	4.5528e-05	0.9414	N/A	N/A
24000	0.274	4.5432e-05	0.9127	N/A	N/A
24500	0.28	4.5337e-05	0.9184	N/A	N/A
25000	0.285	4.5242e-05	0.9419	N/A	N/A
25500	0.291	4.5147e-05	0.9345	N/A	N/A
26000	0.297	4.5052e-05	0.8944	N/A	N/A
26500	0.303	4.4957e-05	0.896	N/A	N/A
27000	0.308	4.4861e-05	0.8738	N/A	N/A
27500	0.314	4.4766e-05	0.8786	N/A	N/A
28000	0.32	4.4671e-05	0.9092	N/A	N/A
28500	0.325	4.4576e-05	0.8959	N/A	N/A
29000	0.331	4.4481e-05	0.8869	N/A	N/A
29500	0.337	4.4386e-05	0.9091	N/A	N/A
30000	0.343	4.4290e-05	0.9018	N/A	N/A
30500	0.348	4.4195e-05	0.8898	N/A	N/A
31000	0.354	4.4100e-05	0.9053	N/A	N/A
31500	0.36	4.4005e-05	0.8612	N/A	N/A
32000	0.365	4.3910e-05	0.9312	N/A	N/A
32500	0.371	4.3815e-05	0.8877	N/A	N/A
33000	0.377	4.3719e-05	0.8946	N/A	N/A
33500	0.383	4.3624e-05	0.925	N/A	N/A
34000	0.388	4.3529e-05	0.9015	N/A	N/A
34500	0.394	4.3434e-05	0.9311	N/A	N/A
35000	0.4	4.3339e-05	0.8821	N/A	N/A
35500	0.405	4.3244e-05	0.8721	N/A	N/A
36000	0.411	4.3148e-05	0.8898	N/A	N/A
36500	0.417	4.3053e-05	0.9048	N/A	N/A
37000	0.423	4.2958e-05	0.9094	N/A	N/A
37500	0.428	4.2863e-05	0.8585	N/A	N/A
38000	0.434	4.2768e-05	0.8623	N/A	N/A
38500	0.44	4.2673e-05	0.9068	N/A	N/A
39000	0.445	4.2577e-05	0.8578	N/A	N/A
39500	0.451	4.2482e-05	0.8668	N/A	N/A
40000	0.457	4.2387e-05	0.8487	N/A	N/A
40500	0.462	4.2292e-05	0.8825	N/A	N/A
41000	0.468	4.2197e-05	0.8722	N/A	N/A
41500	0.474	4.2102e-05	0.8433	N/A	N/A
42000	0.48	4.2006e-05	0.8276	N/A	N/A
42500	0.485	4.1911e-05	0.8872	N/A	N/A
43000	0.491	4.1816e-05	0.882	N/A	N/A
43500	0.497	4.1721e-05	0.8607	N/A	N/A
44000	0.502	4.1626e-05	0.8733	N/A	N/A
44500	0.508	4.1531e-05	0.8655	N/A	N/A
45000	0.514	4.1436e-05	0.8632	N/A	N/A
45500	0.52	4.1340e-05	0.8619	N/A	N/A
46000	0.525	4.1245e-05	0.8843	N/A	N/A
46500	0.531	4.1150e-05	0.866	N/A	N/A
47000	0.537	4.1055e-05	0.841	N/A	N/A
47500	0.542	4.0960e-05	0.8361	N/A	N/A
48000	0.548	4.0865e-05	0.83	N/A	N/A
48500	0.554	4.0769e-05	0.8548	N/A	N/A
49000	0.56	4.0674e-05	0.8534	N/A	N/A
49500	0.565	4.0579e-05	0.8629	N/A	N/A
50000	0.571	4.0484e-05	0.8435	N/A	N/A
50500	0.577	4.0389e-05	0.8873	N/A	N/A
51000	0.582	4.0294e-05	0.8472	N/A	N/A
51500	0.588	4.0198e-05	0.8595	N/A	N/A
52000	0.594	4.0103e-05	0.8625	N/A	N/A
52500	0.6	4.0008e-05	0.823	N/A	N/A
53000	0.605	3.9913e-05	0.8606	N/A	N/A
53500	0.611	3.9818e-05	0.8446	N/A	N/A
54000	0.617	3.9723e-05	0.8175	N/A	N/A
54500	0.622	3.9627e-05	0.8045	N/A	N/A
55000	0.628	3.9532e-05	0.8265	N/A	N/A
55500	0.634	3.9437e-05	0.8412	N/A	N/A
56000	0.639	3.9342e-05	0.8621	N/A	N/A
56500	0.645	3.9247e-05	0.8485	N/A	N/A
57000	0.651	3.9152e-05	0.8045	N/A	N/A
57500	0.657	3.9056e-05	0.8086	N/A	N/A
58000	0.662	3.8961e-05	0.8272	N/A	N/A
58500	0.668	3.8866e-05	0.8328	N/A	N/A
59000	0.674	3.8771e-05	0.838	N/A	N/A
59500	0.679	3.8676e-05	0.8143	N/A	N/A
60000	0.685	3.8581e-05	0.7847	N/A	N/A
60500	0.691	3.8485e-05	0.7838	N/A	N/A
61000	0.697	3.8390e-05	0.8175	N/A	N/A
61500	0.702	3.8295e-05	0.8089	N/A	N/A
62000	0.708	3.8200e-05	0.8405	N/A	N/A
62500	0.714	3.8105e-05	0.7925	N/A	N/A
63000	0.719	3.8010e-05	0.8146	N/A	N/A
63500	0.725	3.7914e-05	0.807	N/A	N/A
64000	0.731	3.7819e-05	0.8042	N/A	N/A
64500	0.737	3.7724e-05	0.7995	N/A	N/A
65000	0.742	3.7629e-05	0.7968	N/A	N/A
65500	0.748	3.7534e-05	0.7984	N/A	N/A
66000	0.754	3.7439e-05	0.8228	N/A	N/A
66500	0.759	3.7344e-05	0.8193	N/A	N/A
67000	0.765	3.7248e-05	0.8004	N/A	N/A
67500	0.771	3.7153e-05	0.8199	N/A	N/A
68000	0.777	3.7058e-05	0.8361	N/A	N/A
68500	0.782	3.6963e-05	0.7925	N/A	N/A
69000	0.788	3.6868e-05	0.7814	N/A	N/A
69500	0.794	3.6773e-05	0.8311	N/A	N/A
70000	0.799	3.6677e-05	0.7993	N/A	N/A
70500	0.805	3.6582e-05	0.7903	N/A	N/A
71000	0.811	3.6487e-05	0.7847	N/A	N/A
71500	0.816	3.6392e-05	0.7855	N/A	N/A
72000	0.822	3.6297e-05	0.7931	N/A	N/A
72500	0.828	3.6202e-05	0.8204	N/A	N/A
73000	0.834	3.6106e-05	0.834	N/A	N/A
73500	0.839	3.6011e-05	0.7876	N/A	N/A
74000	0.845	3.5916e-05	0.7929	N/A	N/A
74500	0.851	3.5821e-05	0.8049	N/A	N/A
75000	0.856	3.5726e-05	0.8133	N/A	N/A
75500	0.862	3.5631e-05	0.8016	N/A	N/A
76000	0.868	3.5535e-05	0.7829	N/A	N/A
76500	0.874	3.5440e-05	0.7965	N/A	N/A
77000	0.879	3.5345e-05	0.7889	N/A	N/A
77500	0.885	3.5250e-05	0.7987	N/A	N/A
78000	0.891	3.5155e-05	0.7897	N/A	N/A
78500	0.896	3.5060e-05	0.7981	N/A	N/A
79000	0.902	3.4964e-05	0.8072	N/A	N/A
79500	0.908	3.4869e-05	0.7892	N/A	N/A
80000	0.914	3.4774e-05	0.7836	N/A	N/A
80500	0.919	3.4679e-05	0.7973	N/A	N/A
81000	0.925	3.4584e-05	0.8297	N/A	N/A
81500	0.931	3.4489e-05	0.8009	N/A	N/A
82000	0.936	3.4393e-05	0.7952	N/A	N/A
82500	0.942	3.4298e-05	0.8234	N/A	N/A
83000	0.948	3.4203e-05	0.7594	N/A	N/A
83500	0.954	3.4108e-05	0.7487	N/A	N/A
84000	0.959	3.4013e-05	0.8137	N/A	N/A
84500	0.965	3.3918e-05	0.8131	N/A	N/A
85000	0.971	3.3822e-05	0.7783	N/A	N/A
85500	0.976	3.3727e-05	0.797	N/A	N/A
86000	0.982	3.3632e-05	0.7969	N/A	N/A
86500	0.988	3.3537e-05	0.7918	N/A	N/A
87000	0.994	3.3442e-05	0.7454	N/A	N/A
87500	0.999	3.3347e-05	0.8006	N/A	N/A
87569	1.0	N/A	N/A	0.7439	0.7674
88000	1.005	3.3251e-05	0.6421	N/A	N/A
88500	1.011	3.3156e-05	0.6501	N/A	N/A
89000	1.016	3.3061e-05	0.663	N/A	N/A
89500	1.022	3.2966e-05	0.6677	N/A	N/A
90000	1.028	3.2871e-05	0.6503	N/A	N/A
90500	1.033	3.2776e-05	0.6609	N/A	N/A
91000	1.039	3.2681e-05	0.6575	N/A	N/A
91500	1.045	3.2585e-05	0.6406	N/A	N/A
92000	1.051	3.2490e-05	0.6305	N/A	N/A
92500	1.056	3.2395e-05	0.6193	N/A	N/A
93000	1.062	3.2300e-05	0.666	N/A	N/A
93500	1.068	3.2205e-05	0.6587	N/A	N/A
94000	1.073	3.2110e-05	0.6741	N/A	N/A
94500	1.079	3.2014e-05	0.6351	N/A	N/A
95000	1.085	3.1919e-05	0.6346	N/A	N/A
95500	1.091	3.1824e-05	0.6646	N/A	N/A
96000	1.096	3.1729e-05	0.6547	N/A	N/A
96500	1.102	3.1634e-05	0.6317	N/A	N/A
97000	1.108	3.1539e-05	0.6661	N/A	N/A
97500	1.113	3.1443e-05	0.6897	N/A	N/A
98000	1.119	3.1348e-05	0.6279	N/A	N/A
98500	1.125	3.1253e-05	0.6431	N/A	N/A
99000	1.131	3.1158e-05	0.631	N/A	N/A
99500	1.136	3.1063e-05	0.6563	N/A	N/A
100000	1.142	3.0968e-05	0.6437	N/A	N/A
100500	1.148	3.0872e-05	0.6333	N/A	N/A
101000	1.153	3.0777e-05	0.6486	N/A	N/A
101500	1.159	3.0682e-05	0.6731	N/A	N/A
102000	1.165	3.0587e-05	0.6537	N/A	N/A
102500	1.171	3.0492e-05	0.6413	N/A	N/A
103000	1.176	3.0397e-05	0.6559	N/A	N/A
103500	1.182	3.0301e-05	0.6737	N/A	N/A
104000	1.188	3.0206e-05	0.6518	N/A	N/A
104500	1.193	3.0111e-05	0.6594	N/A	N/A
105000	1.199	3.0016e-05	0.6007	N/A	N/A
105500	1.205	2.9921e-05	0.6602	N/A	N/A
106000	1.21	2.9826e-05	0.6362	N/A	N/A
106500	1.216	2.9730e-05	0.6769	N/A	N/A
107000	1.222	2.9635e-05	0.6297	N/A	N/A
107500	1.228	2.9540e-05	0.6661	N/A	N/A
108000	1.233	2.9445e-05	0.6549	N/A	N/A
108500	1.239	2.9350e-05	0.659	N/A	N/A
109000	1.245	2.9255e-05	0.6735	N/A	N/A
109500	1.25	2.9159e-05	0.6672	N/A	N/A
110000	1.256	2.9064e-05	0.6698	N/A	N/A
110500	1.262	2.8969e-05	0.6736	N/A	N/A
111000	1.268	2.8874e-05	0.6778	N/A	N/A
111500	1.273	2.8779e-05	0.6405	N/A	N/A
112000	1.279	2.8684e-05	0.6697	N/A	N/A
112500	1.285	2.8589e-05	0.6317	N/A	N/A
113000	1.29	2.8493e-05	0.665	N/A	N/A
113500	1.296	2.8398e-05	0.6855	N/A	N/A
114000	1.302	2.8303e-05	0.6277	N/A	N/A
114500	1.308	2.8208e-05	0.6383	N/A	N/A
115000	1.313	2.8113e-05	0.6659	N/A	N/A
115500	1.319	2.8018e-05	0.631	N/A	N/A
116000	1.325	2.7922e-05	0.6516	N/A	N/A
116500	1.33	2.7827e-05	0.615	N/A	N/A
117000	1.336	2.7732e-05	0.6348	N/A	N/A
117500	1.342	2.7637e-05	0.5992	N/A	N/A
118000	1.348	2.7542e-05	0.6612	N/A	N/A
118500	1.353	2.7447e-05	0.6328	N/A	N/A
119000	1.359	2.7351e-05	0.6659	N/A	N/A
119500	1.365	2.7256e-05	0.6462	N/A	N/A
120000	1.37	2.7161e-05	0.6393	N/A	N/A
120500	1.376	2.7066e-05	0.636	N/A	N/A
121000	1.382	2.6971e-05	0.6361	N/A	N/A
121500	1.387	2.6876e-05	0.6508	N/A	N/A
122000	1.393	2.6780e-05	0.6574	N/A	N/A
122500	1.399	2.6685e-05	0.6194	N/A	N/A
123000	1.405	2.6590e-05	0.641	N/A	N/A
123500	1.41	2.6495e-05	0.6749	N/A	N/A
124000	1.416	2.6400e-05	0.6565	N/A	N/A
124500	1.422	2.6305e-05	0.6535	N/A	N/A
125000	1.427	2.6209e-05	0.6535	N/A	N/A
125500	1.433	2.6114e-05	0.6331	N/A	N/A
126000	1.439	2.6019e-05	0.6375	N/A	N/A
126500	1.445	2.5924e-05	0.6527	N/A	N/A
127000	1.45	2.5829e-05	0.6356	N/A	N/A
127500	1.456	2.5734e-05	0.6277	N/A	N/A
128000	1.462	2.5638e-05	0.656	N/A	N/A
128500	1.467	2.5543e-05	0.6518	N/A	N/A
129000	1.473	2.5448e-05	0.6243	N/A	N/A
129500	1.479	2.5353e-05	0.6219	N/A	N/A
130000	1.485	2.5258e-05	0.6573	N/A	N/A
130500	1.49	2.5163e-05	0.6456	N/A	N/A
131000	1.496	2.5067e-05	0.608	N/A	N/A
131500	1.502	2.4972e-05	0.6446	N/A	N/A
132000	1.507	2.4877e-05	0.6642	N/A	N/A
132500	1.513	2.4782e-05	0.6172	N/A	N/A
133000	1.519	2.4687e-05	0.6533	N/A	N/A
133500	1.525	2.4592e-05	0.6416	N/A	N/A
134000	1.53	2.4496e-05	0.6443	N/A	N/A
134500	1.536	2.4401e-05	0.62	N/A	N/A
135000	1.542	2.4306e-05	0.6242	N/A	N/A
135500	1.547	2.4211e-05	0.6134	N/A	N/A
136000	1.553	2.4116e-05	0.6438	N/A	N/A
136500	1.559	2.4021e-05	0.6313	N/A	N/A
137000	1.564	2.3926e-05	0.6183	N/A	N/A
137500	1.57	2.3830e-05	0.5993	N/A	N/A
138000	1.576	2.3735e-05	0.6208	N/A	N/A
138500	1.582	2.3640e-05	0.6314	N/A	N/A
139000	1.587	2.3545e-05	0.6486	N/A	N/A
139500	1.593	2.3450e-05	0.634	N/A	N/A
140000	1.599	2.3355e-05	0.6474	N/A	N/A
140500	1.604	2.3259e-05	0.6476	N/A	N/A
141000	1.61	2.3164e-05	0.6196	N/A	N/A
141500	1.616	2.3069e-05	0.623	N/A	N/A
142000	1.622	2.2974e-05	0.6409	N/A	N/A
142500	1.627	2.2879e-05	0.6178	N/A	N/A
143000	1.633	2.2784e-05	0.6152	N/A	N/A
143500	1.639	2.2688e-05	0.654	N/A	N/A
144000	1.644	2.2593e-05	0.6058	N/A	N/A
144500	1.65	2.2498e-05	0.6174	N/A	N/A
145000	1.656	2.2403e-05	0.6264	N/A	N/A
145500	1.662	2.2308e-05	0.6083	N/A	N/A
146000	1.667	2.2213e-05	0.6618	N/A	N/A
146500	1.673	2.2117e-05	0.6186	N/A	N/A
147000	1.679	2.2022e-05	0.6448	N/A	N/A
147500	1.684	2.1927e-05	0.6119	N/A	N/A
148000	1.69	2.1832e-05	0.6402	N/A	N/A
148500	1.696	2.1737e-05	0.6176	N/A	N/A
149000	1.702	2.1642e-05	0.6302	N/A	N/A
149500	1.707	2.1546e-05	0.6386	N/A	N/A
150000	1.713	2.1451e-05	0.6287	N/A	N/A
150500	1.719	2.1356e-05	0.6324	N/A	N/A
151000	1.724	2.1261e-05	0.6227	N/A	N/A
151500	1.73	2.1166e-05	0.6498	N/A	N/A
152000	1.736	2.1071e-05	0.6233	N/A	N/A
152500	1.741	2.0975e-05	0.5847	N/A	N/A
153000	1.747	2.0880e-05	0.6408	N/A	N/A
153500	1.753	2.0785e-05	0.6336	N/A	N/A
154000	1.759	2.0690e-05	0.6323	N/A	N/A
154500	1.764	2.0595e-05	0.6128	N/A	N/A
155000	1.77	2.0500e-05	0.661	N/A	N/A
155500	1.776	2.0404e-05	0.6195	N/A	N/A
156000	1.781	2.0309e-05	0.6024	N/A	N/A
156500	1.787	2.0214e-05	0.5593	N/A	N/A
157000	1.793	2.0119e-05	0.6338	N/A	N/A
157500	1.799	2.0024e-05	0.6033	N/A	N/A
158000	1.804	1.9929e-05	0.6147	N/A	N/A
158500	1.81	1.9834e-05	0.6365	N/A	N/A
159000	1.816	1.9738e-05	0.6275	N/A	N/A
159500	1.821	1.9643e-05	0.6281	N/A	N/A
160000	1.827	1.9548e-05	0.6293	N/A	N/A
160500	1.833	1.9453e-05	0.6241	N/A	N/A
161000	1.839	1.9358e-05	0.6193	N/A	N/A
161500	1.844	1.9263e-05	0.6378	N/A	N/A
162000	1.85	1.9167e-05	0.6125	N/A	N/A
162500	1.856	1.9072e-05	0.6228	N/A	N/A
163000	1.861	1.8977e-05	0.6149	N/A	N/A
163500	1.867	1.8882e-05	0.6436	N/A	N/A
164000	1.873	1.8787e-05	0.6274	N/A	N/A
164500	1.879	1.8692e-05	0.6123	N/A	N/A
165000	1.884	1.8596e-05	0.5941	N/A	N/A
165500	1.89	1.8501e-05	0.6248	N/A	N/A
166000	1.896	1.8406e-05	0.6275	N/A	N/A
166500	1.901	1.8311e-05	0.6257	N/A	N/A
167000	1.907	1.8216e-05	0.6242	N/A	N/A
167500	1.913	1.8121e-05	0.6218	N/A	N/A
168000	1.918	1.8025e-05	0.6396	N/A	N/A
168500	1.924	1.7930e-05	0.5984	N/A	N/A
169000	1.93	1.7835e-05	0.6247	N/A	N/A
169500	1.936	1.7740e-05	0.6178	N/A	N/A
170000	1.941	1.7645e-05	0.6114	N/A	N/A
170500	1.947	1.7550e-05	0.6133	N/A	N/A
171000	1.953	1.7454e-05	0.5747	N/A	N/A
171500	1.958	1.7359e-05	0.6093	N/A	N/A
172000	1.964	1.7264e-05	0.6319	N/A	N/A
172500	1.97	1.7169e-05	0.6038	N/A	N/A
173000	1.976	1.7074e-05	0.6462	N/A	N/A
173500	1.981	1.6979e-05	0.6297	N/A	N/A
174000	1.987	1.6883e-05	0.5871	N/A	N/A
174500	1.993	1.6788e-05	0.6053	N/A	N/A
175000	1.998	1.6693e-05	0.6151	N/A	N/A
175138	2.0	N/A	N/A	0.6948	0.7879
175500	2.004	1.6598e-05	0.5129	N/A	N/A
176000	2.01	1.6503e-05	0.4964	N/A	N/A
176500	2.016	1.6408e-05	0.4688	N/A	N/A
177000	2.021	1.6312e-05	0.4841	N/A	N/A
177500	2.027	1.6217e-05	0.466	N/A	N/A
178000	2.033	1.6122e-05	0.4775	N/A	N/A
178500	2.038	1.6027e-05	0.4351	N/A	N/A
179000	2.044	1.5932e-05	0.4796	N/A	N/A
179500	2.05	1.5837e-05	0.468	N/A	N/A
180000	2.056	1.5741e-05	0.4882	N/A	N/A
180500	2.061	1.5646e-05	0.4948	N/A	N/A
181000	2.067	1.5551e-05	0.4724	N/A	N/A
181500	2.073	1.5456e-05	0.4864	N/A	N/A
182000	2.078	1.5361e-05	0.4946	N/A	N/A
182500	2.084	1.5266e-05	0.4613	N/A	N/A
183000	2.09	1.5171e-05	0.4674	N/A	N/A
183500	2.095	1.5075e-05	0.4635	N/A	N/A
184000	2.101	1.4980e-05	0.4997	N/A	N/A
184500	2.107	1.4885e-05	0.4642	N/A	N/A
185000	2.113	1.4790e-05	0.4787	N/A	N/A
185500	2.118	1.4695e-05	0.5043	N/A	N/A
186000	2.124	1.4600e-05	0.4664	N/A	N/A
186500	2.13	1.4504e-05	0.4376	N/A	N/A
187000	2.135	1.4409e-05	0.4647	N/A	N/A
187500	2.141	1.4314e-05	0.4805	N/A	N/A
188000	2.147	1.4219e-05	0.4977	N/A	N/A
188500	2.153	1.4124e-05	0.4634	N/A	N/A
189000	2.158	1.4029e-05	0.4762	N/A	N/A
189500	2.164	1.3933e-05	0.4949	N/A	N/A
190000	2.17	1.3838e-05	0.4786	N/A	N/A
190500	2.175	1.3743e-05	0.5049	N/A	N/A
191000	2.181	1.3648e-05	0.4882	N/A	N/A
191500	2.187	1.3553e-05	0.4839	N/A	N/A
192000	2.193	1.3458e-05	0.4967	N/A	N/A
192500	2.198	1.3362e-05	0.478	N/A	N/A
193000	2.204	1.3267e-05	0.4914	N/A	N/A
193500	2.21	1.3172e-05	0.4715	N/A	N/A
194000	2.215	1.3077e-05	0.4533	N/A	N/A
194500	2.221	1.2982e-05	0.4616	N/A	N/A
195000	2.227	1.2887e-05	0.4756	N/A	N/A
195500	2.233	1.2791e-05	0.487	N/A	N/A
196000	2.238	1.2696e-05	0.4629	N/A	N/A
196500	2.244	1.2601e-05	0.5031	N/A	N/A
197000	2.25	1.2506e-05	0.4685	N/A	N/A
197500	2.255	1.2411e-05	0.4817	N/A	N/A
198000	2.261	1.2316e-05	0.4645	N/A	N/A
198500	2.267	1.2220e-05	0.4546	N/A	N/A
199000	2.272	1.2125e-05	0.4694	N/A	N/A
199500	2.278	1.2030e-05	0.4724	N/A	N/A
200000	2.284	1.1935e-05	0.4623	N/A	N/A
200500	2.29	1.1840e-05	0.4742	N/A	N/A
201000	2.295	1.1745e-05	0.4865	N/A	N/A
201500	2.301	1.1649e-05	0.489	N/A	N/A
202000	2.307	1.1554e-05	0.4652	N/A	N/A
202500	2.312	1.1459e-05	0.4902	N/A	N/A
203000	2.318	1.1364e-05	0.4816	N/A	N/A
203500	2.324	1.1269e-05	0.4758	N/A	N/A
204000	2.33	1.1174e-05	0.4467	N/A	N/A
204500	2.335	1.1079e-05	0.4921	N/A	N/A
205000	2.341	1.0983e-05	0.4809	N/A	N/A
205500	2.347	1.0888e-05	0.4822	N/A	N/A
206000	2.352	1.0793e-05	0.4768	N/A	N/A
206500	2.358	1.0698e-05	0.4982	N/A	N/A
207000	2.364	1.0603e-05	0.4657	N/A	N/A
207500	2.37	1.0508e-05	0.4632	N/A	N/A
208000	2.375	1.0412e-05	0.4429	N/A	N/A
208500	2.381	1.0317e-05	0.4727	N/A	N/A
209000	2.387	1.0222e-05	0.4921	N/A	N/A
209500	2.392	1.0127e-05	0.4585	N/A	N/A
210000	2.398	1.0032e-05	0.4915	N/A	N/A
210500	2.404	9.9365e-06	0.4676	N/A	N/A
211000	2.41	9.8414e-06	0.483	N/A	N/A
211500	2.415	9.7462e-06	0.507	N/A	N/A
212000	2.421	9.6511e-06	0.4577	N/A	N/A
212500	2.427	9.5559e-06	0.4423	N/A	N/A
213000	2.432	9.4607e-06	0.4827	N/A	N/A
213500	2.438	9.3656e-06	0.455	N/A	N/A
214000	2.444	9.2704e-06	0.4666	N/A	N/A
214500	2.449	9.1752e-06	0.4512	N/A	N/A
215000	2.455	9.0801e-06	0.4587	N/A	N/A
215500	2.461	8.9849e-06	0.4771	N/A	N/A
216000	2.467	8.8898e-06	0.4791	N/A	N/A
216500	2.472	8.7946e-06	0.5014	N/A	N/A
217000	2.478	8.6994e-06	0.4644	N/A	N/A
217500	2.484	8.6043e-06	0.4664	N/A	N/A
218000	2.489	8.5091e-06	0.4813	N/A	N/A
218500	2.495	8.4139e-06	0.4878	N/A	N/A
219000	2.501	8.3188e-06	0.4827	N/A	N/A
219500	2.507	8.2236e-06	0.45	N/A	N/A
220000	2.512	8.1284e-06	0.4642	N/A	N/A
220500	2.518	8.0333e-06	0.4328	N/A	N/A
221000	2.524	7.9381e-06	0.4907	N/A	N/A
221500	2.529	7.8430e-06	0.4601	N/A	N/A
222000	2.535	7.7478e-06	0.4633	N/A	N/A
222500	2.541	7.6526e-06	0.4758	N/A	N/A
223000	2.547	7.5575e-06	0.4534	N/A	N/A
223500	2.552	7.4623e-06	0.4541	N/A	N/A
224000	2.558	7.3671e-06	0.4947	N/A	N/A
224500	2.564	7.2720e-06	0.4478	N/A	N/A
225000	2.569	7.1768e-06	0.4391	N/A	N/A
225500	2.575	7.0817e-06	0.4671	N/A	N/A
226000	2.581	6.9865e-06	0.4459	N/A	N/A
226500	2.587	6.8913e-06	0.5051	N/A	N/A
227000	2.592	6.7962e-06	0.4645	N/A	N/A
227500	2.598	6.7010e-06	0.4913	N/A	N/A
228000	2.604	6.6058e-06	0.4532	N/A	N/A
228500	2.609	6.5107e-06	0.4517	N/A	N/A
229000	2.615	6.4155e-06	0.4228	N/A	N/A
229500	2.621	6.3203e-06	0.4686	N/A	N/A
230000	2.627	6.2252e-06	0.4804	N/A	N/A
230500	2.632	6.1300e-06	0.4784	N/A	N/A
231000	2.638	6.0349e-06	0.4535	N/A	N/A
231500	2.644	5.9397e-06	0.43	N/A	N/A
232000	2.649	5.8445e-06	0.4536	N/A	N/A
232500	2.655	5.7494e-06	0.4511	N/A	N/A
233000	2.661	5.6542e-06	0.4608	N/A	N/A
233500	2.666	5.5590e-06	0.4809	N/A	N/A
234000	2.672	5.4639e-06	0.4283	N/A	N/A
234500	2.678	5.3687e-06	0.45	N/A	N/A
235000	2.684	5.2736e-06	0.492	N/A	N/A
235500	2.689	5.1784e-06	0.4557	N/A	N/A
236000	2.695	5.0832e-06	0.4975	N/A	N/A
236500	2.701	4.9881e-06	0.5125	N/A	N/A
237000	2.706	4.8929e-06	0.4634	N/A	N/A
237500	2.712	4.7977e-06	0.4408	N/A	N/A
238000	2.718	4.7026e-06	0.4801	N/A	N/A
238500	2.724	4.6074e-06	0.4578	N/A	N/A
239000	2.729	4.5123e-06	0.438	N/A	N/A
239500	2.735	4.4171e-06	0.4883	N/A	N/A
240000	2.741	4.3219e-06	0.4385	N/A	N/A
240500	2.746	4.2268e-06	0.4581	N/A	N/A
241000	2.752	4.1316e-06	0.4594	N/A	N/A
241500	2.758	4.0364e-06	0.4697	N/A	N/A
242000	2.764	3.9413e-06	0.4821	N/A	N/A
242500	2.769	3.8461e-06	0.4573	N/A	N/A
243000	2.775	3.7509e-06	0.4446	N/A	N/A
243500	2.781	3.6558e-06	0.4513	N/A	N/A
244000	2.786	3.5606e-06	0.4616	N/A	N/A
244500	2.792	3.4655e-06	0.4699	N/A	N/A
245000	2.798	3.3703e-06	0.4492	N/A	N/A
245500	2.804	3.2751e-06	0.438	N/A	N/A
246000	2.809	3.1800e-06	0.435	N/A	N/A
246500	2.815	3.0848e-06	0.484	N/A	N/A
247000	2.821	2.9896e-06	0.4447	N/A	N/A
247500	2.826	2.8945e-06	0.409	N/A	N/A
248000	2.832	2.7993e-06	0.4598	N/A	N/A
248500	2.838	2.7042e-06	0.4533	N/A	N/A
249000	2.843	2.6090e-06	0.4628	N/A	N/A
249500	2.849	2.5138e-06	0.4518	N/A	N/A
250000	2.855	2.4187e-06	0.4305	N/A	N/A
250500	2.861	2.3235e-06	0.4361	N/A	N/A
251000	2.866	2.2283e-06	0.4252	N/A	N/A
251500	2.872	2.1332e-06	0.4373	N/A	N/A
252000	2.878	2.0380e-06	0.4419	N/A	N/A
252500	2.883	1.9428e-06	0.4831	N/A	N/A
253000	2.889	1.8477e-06	0.4802	N/A	N/A
253500	2.895	1.7525e-06	0.4336	N/A	N/A
254000	2.901	1.6574e-06	0.4225	N/A	N/A
254500	2.906	1.5622e-06	0.4631	N/A	N/A
255000	2.912	1.4670e-06	0.4371	N/A	N/A
255500	2.918	1.3719e-06	0.4711	N/A	N/A
256000	2.923	1.2767e-06	0.4364	N/A	N/A
256500	2.929	1.1815e-06	0.4639	N/A	N/A
257000	2.935	1.0864e-06	0.4458	N/A	N/A
257500	2.941	9.9122e-07	0.472	N/A	N/A
258000	2.946	8.9606e-07	0.413	N/A	N/A
258500	2.952	8.0089e-07	0.4363	N/A	N/A
259000	2.958	7.0573e-07	0.4216	N/A	N/A
259500	2.963	6.1057e-07	0.4494	N/A	N/A
260000	2.969	5.1540e-07	0.4262	N/A	N/A
260500	2.975	4.2024e-07	0.4337	N/A	N/A
261000	2.981	3.2508e-07	0.4182	N/A	N/A
261500	2.986	2.2991e-07	0.446	N/A	N/A
262000	2.992	1.3475e-07	0.4276	N/A	N/A
262500	2.998	3.9588e-08	0.4511	N/A	N/A
262707	3.0	N/A	N/A	0.7441	0.7959

Framework Versions

• Transformers: 5.0.0.dev0
• PyTorch: 2.6.0+cu124