Hailay commited on
Commit
ea3e4e3
·
verified ·
1 Parent(s): 4b752dc

Add VEXMLM-Tigrinya-NER: five verified fine-tuned checkpoints (seeds 42-46)

Browse files
.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ seed-42/tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
+ seed-43/tokenizer.json filter=lfs diff=lfs merge=lfs -text
38
+ seed-44/tokenizer.json filter=lfs diff=lfs merge=lfs -text
39
+ seed-45/tokenizer.json filter=lfs diff=lfs merge=lfs -text
40
+ seed-46/tokenizer.json filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,161 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - ti
4
+ license: apache-2.0
5
+ library_name: transformers
6
+ pipeline_tag: token-classification
7
+ tags:
8
+ - ner
9
+ - token-classification
10
+ - xlm-roberta
11
+ - vexmlm
12
+ - geez
13
+ - low-resource
14
+ base_model: Hailay/VEXMLM
15
+ ---
16
+
17
+ # VEXMLM — Tigrinya NER
18
+
19
+ Tigrinya **token classification** fine-tuned from
20
+ [`Hailay/VEXMLM`](https://huggingface.co/Hailay/VEXMLM), the vocabulary-extended
21
+ XLM-R for Ge'ez-script languages.
22
+
23
+ Official implementation: **https://github.com/hailaykidu/VEXMLM**
24
+
25
+ | | |
26
+ |---|---|
27
+ | Task | token-classification |
28
+ | Dataset | Tigrinya NER |
29
+ | Language | Tigrinya |
30
+ | Architecture | `XLMRobertaForTokenClassification` |
31
+ | Base model | `Hailay/VEXMLM` |
32
+ | Vocabulary | 280,002 |
33
+ | Labels | 11 |
34
+ | Seeds published | 42, 43, 44, 45, 46 |
35
+
36
+ Labels cover PER, ORG, LOC, DATE and MISC in BIO format (11 classes).
37
+
38
+ ## Five-seed benchmark evaluation
39
+
40
+ Fine-tuned independently under seeds 42–46 with one configuration (hash
41
+ `ce27cc194946`) on an A100-PCIE-40GB. Reported as mean ± standard deviation over
42
+ the five runs, on the dataset's **test** split.
43
+
44
+ | Metric | Score |
45
+ |---|---|
46
+ | Entity-F1 | **72.82 ± 0.79** |
47
+ | Macro-F1 | 82.19 ± 0.69 |
48
+ | Accuracy | 95.15 ± 0.05 |
49
+
50
+ These are the paper's verified results. They come from the five-seed evaluation
51
+ described above — **not** from interactive use.
52
+
53
+ ### Interactive inference vs. benchmark
54
+
55
+ **Benchmark evaluation** is the five-seed measurement on the held-out test split,
56
+ shown in the table above.
57
+
58
+ **Interactive inference** is what the usage example below performs: Enter arbitrary Tigrinya text and inspect the predicted entity spans.
59
+ Predictions on arbitrary user input are demonstrations only and do not produce or
60
+ reproduce the benchmark score.
61
+
62
+ ## Repository layout
63
+
64
+ Five independently fine-tuned checkpoints, one per seed. The reported benchmark
65
+ score is the mean ± standard deviation over all five; **no single seed is the
66
+ "five-seed model."**
67
+
68
+ ```
69
+ seed-42/ seed-43/ seed-44/ seed-45/ seed-46/
70
+ ```
71
+
72
+ Load a specific seed with the `subfolder` argument, as in the example below.
73
+
74
+ ## Fine-tuning
75
+
76
+ Fine-tuned from [`Hailay/VEXMLM`](https://huggingface.co/Hailay/VEXMLM), a
77
+ vocabulary-extended XLM-R (280,002 subwords, 30,000 Ge'ez tokens merged into the
78
+ SentencePiece model) after continued MLM pretraining.
79
+
80
+ | Hyperparameter | Value |
81
+ |---|---|
82
+ | Max sequence length | 256 |
83
+ | Batch size | 32 |
84
+ | Epochs | 4 |
85
+ | Learning rate | 2e-5 |
86
+ | LR schedule | Linear decay, 10% warmup |
87
+ | Weight decay | 0.01 |
88
+ | Gradient clipping | 1.0 |
89
+ | Optimizer | AdamW (β₁ 0.9, β₂ 0.999, ε 1e-8) |
90
+ | Precision | bf16 |
91
+ | Trainable parameters | All |
92
+ | Hardware | 1× NVIDIA A100 |
93
+
94
+ Runs are bit-reproducible: `enable_full_determinism`,
95
+ `CUBLAS_WORKSPACE_CONFIG=:4096:8`, `dataloader_num_workers=0`.
96
+
97
+ ## Usage
98
+
99
+ ```python
100
+ from transformers import AutoTokenizer, AutoModelForTokenClassification
101
+ import torch
102
+
103
+ repo = "Hailay/VEXMLM-Tigrinya-NER"
104
+ tokenizer = AutoTokenizer.from_pretrained(repo, subfolder="seed-42")
105
+ model = AutoModelForTokenClassification.from_pretrained(repo, subfolder="seed-42")
106
+ model.eval()
107
+
108
+ words = "ኤርትራ ኣብ ቀርኒ አፍሪቃ እትርከብ ሃገር እያ።".split()
109
+ enc = tokenizer(words, is_split_into_words=True, return_tensors="pt", truncation=True)
110
+
111
+ with torch.no_grad():
112
+ pred = model(**enc).logits.argmax(-1)[0].tolist()
113
+
114
+ seen = set()
115
+ for p, w in zip(pred, enc.word_ids(0)):
116
+ if w is None or w in seen:
117
+ continue
118
+ seen.add(w)
119
+ print(words[w], "->", model.config.id2label[p])
120
+ ```
121
+
122
+ ## Limitations
123
+
124
+ - Fine-tuned for Tigrinya on Tigrinya NER only; performance on other
125
+ languages, domains or label schemes is not characterised.
126
+ - The base model covers Amharic and Tigrinya; other Ge'ez-script languages were
127
+ not part of pretraining.
128
+ - Corpora are drawn largely from religious and news domains, and the model may
129
+ reflect those distributions and any biases in them.
130
+ - Single-configuration study: no hyperparameter search was performed, and
131
+ baseline comparisons in the paper are single-seed.
132
+
133
+ ## Reproducibility
134
+
135
+ The fine-tuning launcher, evaluation code and per-run result records are in the
136
+ official repository: **https://github.com/hailaykidu/VEXMLM**
137
+
138
+ ```bash
139
+ sbatch scripts/slurm_stage2_spm_seeds.sh # 6 tasks × 5 seeds
140
+ python3 evaluation/export_spm_results.py # regenerates the metrics table
141
+ ```
142
+
143
+ ## Citation
144
+
145
+ ```bibtex
146
+ @inproceedings{teklehaymanot2026vexmlm,
147
+ title = {Expanding the Lexicon of Ge'ez Based African Languages:
148
+ A Comparative Study of Amharic and Tigrinya},
149
+ author = {Teklehaymanot, Hailay Kidu and Yadeta, Gebregziabihier and
150
+ Nejdl, Wolfgang},
151
+ booktitle = {Proceedings of the Workshop on Language Models for
152
+ Underserved Communities (LM4UC) at IJCAI},
153
+ year = {2026}
154
+ }
155
+ ```
156
+
157
+ Accepted at the LM4UC Workshop, IJCAI 2026.
158
+
159
+ ## License
160
+
161
+ Apache 2.0, following `xlm-roberta-base`.
seed-42/config.json ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "XLMRobertaForTokenClassification"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "bos_token_id": 0,
7
+ "classifier_dropout": null,
8
+ "eos_token_id": 2,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 768,
12
+ "id2label": {
13
+ "0": "O",
14
+ "1": "B-DATE",
15
+ "2": "B-LOC",
16
+ "3": "B-MISC",
17
+ "4": "B-ORG",
18
+ "5": "B-PER",
19
+ "6": "I-DATE",
20
+ "7": "I-LOC",
21
+ "8": "I-MISC",
22
+ "9": "I-ORG",
23
+ "10": "I-PER"
24
+ },
25
+ "initializer_range": 0.02,
26
+ "intermediate_size": 3072,
27
+ "label2id": {
28
+ "B-DATE": 1,
29
+ "B-LOC": 2,
30
+ "B-MISC": 3,
31
+ "B-ORG": 4,
32
+ "B-PER": 5,
33
+ "I-DATE": 6,
34
+ "I-LOC": 7,
35
+ "I-MISC": 8,
36
+ "I-ORG": 9,
37
+ "I-PER": 10,
38
+ "O": 0
39
+ },
40
+ "layer_norm_eps": 1e-05,
41
+ "max_position_embeddings": 514,
42
+ "model_type": "xlm-roberta",
43
+ "num_attention_heads": 12,
44
+ "num_hidden_layers": 12,
45
+ "output_past": true,
46
+ "pad_token_id": 1,
47
+ "position_embedding_type": "absolute",
48
+ "torch_dtype": "float32",
49
+ "transformers_version": "4.51.3",
50
+ "type_vocab_size": 1,
51
+ "use_cache": true,
52
+ "vocab_size": 280002
53
+ }
seed-42/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06f46365b3ea4cb56a03520c4610ea85729a1552078b533b80a33ed3e4c2a0c4
3
+ size 1202030220
seed-42/sentencepiece.bpe.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa0968380f92ab1a191718b59ed1dc2b759ad6ac521c876aecbef3e27b57cbc3
3
+ size 5812895
seed-42/special_tokens_map.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "cls_token": {
10
+ "content": "<s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "eos_token": {
17
+ "content": "</s>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "mask_token": {
24
+ "content": "<mask>",
25
+ "lstrip": true,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "pad_token": {
31
+ "content": "<pad>",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ },
37
+ "sep_token": {
38
+ "content": "</s>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false
43
+ },
44
+ "unk_token": {
45
+ "content": "<unk>",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false
50
+ }
51
+ }
seed-42/tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3f61da7ee5658d8fffacfd0ca08e92105810fe51b8c6994b249722c5c586c81
3
+ size 19146842
seed-42/tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "<s>",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "1": {
12
+ "content": "<pad>",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "2": {
20
+ "content": "</s>",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "3": {
28
+ "content": "<unk>",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "280001": {
36
+ "content": "<mask>",
37
+ "lstrip": true,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "bos_token": "<s>",
45
+ "clean_up_tokenization_spaces": false,
46
+ "cls_token": "<s>",
47
+ "eos_token": "</s>",
48
+ "extra_special_tokens": {},
49
+ "mask_token": "<mask>",
50
+ "model_max_length": 512,
51
+ "pad_token": "<pad>",
52
+ "sep_token": "</s>",
53
+ "sp_model_kwargs": {},
54
+ "tokenizer_class": "XLMRobertaTokenizer",
55
+ "unk_token": "<unk>"
56
+ }
seed-43/config.json ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "XLMRobertaForTokenClassification"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "bos_token_id": 0,
7
+ "classifier_dropout": null,
8
+ "eos_token_id": 2,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 768,
12
+ "id2label": {
13
+ "0": "O",
14
+ "1": "B-DATE",
15
+ "2": "B-LOC",
16
+ "3": "B-MISC",
17
+ "4": "B-ORG",
18
+ "5": "B-PER",
19
+ "6": "I-DATE",
20
+ "7": "I-LOC",
21
+ "8": "I-MISC",
22
+ "9": "I-ORG",
23
+ "10": "I-PER"
24
+ },
25
+ "initializer_range": 0.02,
26
+ "intermediate_size": 3072,
27
+ "label2id": {
28
+ "B-DATE": 1,
29
+ "B-LOC": 2,
30
+ "B-MISC": 3,
31
+ "B-ORG": 4,
32
+ "B-PER": 5,
33
+ "I-DATE": 6,
34
+ "I-LOC": 7,
35
+ "I-MISC": 8,
36
+ "I-ORG": 9,
37
+ "I-PER": 10,
38
+ "O": 0
39
+ },
40
+ "layer_norm_eps": 1e-05,
41
+ "max_position_embeddings": 514,
42
+ "model_type": "xlm-roberta",
43
+ "num_attention_heads": 12,
44
+ "num_hidden_layers": 12,
45
+ "output_past": true,
46
+ "pad_token_id": 1,
47
+ "position_embedding_type": "absolute",
48
+ "torch_dtype": "float32",
49
+ "transformers_version": "4.51.3",
50
+ "type_vocab_size": 1,
51
+ "use_cache": true,
52
+ "vocab_size": 280002
53
+ }
seed-43/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:801d518fe3610a7e42ed34f0cd2f64a6e6ce082608d565d28c65338c2684ef5d
3
+ size 1202030220
seed-43/sentencepiece.bpe.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa0968380f92ab1a191718b59ed1dc2b759ad6ac521c876aecbef3e27b57cbc3
3
+ size 5812895
seed-43/special_tokens_map.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "cls_token": {
10
+ "content": "<s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "eos_token": {
17
+ "content": "</s>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "mask_token": {
24
+ "content": "<mask>",
25
+ "lstrip": true,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "pad_token": {
31
+ "content": "<pad>",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ },
37
+ "sep_token": {
38
+ "content": "</s>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false
43
+ },
44
+ "unk_token": {
45
+ "content": "<unk>",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false
50
+ }
51
+ }
seed-43/tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3f61da7ee5658d8fffacfd0ca08e92105810fe51b8c6994b249722c5c586c81
3
+ size 19146842
seed-43/tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "<s>",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "1": {
12
+ "content": "<pad>",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "2": {
20
+ "content": "</s>",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "3": {
28
+ "content": "<unk>",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "280001": {
36
+ "content": "<mask>",
37
+ "lstrip": true,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "bos_token": "<s>",
45
+ "clean_up_tokenization_spaces": false,
46
+ "cls_token": "<s>",
47
+ "eos_token": "</s>",
48
+ "extra_special_tokens": {},
49
+ "mask_token": "<mask>",
50
+ "model_max_length": 512,
51
+ "pad_token": "<pad>",
52
+ "sep_token": "</s>",
53
+ "sp_model_kwargs": {},
54
+ "tokenizer_class": "XLMRobertaTokenizer",
55
+ "unk_token": "<unk>"
56
+ }
seed-44/config.json ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "XLMRobertaForTokenClassification"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "bos_token_id": 0,
7
+ "classifier_dropout": null,
8
+ "eos_token_id": 2,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 768,
12
+ "id2label": {
13
+ "0": "O",
14
+ "1": "B-DATE",
15
+ "2": "B-LOC",
16
+ "3": "B-MISC",
17
+ "4": "B-ORG",
18
+ "5": "B-PER",
19
+ "6": "I-DATE",
20
+ "7": "I-LOC",
21
+ "8": "I-MISC",
22
+ "9": "I-ORG",
23
+ "10": "I-PER"
24
+ },
25
+ "initializer_range": 0.02,
26
+ "intermediate_size": 3072,
27
+ "label2id": {
28
+ "B-DATE": 1,
29
+ "B-LOC": 2,
30
+ "B-MISC": 3,
31
+ "B-ORG": 4,
32
+ "B-PER": 5,
33
+ "I-DATE": 6,
34
+ "I-LOC": 7,
35
+ "I-MISC": 8,
36
+ "I-ORG": 9,
37
+ "I-PER": 10,
38
+ "O": 0
39
+ },
40
+ "layer_norm_eps": 1e-05,
41
+ "max_position_embeddings": 514,
42
+ "model_type": "xlm-roberta",
43
+ "num_attention_heads": 12,
44
+ "num_hidden_layers": 12,
45
+ "output_past": true,
46
+ "pad_token_id": 1,
47
+ "position_embedding_type": "absolute",
48
+ "torch_dtype": "float32",
49
+ "transformers_version": "4.51.3",
50
+ "type_vocab_size": 1,
51
+ "use_cache": true,
52
+ "vocab_size": 280002
53
+ }
seed-44/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae4cc3278fe80b69a880784766ce4fd6a4f21573433cbd8fa84380a4dc4e19a4
3
+ size 1202030220
seed-44/sentencepiece.bpe.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa0968380f92ab1a191718b59ed1dc2b759ad6ac521c876aecbef3e27b57cbc3
3
+ size 5812895
seed-44/special_tokens_map.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "cls_token": {
10
+ "content": "<s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "eos_token": {
17
+ "content": "</s>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "mask_token": {
24
+ "content": "<mask>",
25
+ "lstrip": true,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "pad_token": {
31
+ "content": "<pad>",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ },
37
+ "sep_token": {
38
+ "content": "</s>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false
43
+ },
44
+ "unk_token": {
45
+ "content": "<unk>",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false
50
+ }
51
+ }
seed-44/tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3f61da7ee5658d8fffacfd0ca08e92105810fe51b8c6994b249722c5c586c81
3
+ size 19146842
seed-44/tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "<s>",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "1": {
12
+ "content": "<pad>",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "2": {
20
+ "content": "</s>",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "3": {
28
+ "content": "<unk>",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "280001": {
36
+ "content": "<mask>",
37
+ "lstrip": true,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "bos_token": "<s>",
45
+ "clean_up_tokenization_spaces": false,
46
+ "cls_token": "<s>",
47
+ "eos_token": "</s>",
48
+ "extra_special_tokens": {},
49
+ "mask_token": "<mask>",
50
+ "model_max_length": 512,
51
+ "pad_token": "<pad>",
52
+ "sep_token": "</s>",
53
+ "sp_model_kwargs": {},
54
+ "tokenizer_class": "XLMRobertaTokenizer",
55
+ "unk_token": "<unk>"
56
+ }
seed-45/config.json ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "XLMRobertaForTokenClassification"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "bos_token_id": 0,
7
+ "classifier_dropout": null,
8
+ "eos_token_id": 2,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 768,
12
+ "id2label": {
13
+ "0": "O",
14
+ "1": "B-DATE",
15
+ "2": "B-LOC",
16
+ "3": "B-MISC",
17
+ "4": "B-ORG",
18
+ "5": "B-PER",
19
+ "6": "I-DATE",
20
+ "7": "I-LOC",
21
+ "8": "I-MISC",
22
+ "9": "I-ORG",
23
+ "10": "I-PER"
24
+ },
25
+ "initializer_range": 0.02,
26
+ "intermediate_size": 3072,
27
+ "label2id": {
28
+ "B-DATE": 1,
29
+ "B-LOC": 2,
30
+ "B-MISC": 3,
31
+ "B-ORG": 4,
32
+ "B-PER": 5,
33
+ "I-DATE": 6,
34
+ "I-LOC": 7,
35
+ "I-MISC": 8,
36
+ "I-ORG": 9,
37
+ "I-PER": 10,
38
+ "O": 0
39
+ },
40
+ "layer_norm_eps": 1e-05,
41
+ "max_position_embeddings": 514,
42
+ "model_type": "xlm-roberta",
43
+ "num_attention_heads": 12,
44
+ "num_hidden_layers": 12,
45
+ "output_past": true,
46
+ "pad_token_id": 1,
47
+ "position_embedding_type": "absolute",
48
+ "torch_dtype": "float32",
49
+ "transformers_version": "4.51.3",
50
+ "type_vocab_size": 1,
51
+ "use_cache": true,
52
+ "vocab_size": 280002
53
+ }
seed-45/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3519951356e088bc75ed05e4bdc7faffb5af822a91da8c9bb879b3d12ace932d
3
+ size 1202030220
seed-45/sentencepiece.bpe.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa0968380f92ab1a191718b59ed1dc2b759ad6ac521c876aecbef3e27b57cbc3
3
+ size 5812895
seed-45/special_tokens_map.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "cls_token": {
10
+ "content": "<s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "eos_token": {
17
+ "content": "</s>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "mask_token": {
24
+ "content": "<mask>",
25
+ "lstrip": true,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "pad_token": {
31
+ "content": "<pad>",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ },
37
+ "sep_token": {
38
+ "content": "</s>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false
43
+ },
44
+ "unk_token": {
45
+ "content": "<unk>",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false
50
+ }
51
+ }
seed-45/tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3f61da7ee5658d8fffacfd0ca08e92105810fe51b8c6994b249722c5c586c81
3
+ size 19146842
seed-45/tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "<s>",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "1": {
12
+ "content": "<pad>",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "2": {
20
+ "content": "</s>",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "3": {
28
+ "content": "<unk>",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "280001": {
36
+ "content": "<mask>",
37
+ "lstrip": true,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "bos_token": "<s>",
45
+ "clean_up_tokenization_spaces": false,
46
+ "cls_token": "<s>",
47
+ "eos_token": "</s>",
48
+ "extra_special_tokens": {},
49
+ "mask_token": "<mask>",
50
+ "model_max_length": 512,
51
+ "pad_token": "<pad>",
52
+ "sep_token": "</s>",
53
+ "sp_model_kwargs": {},
54
+ "tokenizer_class": "XLMRobertaTokenizer",
55
+ "unk_token": "<unk>"
56
+ }
seed-46/config.json ADDED
@@ -0,0 +1,53 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "XLMRobertaForTokenClassification"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "bos_token_id": 0,
7
+ "classifier_dropout": null,
8
+ "eos_token_id": 2,
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 768,
12
+ "id2label": {
13
+ "0": "O",
14
+ "1": "B-DATE",
15
+ "2": "B-LOC",
16
+ "3": "B-MISC",
17
+ "4": "B-ORG",
18
+ "5": "B-PER",
19
+ "6": "I-DATE",
20
+ "7": "I-LOC",
21
+ "8": "I-MISC",
22
+ "9": "I-ORG",
23
+ "10": "I-PER"
24
+ },
25
+ "initializer_range": 0.02,
26
+ "intermediate_size": 3072,
27
+ "label2id": {
28
+ "B-DATE": 1,
29
+ "B-LOC": 2,
30
+ "B-MISC": 3,
31
+ "B-ORG": 4,
32
+ "B-PER": 5,
33
+ "I-DATE": 6,
34
+ "I-LOC": 7,
35
+ "I-MISC": 8,
36
+ "I-ORG": 9,
37
+ "I-PER": 10,
38
+ "O": 0
39
+ },
40
+ "layer_norm_eps": 1e-05,
41
+ "max_position_embeddings": 514,
42
+ "model_type": "xlm-roberta",
43
+ "num_attention_heads": 12,
44
+ "num_hidden_layers": 12,
45
+ "output_past": true,
46
+ "pad_token_id": 1,
47
+ "position_embedding_type": "absolute",
48
+ "torch_dtype": "float32",
49
+ "transformers_version": "4.51.3",
50
+ "type_vocab_size": 1,
51
+ "use_cache": true,
52
+ "vocab_size": 280002
53
+ }
seed-46/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a10fbdbd3401b01901d6fd722b89c7b1225f3c089024f9290695e9bc808fca6
3
+ size 1202030220
seed-46/sentencepiece.bpe.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa0968380f92ab1a191718b59ed1dc2b759ad6ac521c876aecbef3e27b57cbc3
3
+ size 5812895
seed-46/special_tokens_map.json ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": {
3
+ "content": "<s>",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "cls_token": {
10
+ "content": "<s>",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "eos_token": {
17
+ "content": "</s>",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "mask_token": {
24
+ "content": "<mask>",
25
+ "lstrip": true,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "pad_token": {
31
+ "content": "<pad>",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ },
37
+ "sep_token": {
38
+ "content": "</s>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false
43
+ },
44
+ "unk_token": {
45
+ "content": "<unk>",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false
50
+ }
51
+ }
seed-46/tokenizer.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3f61da7ee5658d8fffacfd0ca08e92105810fe51b8c6994b249722c5c586c81
3
+ size 19146842
seed-46/tokenizer_config.json ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "<s>",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "1": {
12
+ "content": "<pad>",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "2": {
20
+ "content": "</s>",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "3": {
28
+ "content": "<unk>",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "280001": {
36
+ "content": "<mask>",
37
+ "lstrip": true,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "bos_token": "<s>",
45
+ "clean_up_tokenization_spaces": false,
46
+ "cls_token": "<s>",
47
+ "eos_token": "</s>",
48
+ "extra_special_tokens": {},
49
+ "mask_token": "<mask>",
50
+ "model_max_length": 512,
51
+ "pad_token": "<pad>",
52
+ "sep_token": "</s>",
53
+ "sp_model_kwargs": {},
54
+ "tokenizer_class": "XLMRobertaTokenizer",
55
+ "unk_token": "<unk>"
56
+ }