MWirelabs
/

ne-bert

masked-language-modeling

northeast-india

low-resource-nlp

token-efficiency

Model card Files Files and versions

614 MB

1 contributor

History: 18 commits

Badnyal's picture

Update README.md

f7964c7 verified about 1 month ago

.gitattributes

1.64 kB

Add Data Distribution Chart about 1 month ago
README.md

8.88 kB

Update README.md about 1 month ago
config.json

1.11 kB

Initial upload of NE-BERT (10 Epochs) about 1 month ago
fertility_benchmark_chart.png

31.3 kB

Upload 3 files about 1 month ago
model.safetensors

610 MB
xet

Initial upload of NE-BERT (10 Epochs) about 1 month ago
ne_bert_data_dist.png

222 kB
xet

Add Data Distribution Chart about 1 month ago
ne_bert_loss_chart.png

186 kB
xet

Add training convergence chart about 1 month ago
ppl_benchmark_chart.png

47.3 kB

Upload 3 files about 1 month ago
special_tokens_map.json

695 Bytes

Initial upload of NE-BERT (10 Epochs) about 1 month ago
synthetic_test_corpus.json

9.39 kB

Upload 3 files about 1 month ago
tokenizer.json

3.52 MB

Initial upload of NE-BERT (10 Epochs) about 1 month ago
tokenizer_config.json

1.17 kB

Initial upload of NE-BERT (10 Epochs) about 1 month ago
training_args.bin
Detected Pickle imports (10)
- "transformers.training_args.TrainingArguments",
- "accelerate.state.PartialState",
- "transformers.trainer_utils.SaveStrategy",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.HubStrategy",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.training_args.OptimizerNames",
- "torch.device",
- "transformers.trainer_utils.SchedulerType",
- "transformers.trainer_pt_utils.AcceleratorConfig"
How to fix it?
5.84 kB
xet

Initial upload of NE-BERT (10 Epochs) about 1 month ago