MWirelabs
/

ne-bert

masked-language-modeling

northeast-india

low-resource-nlp

token-efficiency

Eval Results (legacy)

Model card Files Files and versions

614 MB

Ctrl+K

Ctrl+K

1 contributor

History: 9 commits

Badnyal's picture

Upload 3 files

7cdbcec verified 5 months ago

.gitattributes

1.64 kB
Add Data Distribution Chart 5 months ago
README.md

6.69 kB
Update README.md 5 months ago
config.json

1.11 kB
Initial upload of NE-BERT (10 Epochs) 5 months ago
fertility_benchmark_chart.png

31.3 kB
Upload 3 files 5 months ago
model.safetensors

610 MB
xet

Initial upload of NE-BERT (10 Epochs) 5 months ago
ne_bert_data_dist.png

222 kB
xet

Add Data Distribution Chart 5 months ago
ne_bert_loss_chart.png

186 kB
xet

Add training convergence chart 5 months ago
ppl_benchmark_chart.png

47.3 kB
Upload 3 files 5 months ago
special_tokens_map.json

695 Bytes
Initial upload of NE-BERT (10 Epochs) 5 months ago
synthetic_test_corpus.json

9.39 kB
Upload 3 files 5 months ago
tokenizer.json

3.52 MB
Initial upload of NE-BERT (10 Epochs) 5 months ago
tokenizer_config.json

1.17 kB
Initial upload of NE-BERT (10 Epochs) 5 months ago
training_args.bin
Detected Pickle imports (10)
- "transformers.training_args.TrainingArguments",
- "accelerate.state.PartialState",
- "transformers.trainer_utils.SaveStrategy",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.HubStrategy",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.training_args.OptimizerNames",
- "torch.device",
- "transformers.trainer_utils.SchedulerType",
- "transformers.trainer_pt_utils.AcceleratorConfig"
How to fix it?
5.84 kB
xet

Initial upload of NE-BERT (10 Epochs) 5 months ago