MWirelabs
/

ne-bert

masked-language-modeling

northeast-india

low-resource-nlp

token-efficiency

Eval Results (legacy)

Model card Files Files and versions

614 MB

1 contributor

History: 18 commits

Khrawsynth's picture

Update README.md

da094b9 verified 2 months ago

.gitattributes

1.64 kB

Add Data Distribution Chart 2 months ago
README.md

8.88 kB

Update README.md 2 months ago
config.json

1.11 kB

Initial upload of NE-BERT (10 Epochs) 2 months ago
fertility_benchmark_chart.png

31.3 kB

Upload 3 files 2 months ago
model.safetensors

610 MB
xet

Initial upload of NE-BERT (10 Epochs) 2 months ago
ne_bert_data_dist.png

222 kB
xet

Add Data Distribution Chart 2 months ago
ne_bert_loss_chart.png

186 kB
xet

Add training convergence chart 2 months ago
ppl_benchmark_chart.png

47.3 kB

Upload 3 files 2 months ago
special_tokens_map.json

695 Bytes

Initial upload of NE-BERT (10 Epochs) 2 months ago
synthetic_test_corpus.json

9.39 kB

Upload 3 files 2 months ago
tokenizer.json

3.52 MB

Initial upload of NE-BERT (10 Epochs) 2 months ago
tokenizer_config.json

1.17 kB

Initial upload of NE-BERT (10 Epochs) 2 months ago
training_args.bin
Detected Pickle imports (10)
- "transformers.training_args.TrainingArguments",
- "accelerate.state.PartialState",
- "transformers.trainer_utils.SaveStrategy",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.HubStrategy",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.training_args.OptimizerNames",
- "torch.device",
- "transformers.trainer_utils.SchedulerType",
- "transformers.trainer_pt_utils.AcceleratorConfig"
How to fix it?
5.84 kB
xet

Initial upload of NE-BERT (10 Epochs) 2 months ago