HectorHe
/

Deepseek-Coder-V2-Lite-13B-Instruct-Math10K-Distill-6-experts-test-token-specific-5-epoch

Model card Files Files and versions

Deepseek-Coder-V2-Lite-13B-Instruct-Math10K-Distill-6-experts-test-token-specific-5-epoch

5.33 GB

Ctrl+K

Ctrl+K

1 contributor

History: 16 commits

HectorHe's picture

Training in progress, step 1500

b54edb4 verified 10 months ago

.gitattributes

1.52 kB
initial commit 10 months ago
chat_template.jinja

459 Bytes
Training in progress, step 100 10 months ago
config.json

1.68 kB
Training in progress, step 100 10 months ago
expert_selection.log

8.61 kB
Training in progress, step 100 10 months ago
model-00001-of-00002.safetensors

4.9 GB
xet

Training in progress, step 1500 10 months ago
model-00002-of-00002.safetensors

419 MB
xet

Training in progress, step 1500 10 months ago
model.safetensors.index.json

72.1 kB
Training in progress, step 100 10 months ago
special_tokens_map.json

369 Bytes
Training in progress, step 100 10 months ago
tokenizer.json

7.5 MB
Training in progress, step 100 10 months ago
tokenizer_config.json

3.93 kB
Training in progress, step 100 10 months ago
top_6_experts_lmms-lab_Math10K.json

1.24 kB
Training in progress, step 100 10 months ago
training.log

10.4 kB
Training in progress, step 100 10 months ago
training_args.bin
Detected Pickle imports (14)
- "transformers.integrations.deepspeed.HfDeepSpeedConfig",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.SaveStrategy",
- "transformers.trainer_utils.SchedulerType",
- "transformers.training_args.OptimizerNames",
- "torch.device",
- "accelerate.utils.dataclasses.DistributedType",
- "trainers.efficient_distillation_config.EfficientDistillationConfig",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "transformers.trainer_utils.HubStrategy",
- "transformers.trainer_utils.IntervalStrategy",
- "accelerate.state.PartialState",
- "torch.bfloat16"
How to fix it?
8.18 kB
xet

Training in progress, step 100 10 months ago