ondevicellm
/

tinyllama_moe_sft_ultrachat-slimorca_epochs3

Text Generation

Model card Files Files and versions

Metrics Training metrics Community

tinyllama_moe_sft_ultrachat-slimorca_epochs3

2.41 MB

1 contributor

History: 17 commits

hushell's picture

Training in progress, step 1600

1e1cc42 verified almost 2 years ago

runs
Training in progress, step 1600 almost 2 years ago
.gitattributes

1.52 kB

initial commit almost 2 years ago
config.json

835 Bytes

Training in progress, step 100 almost 2 years ago
special_tokens_map.json

550 Bytes

Training in progress, step 100 almost 2 years ago
tokenizer.json

1.84 MB

Training in progress, step 100 almost 2 years ago
tokenizer.model

500 kB
xet

Training in progress, step 100 almost 2 years ago
tokenizer_config.json

1.42 kB

Training in progress, step 100 almost 2 years ago
training_args.bin
Detected Pickle imports (11)
- "transformers.trainer_utils.HubStrategy",
- "torch.device",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "accelerate.utils.dataclasses.DistributedType",
- "configs.SFTConfig",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.IntervalStrategy",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "transformers.trainer_utils.SchedulerType",
- "accelerate.state.PartialState",
- "torch.bfloat16"
How to fix it?
5.37 kB
xet

Training in progress, step 100 almost 2 years ago