NetherQuartz
/

ilo-toki-gemmax2-28-2b

Generated from Trainer

Model card Files Files and versions

ilo-toki-gemmax2-28-2b

80.2 MB

Ctrl+K

Ctrl+K

1 contributor

History: 9 commits

NetherQuartz's picture

Try lr 6e-5 with 3 epochs

4511577 verified 5 months ago

.gitattributes

1.57 kB
Try GemmaX2 5 months ago
README.md

1.51 kB
Try lr 3e-5 5 months ago
adapter_config.json

979 Bytes
Try lr 6e-5 with 3 epochs 5 months ago
adapter_model.safetensors

41.6 MB
xet

Try lr 6e-5 with 3 epochs 5 months ago
chat_template.jinja

356 Bytes
Try GemmaX2 5 months ago
special_tokens_map.json

585 Bytes
Try GemmaX2 5 months ago
tokenizer.json

34.4 MB
xet

Try GemmaX2 5 months ago
tokenizer.model

4.24 MB
xet

Try GemmaX2 5 months ago
tokenizer_config.json

48.4 kB
Try GemmaX2 5 months ago
training_args.bin
Detected Pickle imports (10)
- "trl.trainer.sft_config.SFTConfig",
- "transformers.trainer_utils.IntervalStrategy",
- "accelerate.state.PartialState",
- "transformers.training_args.OptimizerNames",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.SchedulerType",
- "transformers.trainer_utils.HubStrategy",
- "transformers.trainer_utils.SaveStrategy",
- "torch.device"
How to fix it?
6.16 kB
xet

Try lr 6e-5 with 3 epochs 5 months ago