24.4 GB

Ctrl+K

1 contributor

History: 17 commits

tsor13

Initial upload of fine‑tuned Gemma + custom tokenizer

c5b0064 verified 8 months ago

.gitattributes

1.57 kB
Initial upload of fine‑tuned Gemma + custom tokenizer 9 months ago
README.md

13.7 kB
Initial upload of fine‑tuned Gemma + custom tokenizer 8 months ago
added_tokens.json

35 Bytes
Initial upload of fine‑tuned Gemma + custom tokenizer 9 months ago
config.json

1.57 kB
Initial upload of fine‑tuned Gemma + custom tokenizer 9 months ago
gemma_bracket_tokenizer.py

17.5 kB
Initial upload of fine‑tuned Gemma + custom tokenizer 9 months ago
gemma_explicit_tokenizer.py

16 kB
Initial upload of fine‑tuned Gemma + custom tokenizer 8 months ago
gemma_special_tokenizer.py

17.4 kB
Initial upload of fine‑tuned Gemma + custom tokenizer 8 months ago
generation_config.json

210 Bytes
Initial upload of fine‑tuned Gemma + custom tokenizer 9 months ago
model-00001-of-00005.safetensors

4.98 GB
xet

Initial upload of fine‑tuned Gemma + custom tokenizer 8 months ago
model-00002-of-00005.safetensors

4.93 GB
xet

Initial upload of fine‑tuned Gemma + custom tokenizer 8 months ago
model-00003-of-00005.safetensors

4.93 GB
xet

Initial upload of fine‑tuned Gemma + custom tokenizer 8 months ago
model-00004-of-00005.safetensors

4.93 GB
xet

Initial upload of fine‑tuned Gemma + custom tokenizer 8 months ago
model-00005-of-00005.safetensors

4.6 GB
xet

Initial upload of fine‑tuned Gemma + custom tokenizer 8 months ago
model.safetensors.index.json

109 kB
Initial upload of fine‑tuned Gemma + custom tokenizer 9 months ago
scheduler.pt
Pickle imports
- No problematic imports detected
What is a pickle import?
1.47 kB
xet

Initial upload of fine‑tuned Gemma + custom tokenizer 8 months ago
special_tokens_map.json

662 Bytes
Initial upload of fine‑tuned Gemma + custom tokenizer 9 months ago
tokenizer.json

33.4 MB
xet

Initial upload of fine‑tuned Gemma + custom tokenizer 9 months ago
tokenizer_config.json

1.16 MB
Initial upload of fine‑tuned Gemma + custom tokenizer 8 months ago
trainer_state.json

2.79 kB
Initial upload of fine‑tuned Gemma + custom tokenizer 8 months ago
training_args.bin
Detected Pickle imports (14)
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.training_args.OptimizerNames",
- "torch.device",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "accelerate.state.PartialState",
- "torch.bfloat16",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "trl.trainer.sft_config.SFTConfig",
- "transformers.trainer_utils.SchedulerType",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.HubStrategy",
- "transformers.integrations.deepspeed.HfDeepSpeedConfig",
- "transformers.trainer_utils.SaveStrategy",
- "transformers.trainer_pt_utils.AcceleratorConfig"
How to fix it?
7.38 kB
xet

Initial upload of fine‑tuned Gemma + custom tokenizer 8 months ago
zero_to_fp32.py

33.3 kB
Initial upload of fine‑tuned Gemma + custom tokenizer 9 months ago

Pickle imports

Detected Pickle imports (14)