Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Howuhh
/
SmolLM2-135M-Instruct-Human-Like-Reward
like
0
Text Classification
Transformers
Safetensors
HumanLLMs/Human-Like-DPO-Dataset
llama
Generated from Trainer
trl
reward-trainer
text-generation-inference
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
1761ae5
SmolLM2-135M-Instruct-Human-Like-Reward
274 MB
1 contributor
History:
2 commits
Howuhh
End of training
1761ae5
verified
10 months ago
.gitattributes
Safe
1.52 kB
initial commit
10 months ago
README.md
1.95 kB
End of training
10 months ago
config.json
1.03 kB
End of training
10 months ago
merges.txt
Safe
466 kB
End of training
10 months ago
model.safetensors
269 MB
xet
End of training
10 months ago
special_tokens_map.json
Safe
544 Bytes
End of training
10 months ago
tokenizer.json
Safe
3.52 MB
End of training
10 months ago
tokenizer_config.json
3.77 kB
End of training
10 months ago
training_args.bin
pickle
Detected Pickle imports (9)
"transformers.trainer_utils.SchedulerType"
,
"accelerate.utils.dataclasses.DistributedType"
,
"accelerate.state.PartialState"
,
"torch.device"
,
"transformers.training_args.OptimizerNames"
,
"transformers.trainer_utils.IntervalStrategy"
,
"trl.trainer.reward_config.RewardConfig"
,
"transformers.trainer_pt_utils.AcceleratorConfig"
,
"transformers.trainer_utils.HubStrategy"
How to fix it?
5.43 kB
xet
End of training
10 months ago
vocab.json
Safe
801 kB
End of training
10 months ago