Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
LifelongAlignment
/
aifgen-piecewise-preference-shift-2-reward-model
like
0
Follow
Lifelong Alignment of Agents
7
Safetensors
qwen2
Model card
Files
Files and versions
xet
Community
main
aifgen-piecewise-preference-shift-2-reward-model
7.94 GB
Ctrl+K
Ctrl+K
1 contributor
History:
3 commits
avecplezir
Upload AIFGen reward model
0e1aa5b
verified
11 months ago
checkpoint-133
Upload AIFGen reward model
11 months ago
.gitattributes
Safe
1.64 kB
Upload AIFGen reward model
11 months ago
added_tokens.json
Safe
80 Bytes
Upload AIFGen reward model
11 months ago
all_results.json
Safe
202 Bytes
Upload AIFGen reward model
11 months ago
config.json
Safe
848 Bytes
Upload AIFGen reward model
11 months ago
eval_results.json
Safe
202 Bytes
Upload AIFGen reward model
11 months ago
merges.txt
Safe
1.67 MB
Upload AIFGen reward model
11 months ago
model.safetensors
988 MB
xet
Upload AIFGen reward model
11 months ago
special_tokens_map.json
Safe
367 Bytes
Upload AIFGen reward model
11 months ago
tokenizer.json
Safe
11.4 MB
xet
Upload AIFGen reward model
11 months ago
tokenizer_config.json
Safe
1.33 kB
Upload AIFGen reward model
11 months ago
training_args.bin
pickle
Detected Pickle imports (14)
"transformers.training_args.OptimizerNames"
,
"transformers.trainer_utils.HubStrategy"
,
"transformers.integrations.deepspeed.HfDeepSpeedConfig"
,
"accelerate.utils.dataclasses.DistributedType"
,
"torch.bfloat16"
,
"accelerate.utils.dataclasses.DeepSpeedPlugin"
,
"transformers.trainer_utils.IntervalStrategy"
,
"trl.trainer.reward_config.RewardConfig"
,
"accelerate.state.PartialState"
,
"transformers.trainer_utils.SaveStrategy"
,
"torch.device"
,
"transformers.trainer_utils.SchedulerType"
,
"transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig"
,
"transformers.trainer_pt_utils.AcceleratorConfig"
How to fix it?
6.9 kB
xet
Upload AIFGen reward model
11 months ago
vocab.json
Safe
2.78 MB
Upload AIFGen reward model
11 months ago