CHYang25 commited on
Commit
1f7b3e6
·
verified ·
1 Parent(s): def9645

Upload folder using huggingface_hub

Browse files
Files changed (47) hide show
  1. .gitattributes +1 -0
  2. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/.hydra/config.yaml +115 -0
  3. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/.hydra/hydra.yaml +154 -0
  4. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/.hydra/overrides.yaml +1 -0
  5. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/config.json +42 -0
  6. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/generation_config.json +7 -0
  7. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/merges.txt +0 -0
  8. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/mlp_projector.bin +3 -0
  9. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/model.safetensors +3 -0
  10. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/optimizer.pt +3 -0
  11. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/rng_state.pth +3 -0
  12. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/scheduler.pt +3 -0
  13. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/special_tokens_map.json +34 -0
  14. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/tokenizer.json +0 -0
  15. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/tokenizer_config.json +155 -0
  16. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/trainer_state.json +0 -0
  17. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/training_args.bin +3 -0
  18. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/vocab.json +0 -0
  19. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/config.json +42 -0
  20. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/generation_config.json +7 -0
  21. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/merges.txt +0 -0
  22. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/mlp_projector.bin +3 -0
  23. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/model.safetensors +3 -0
  24. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/optimizer.pt +3 -0
  25. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/rng_state.pth +3 -0
  26. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/scheduler.pt +3 -0
  27. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/special_tokens_map.json +34 -0
  28. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/tokenizer.json +0 -0
  29. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/tokenizer_config.json +155 -0
  30. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/trainer_state.json +0 -0
  31. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/training_args.bin +3 -0
  32. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/vocab.json +0 -0
  33. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/config.json +42 -0
  34. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/generation_config.json +7 -0
  35. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/model.safetensors +3 -0
  36. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/normalizer.pt +3 -0
  37. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/train.log +11 -0
  38. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/debug-internal.log +17 -0
  39. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/debug.log +35 -0
  40. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/files/config.yaml +713 -0
  41. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/files/output.log +0 -0
  42. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/files/wandb-metadata.json +55 -0
  43. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/files/wandb-summary.json +1 -0
  44. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/logs/debug-core.log +16 -0
  45. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/logs/debug-internal.log +17 -0
  46. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/logs/debug.log +35 -0
  47. 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/run-2h81cyev.wandb +3 -0
.gitattributes CHANGED
@@ -173,3 +173,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
173
  2026.03.17/16.13.39_train_rbc_reward_model_box-close-v2/wandb/run-20260317_161342-ydactfyz/run-ydactfyz.wandb filter=lfs diff=lfs merge=lfs -text
174
  2026.03.18/22.30.56_train_llm_lowdim_box-close-v2/wandb/run-20260318_223101-x1m9280b/run-x1m9280b.wandb filter=lfs diff=lfs merge=lfs -text
175
  2026.03.25/21.48.48_train_llm_lowdim_box-close-v2/wandb/run-20260325_214852-hhto1ipm/run-hhto1ipm.wandb filter=lfs diff=lfs merge=lfs -text
 
 
173
  2026.03.17/16.13.39_train_rbc_reward_model_box-close-v2/wandb/run-20260317_161342-ydactfyz/run-ydactfyz.wandb filter=lfs diff=lfs merge=lfs -text
174
  2026.03.18/22.30.56_train_llm_lowdim_box-close-v2/wandb/run-20260318_223101-x1m9280b/run-x1m9280b.wandb filter=lfs diff=lfs merge=lfs -text
175
  2026.03.25/21.48.48_train_llm_lowdim_box-close-v2/wandb/run-20260325_214852-hhto1ipm/run-hhto1ipm.wandb filter=lfs diff=lfs merge=lfs -text
176
+ 2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/run-2h81cyev.wandb filter=lfs diff=lfs merge=lfs -text
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/.hydra/config.yaml ADDED
@@ -0,0 +1,115 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ name: train_llm_lowdim
2
+ _target_: llmbc.workspace.train_llm_workspace.TrainLLMWorkspace
3
+ obs_dim: ${task.obs_dim}
4
+ action_dim: ${task.action_dim}
5
+ horizon: 1
6
+ n_obs_steps: 1
7
+ n_action_steps: 1
8
+ task_name: ${task.name}
9
+ exp_name: train llm
10
+ model_name: ${llm.name}
11
+ use_quantization: ${llm.use_quantization}
12
+ lora_config: ${llm.lora_config}
13
+ dataset:
14
+ test_data_ratio: 0.01
15
+ debug: false
16
+ training:
17
+ seed: 42
18
+ per_device_train_batch_size: 128
19
+ per_device_eval_batch_size: 128
20
+ gradient_accumulation_steps: 1
21
+ optim: paged_adamw_32bit
22
+ num_train_epochs: 10
23
+ eval_strategy: steps
24
+ logging_steps: 1
25
+ warmup_steps: 10
26
+ logging_strategy: steps
27
+ learning_rate: 5.0e-05
28
+ fp16: false
29
+ bf16: true
30
+ tf32: true
31
+ group_by_length: true
32
+ report_to: wandb
33
+ save_steps: 5000
34
+ eval_steps: 10
35
+ use_joint_mlp_projector: ${llm.use_joint_mlp_projector}
36
+ joint_obs_action_mlp_lr: 5.0e-05
37
+ trainer:
38
+ obs_dim: ${obs_dim}
39
+ action_dim: ${action_dim}
40
+ use_joint_mlp_projector: ${llm.use_joint_mlp_projector}
41
+ max_seq_length: ${llm.max_length}
42
+ dataset_text_field: text
43
+ packing: false
44
+ logging:
45
+ project: llm_module_finetuning
46
+ resume: true
47
+ mode: online
48
+ name: ${now:%Y.%m.%d-%H.%M.%S}_${name}_${task_name}
49
+ tags:
50
+ - ${name}
51
+ - ${task_name}
52
+ - ${exp_name}
53
+ id: null
54
+ group: null
55
+ multi_run:
56
+ run_dir: data/outputs/${now:%Y.%m.%d}/${now:%H.%M.%S}_${name}_${task_name}
57
+ wandb_name_base: ${now:%Y.%m.%d-%H.%M.%S}_${name}_${task_name}
58
+ task:
59
+ name: box-close-v2
60
+ obs_dim: 9
61
+ action_dim: 4
62
+ env_runner:
63
+ _target_: llmbc.env_runner.metaworld_lowdim_runner.MetaworldLowdimRunner
64
+ env_name: llf-metaworld-box-close-v2
65
+ n_train: 10
66
+ n_test: 50
67
+ n_envs: 10
68
+ max_steps: 30
69
+ n_obs_steps: ${n_obs_steps}
70
+ n_action_steps: ${n_action_steps}
71
+ instruction_type: b
72
+ feedback_type:
73
+ - hp
74
+ - hn
75
+ - fp
76
+ visual: false
77
+ discount: 0.9
78
+ dataset:
79
+ _target_: llmbc.dataset.metaworld_lowdim_dataset.MetaworldLowdimDataset
80
+ data_path: datasets/box-close-v2-general-pref001.pt
81
+ data_path2: datasets/box-close-v2-pref001.pt
82
+ horizon: ${horizon}
83
+ pad_before: ${eval:'${n_obs_steps}-1'}
84
+ pad_after: ${eval:'${n_action_steps}-1'}
85
+ obs_eef_target: true
86
+ use_manual_normalizer: false
87
+ val_ratio: 0.05
88
+ dummy_normalizer: true
89
+ instructor:
90
+ _target_: llmbc.translator.instructor.metaworld_instructor.box_close_v2_instructor.BoxCloseV2Instructor
91
+ llm:
92
+ name: HuggingFaceTB/SmolLM2-135M-Instruct
93
+ model_name: SmolLM2-135M-Instruct
94
+ config_target: llmbc.model.llm.llama_lowdim_model.LowdimLlamaConfig
95
+ causal_lm_target: llmbc.model.llm.llama_lowdim_model.LowdimLlamaForCausalLM
96
+ use_quantization: false
97
+ use_joint_mlp_projector: true
98
+ llm_mode: mlp-finetuned
99
+ finetune_mode: orig
100
+ checkpoint: data/outputs/2026.03.25/00.25.57_train_mlp_projector_box-close-v2/checkpoints/latest.ckpt
101
+ max_length: 100
102
+ lora_config:
103
+ r: 32
104
+ lora_alpha: 64
105
+ lora_dropout: 0.05
106
+ bias: none
107
+ task_type: CAUSAL_LM
108
+ prompter:
109
+ _target_: llmbc.translator.prompter.smollm2_prompter.SmolLM2Prompter
110
+ use_joint_mlp_projector: true
111
+ hydra:
112
+ job:
113
+ override_dirname: ${model_name}
114
+ run:
115
+ dir: data/outputs/${now:%Y.%m.%d}/${now:%H.%M.%S}_${model_name}
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/.hydra/hydra.yaml ADDED
@@ -0,0 +1,154 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ hydra:
2
+ run:
3
+ dir: data/outputs/${now:%Y.%m.%d}/${now:%H.%M.%S}_${name}_${task_name}
4
+ sweep:
5
+ dir: data/outputs/${now:%Y.%m.%d}/${now:%H.%M.%S}_${name}_${task_name}
6
+ subdir: ${hydra.job.num}
7
+ launcher:
8
+ _target_: hydra._internal.core_plugins.basic_launcher.BasicLauncher
9
+ sweeper:
10
+ _target_: hydra._internal.core_plugins.basic_sweeper.BasicSweeper
11
+ max_batch_size: null
12
+ params: null
13
+ help:
14
+ app_name: ${hydra.job.name}
15
+ header: '${hydra.help.app_name} is powered by Hydra.
16
+
17
+ '
18
+ footer: 'Powered by Hydra (https://hydra.cc)
19
+
20
+ Use --hydra-help to view Hydra specific help
21
+
22
+ '
23
+ template: '${hydra.help.header}
24
+
25
+ == Configuration groups ==
26
+
27
+ Compose your configuration from those groups (group=option)
28
+
29
+
30
+ $APP_CONFIG_GROUPS
31
+
32
+
33
+ == Config ==
34
+
35
+ Override anything in the config (foo.bar=value)
36
+
37
+
38
+ $CONFIG
39
+
40
+
41
+ ${hydra.help.footer}
42
+
43
+ '
44
+ hydra_help:
45
+ template: 'Hydra (${hydra.runtime.version})
46
+
47
+ See https://hydra.cc for more info.
48
+
49
+
50
+ == Flags ==
51
+
52
+ $FLAGS_HELP
53
+
54
+
55
+ == Configuration groups ==
56
+
57
+ Compose your configuration from those groups (For example, append hydra/job_logging=disabled
58
+ to command line)
59
+
60
+
61
+ $HYDRA_CONFIG_GROUPS
62
+
63
+
64
+ Use ''--cfg hydra'' to Show the Hydra config.
65
+
66
+ '
67
+ hydra_help: ???
68
+ hydra_logging:
69
+ version: 1
70
+ formatters:
71
+ simple:
72
+ format: '[%(asctime)s][HYDRA] %(message)s'
73
+ handlers:
74
+ console:
75
+ class: logging.StreamHandler
76
+ formatter: simple
77
+ stream: ext://sys.stdout
78
+ root:
79
+ level: INFO
80
+ handlers:
81
+ - console
82
+ loggers:
83
+ logging_example:
84
+ level: DEBUG
85
+ disable_existing_loggers: false
86
+ job_logging:
87
+ version: 1
88
+ formatters:
89
+ simple:
90
+ format: '[%(asctime)s][%(name)s][%(levelname)s] - %(message)s'
91
+ handlers:
92
+ console:
93
+ class: logging.StreamHandler
94
+ formatter: simple
95
+ stream: ext://sys.stdout
96
+ file:
97
+ class: logging.FileHandler
98
+ formatter: simple
99
+ filename: ${hydra.runtime.output_dir}/${hydra.job.name}.log
100
+ root:
101
+ level: INFO
102
+ handlers:
103
+ - console
104
+ - file
105
+ disable_existing_loggers: false
106
+ env: {}
107
+ mode: RUN
108
+ searchpath: []
109
+ callbacks: {}
110
+ output_subdir: .hydra
111
+ overrides:
112
+ hydra:
113
+ - hydra.mode=RUN
114
+ task: []
115
+ job:
116
+ name: train
117
+ chdir: null
118
+ override_dirname: ''
119
+ id: ???
120
+ num: ???
121
+ config_name: llmbc_llm_box-close-v2_pref001.yaml
122
+ env_set: {}
123
+ env_copy: []
124
+ config:
125
+ override_dirname:
126
+ kv_sep: '='
127
+ item_sep: ','
128
+ exclude_keys: []
129
+ runtime:
130
+ version: 1.2.0
131
+ version_base: '1.2'
132
+ cwd: /tmp2/chyang/workspace/LLM-BC
133
+ config_sources:
134
+ - path: hydra.conf
135
+ schema: pkg
136
+ provider: hydra
137
+ - path: /tmp2/chyang/workspace/LLM-BC/config/lang_compose
138
+ schema: file
139
+ provider: main
140
+ - path: ''
141
+ schema: structured
142
+ provider: schema
143
+ output_dir: /tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2
144
+ choices:
145
+ hydra/env: default
146
+ hydra/callbacks: null
147
+ hydra/job_logging: default
148
+ hydra/hydra_logging: default
149
+ hydra/hydra_help: default
150
+ hydra/help: default
151
+ hydra/sweeper: basic
152
+ hydra/launcher: basic
153
+ hydra/output: default
154
+ verbose: false
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/.hydra/overrides.yaml ADDED
@@ -0,0 +1 @@
 
 
1
+ []
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/config.json ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "HuggingFaceTB/SmolLM2-135M-Instruct",
3
+ "action_dim": 4,
4
+ "architectures": [
5
+ "LowdimLlamaForCausalLM"
6
+ ],
7
+ "attention_bias": false,
8
+ "attention_dropout": 0.0,
9
+ "bos_token_id": 1,
10
+ "eos_token_id": 2,
11
+ "head_dim": 64,
12
+ "hidden_act": "silu",
13
+ "hidden_size": 576,
14
+ "initializer_range": 0.041666666666666664,
15
+ "intermediate_size": 1536,
16
+ "is_llama_config": true,
17
+ "max_position_embeddings": 8192,
18
+ "mlp_bias": false,
19
+ "model_type": "llama_lowdim",
20
+ "num_attention_heads": 9,
21
+ "num_hidden_layers": 30,
22
+ "num_key_value_heads": 3,
23
+ "obs_dim": 9,
24
+ "pad_token_id": 2,
25
+ "pretraining_tp": 1,
26
+ "rms_norm_eps": 1e-05,
27
+ "rope_interleaved": false,
28
+ "rope_scaling": null,
29
+ "rope_theta": 100000,
30
+ "tie_word_embeddings": true,
31
+ "torch_dtype": "float32",
32
+ "transformers.js_config": {
33
+ "kv_cache_dtype": {
34
+ "fp16": "float16",
35
+ "q4f16": "float16"
36
+ }
37
+ },
38
+ "transformers_version": "4.47.1",
39
+ "use_cache": false,
40
+ "use_joint_mlp_projector": true,
41
+ "vocab_size": 49152
42
+ }
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/generation_config.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 1,
4
+ "eos_token_id": 2,
5
+ "pad_token_id": 2,
6
+ "transformers_version": "4.47.1"
7
+ }
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/mlp_projector.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ccb7ee5c1addd2e890eafd3510224a36c3136289466ee4f4264f12dffe55d2e
3
+ size 1363840
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:667c694edbb543a2c108b3fce3e545c031ffd769e78a3abf0ac3bf0b44da2b80
3
+ size 539452560
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3f44e75212d354b26f0157fbb0d34520d36dae48af8b0b9636691f184663f8a
3
+ size 1079012922
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1229178cd3fc53fbbeb2ace48b61cc7f5f11f85a2aa90404bd54a81f04d35cf2
3
+ size 14244
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fe091fb2fedf91b42e18969d851f23b6438bcf57783f83635d0c5496df212a1d
3
+ size 1064
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/special_tokens_map.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<|im_start|>",
4
+ "<|im_end|>"
5
+ ],
6
+ "bos_token": {
7
+ "content": "<|im_start|>",
8
+ "lstrip": false,
9
+ "normalized": false,
10
+ "rstrip": false,
11
+ "single_word": false
12
+ },
13
+ "eos_token": {
14
+ "content": "<|im_end|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false
19
+ },
20
+ "pad_token": {
21
+ "content": "<|im_end|>",
22
+ "lstrip": false,
23
+ "normalized": false,
24
+ "rstrip": false,
25
+ "single_word": false
26
+ },
27
+ "unk_token": {
28
+ "content": "<|endoftext|>",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false
33
+ }
34
+ }
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/tokenizer_config.json ADDED
@@ -0,0 +1,155 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "added_tokens_decoder": {
4
+ "0": {
5
+ "content": "<|endoftext|>",
6
+ "lstrip": false,
7
+ "normalized": false,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ },
12
+ "1": {
13
+ "content": "<|im_start|>",
14
+ "lstrip": false,
15
+ "normalized": false,
16
+ "rstrip": false,
17
+ "single_word": false,
18
+ "special": true
19
+ },
20
+ "2": {
21
+ "content": "<|im_end|>",
22
+ "lstrip": false,
23
+ "normalized": false,
24
+ "rstrip": false,
25
+ "single_word": false,
26
+ "special": true
27
+ },
28
+ "3": {
29
+ "content": "<repo_name>",
30
+ "lstrip": false,
31
+ "normalized": false,
32
+ "rstrip": false,
33
+ "single_word": false,
34
+ "special": true
35
+ },
36
+ "4": {
37
+ "content": "<reponame>",
38
+ "lstrip": false,
39
+ "normalized": false,
40
+ "rstrip": false,
41
+ "single_word": false,
42
+ "special": true
43
+ },
44
+ "5": {
45
+ "content": "<file_sep>",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false,
50
+ "special": true
51
+ },
52
+ "6": {
53
+ "content": "<filename>",
54
+ "lstrip": false,
55
+ "normalized": false,
56
+ "rstrip": false,
57
+ "single_word": false,
58
+ "special": true
59
+ },
60
+ "7": {
61
+ "content": "<gh_stars>",
62
+ "lstrip": false,
63
+ "normalized": false,
64
+ "rstrip": false,
65
+ "single_word": false,
66
+ "special": true
67
+ },
68
+ "8": {
69
+ "content": "<issue_start>",
70
+ "lstrip": false,
71
+ "normalized": false,
72
+ "rstrip": false,
73
+ "single_word": false,
74
+ "special": true
75
+ },
76
+ "9": {
77
+ "content": "<issue_comment>",
78
+ "lstrip": false,
79
+ "normalized": false,
80
+ "rstrip": false,
81
+ "single_word": false,
82
+ "special": true
83
+ },
84
+ "10": {
85
+ "content": "<issue_closed>",
86
+ "lstrip": false,
87
+ "normalized": false,
88
+ "rstrip": false,
89
+ "single_word": false,
90
+ "special": true
91
+ },
92
+ "11": {
93
+ "content": "<jupyter_start>",
94
+ "lstrip": false,
95
+ "normalized": false,
96
+ "rstrip": false,
97
+ "single_word": false,
98
+ "special": true
99
+ },
100
+ "12": {
101
+ "content": "<jupyter_text>",
102
+ "lstrip": false,
103
+ "normalized": false,
104
+ "rstrip": false,
105
+ "single_word": false,
106
+ "special": true
107
+ },
108
+ "13": {
109
+ "content": "<jupyter_code>",
110
+ "lstrip": false,
111
+ "normalized": false,
112
+ "rstrip": false,
113
+ "single_word": false,
114
+ "special": true
115
+ },
116
+ "14": {
117
+ "content": "<jupyter_output>",
118
+ "lstrip": false,
119
+ "normalized": false,
120
+ "rstrip": false,
121
+ "single_word": false,
122
+ "special": true
123
+ },
124
+ "15": {
125
+ "content": "<jupyter_script>",
126
+ "lstrip": false,
127
+ "normalized": false,
128
+ "rstrip": false,
129
+ "single_word": false,
130
+ "special": true
131
+ },
132
+ "16": {
133
+ "content": "<empty_output>",
134
+ "lstrip": false,
135
+ "normalized": false,
136
+ "rstrip": false,
137
+ "single_word": false,
138
+ "special": true
139
+ }
140
+ },
141
+ "additional_special_tokens": [
142
+ "<|im_start|>",
143
+ "<|im_end|>"
144
+ ],
145
+ "bos_token": "<|im_start|>",
146
+ "chat_template": "{% for message in messages %}{% if loop.first and messages[0]['role'] != 'system' %}{{ '<|im_start|>system\nYou are a helpful AI assistant named SmolLM, trained by Hugging Face<|im_end|>\n' }}{% endif %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
147
+ "clean_up_tokenization_spaces": false,
148
+ "eos_token": "<|im_end|>",
149
+ "extra_special_tokens": {},
150
+ "model_max_length": 8192,
151
+ "pad_token": "<|im_end|>",
152
+ "tokenizer_class": "GPT2Tokenizer",
153
+ "unk_token": "<|endoftext|>",
154
+ "vocab_size": 49152
155
+ }
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/trainer_state.json ADDED
The diff for this file is too large to render. See raw diff
 
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7d086f0d85d4811f50e1b1e02897a31ca34f9fd6b54a7941a52c466723aceac
3
+ size 5944
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5000/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/config.json ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "HuggingFaceTB/SmolLM2-135M-Instruct",
3
+ "action_dim": 4,
4
+ "architectures": [
5
+ "LowdimLlamaForCausalLM"
6
+ ],
7
+ "attention_bias": false,
8
+ "attention_dropout": 0.0,
9
+ "bos_token_id": 1,
10
+ "eos_token_id": 2,
11
+ "head_dim": 64,
12
+ "hidden_act": "silu",
13
+ "hidden_size": 576,
14
+ "initializer_range": 0.041666666666666664,
15
+ "intermediate_size": 1536,
16
+ "is_llama_config": true,
17
+ "max_position_embeddings": 8192,
18
+ "mlp_bias": false,
19
+ "model_type": "llama_lowdim",
20
+ "num_attention_heads": 9,
21
+ "num_hidden_layers": 30,
22
+ "num_key_value_heads": 3,
23
+ "obs_dim": 9,
24
+ "pad_token_id": 2,
25
+ "pretraining_tp": 1,
26
+ "rms_norm_eps": 1e-05,
27
+ "rope_interleaved": false,
28
+ "rope_scaling": null,
29
+ "rope_theta": 100000,
30
+ "tie_word_embeddings": true,
31
+ "torch_dtype": "float32",
32
+ "transformers.js_config": {
33
+ "kv_cache_dtype": {
34
+ "fp16": "float16",
35
+ "q4f16": "float16"
36
+ }
37
+ },
38
+ "transformers_version": "4.47.1",
39
+ "use_cache": false,
40
+ "use_joint_mlp_projector": true,
41
+ "vocab_size": 49152
42
+ }
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/generation_config.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 1,
4
+ "eos_token_id": 2,
5
+ "pad_token_id": 2,
6
+ "transformers_version": "4.47.1"
7
+ }
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/mlp_projector.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0445f182cf177b5230d3e8c1058c5779c22eb98d459b8fe9dac58214271072b0
3
+ size 1363840
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e35e7ada606664ef63b93c0a64d73afd048a50cfee7094256033dbb65d3485b5
3
+ size 539452560
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d4c4759c638f6a44b86f92930571ea55355a21dae3e7381eeb5222ca5a24e9f
3
+ size 1079012922
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e3efd5afaf0c28c80d40a9eb842707cd94a44c7a47a687677b2160e97b49d52d
3
+ size 14244
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:adf749f5c0a6b0dab58262308848ebbfadc0419a6c8689ff553fc635da2b5342
3
+ size 1064
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/special_tokens_map.json ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<|im_start|>",
4
+ "<|im_end|>"
5
+ ],
6
+ "bos_token": {
7
+ "content": "<|im_start|>",
8
+ "lstrip": false,
9
+ "normalized": false,
10
+ "rstrip": false,
11
+ "single_word": false
12
+ },
13
+ "eos_token": {
14
+ "content": "<|im_end|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false
19
+ },
20
+ "pad_token": {
21
+ "content": "<|im_end|>",
22
+ "lstrip": false,
23
+ "normalized": false,
24
+ "rstrip": false,
25
+ "single_word": false
26
+ },
27
+ "unk_token": {
28
+ "content": "<|endoftext|>",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false
33
+ }
34
+ }
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/tokenizer_config.json ADDED
@@ -0,0 +1,155 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_prefix_space": false,
3
+ "added_tokens_decoder": {
4
+ "0": {
5
+ "content": "<|endoftext|>",
6
+ "lstrip": false,
7
+ "normalized": false,
8
+ "rstrip": false,
9
+ "single_word": false,
10
+ "special": true
11
+ },
12
+ "1": {
13
+ "content": "<|im_start|>",
14
+ "lstrip": false,
15
+ "normalized": false,
16
+ "rstrip": false,
17
+ "single_word": false,
18
+ "special": true
19
+ },
20
+ "2": {
21
+ "content": "<|im_end|>",
22
+ "lstrip": false,
23
+ "normalized": false,
24
+ "rstrip": false,
25
+ "single_word": false,
26
+ "special": true
27
+ },
28
+ "3": {
29
+ "content": "<repo_name>",
30
+ "lstrip": false,
31
+ "normalized": false,
32
+ "rstrip": false,
33
+ "single_word": false,
34
+ "special": true
35
+ },
36
+ "4": {
37
+ "content": "<reponame>",
38
+ "lstrip": false,
39
+ "normalized": false,
40
+ "rstrip": false,
41
+ "single_word": false,
42
+ "special": true
43
+ },
44
+ "5": {
45
+ "content": "<file_sep>",
46
+ "lstrip": false,
47
+ "normalized": false,
48
+ "rstrip": false,
49
+ "single_word": false,
50
+ "special": true
51
+ },
52
+ "6": {
53
+ "content": "<filename>",
54
+ "lstrip": false,
55
+ "normalized": false,
56
+ "rstrip": false,
57
+ "single_word": false,
58
+ "special": true
59
+ },
60
+ "7": {
61
+ "content": "<gh_stars>",
62
+ "lstrip": false,
63
+ "normalized": false,
64
+ "rstrip": false,
65
+ "single_word": false,
66
+ "special": true
67
+ },
68
+ "8": {
69
+ "content": "<issue_start>",
70
+ "lstrip": false,
71
+ "normalized": false,
72
+ "rstrip": false,
73
+ "single_word": false,
74
+ "special": true
75
+ },
76
+ "9": {
77
+ "content": "<issue_comment>",
78
+ "lstrip": false,
79
+ "normalized": false,
80
+ "rstrip": false,
81
+ "single_word": false,
82
+ "special": true
83
+ },
84
+ "10": {
85
+ "content": "<issue_closed>",
86
+ "lstrip": false,
87
+ "normalized": false,
88
+ "rstrip": false,
89
+ "single_word": false,
90
+ "special": true
91
+ },
92
+ "11": {
93
+ "content": "<jupyter_start>",
94
+ "lstrip": false,
95
+ "normalized": false,
96
+ "rstrip": false,
97
+ "single_word": false,
98
+ "special": true
99
+ },
100
+ "12": {
101
+ "content": "<jupyter_text>",
102
+ "lstrip": false,
103
+ "normalized": false,
104
+ "rstrip": false,
105
+ "single_word": false,
106
+ "special": true
107
+ },
108
+ "13": {
109
+ "content": "<jupyter_code>",
110
+ "lstrip": false,
111
+ "normalized": false,
112
+ "rstrip": false,
113
+ "single_word": false,
114
+ "special": true
115
+ },
116
+ "14": {
117
+ "content": "<jupyter_output>",
118
+ "lstrip": false,
119
+ "normalized": false,
120
+ "rstrip": false,
121
+ "single_word": false,
122
+ "special": true
123
+ },
124
+ "15": {
125
+ "content": "<jupyter_script>",
126
+ "lstrip": false,
127
+ "normalized": false,
128
+ "rstrip": false,
129
+ "single_word": false,
130
+ "special": true
131
+ },
132
+ "16": {
133
+ "content": "<empty_output>",
134
+ "lstrip": false,
135
+ "normalized": false,
136
+ "rstrip": false,
137
+ "single_word": false,
138
+ "special": true
139
+ }
140
+ },
141
+ "additional_special_tokens": [
142
+ "<|im_start|>",
143
+ "<|im_end|>"
144
+ ],
145
+ "bos_token": "<|im_start|>",
146
+ "chat_template": "{% for message in messages %}{% if loop.first and messages[0]['role'] != 'system' %}{{ '<|im_start|>system\nYou are a helpful AI assistant named SmolLM, trained by Hugging Face<|im_end|>\n' }}{% endif %}{{'<|im_start|>' + message['role'] + '\n' + message['content'] + '<|im_end|>' + '\n'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant\n' }}{% endif %}",
147
+ "clean_up_tokenization_spaces": false,
148
+ "eos_token": "<|im_end|>",
149
+ "extra_special_tokens": {},
150
+ "model_max_length": 8192,
151
+ "pad_token": "<|im_end|>",
152
+ "tokenizer_class": "GPT2Tokenizer",
153
+ "unk_token": "<|endoftext|>",
154
+ "vocab_size": 49152
155
+ }
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/trainer_state.json ADDED
The diff for this file is too large to render. See raw diff
 
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7d086f0d85d4811f50e1b1e02897a31ca34f9fd6b54a7941a52c466723aceac
3
+ size 5944
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/checkpoint-5890/vocab.json ADDED
The diff for this file is too large to render. See raw diff
 
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/config.json ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "HuggingFaceTB/SmolLM2-135M-Instruct",
3
+ "action_dim": 4,
4
+ "architectures": [
5
+ "LowdimLlamaForCausalLM"
6
+ ],
7
+ "attention_bias": false,
8
+ "attention_dropout": 0.0,
9
+ "bos_token_id": 1,
10
+ "eos_token_id": 2,
11
+ "head_dim": 64,
12
+ "hidden_act": "silu",
13
+ "hidden_size": 576,
14
+ "initializer_range": 0.041666666666666664,
15
+ "intermediate_size": 1536,
16
+ "is_llama_config": true,
17
+ "max_position_embeddings": 8192,
18
+ "mlp_bias": false,
19
+ "model_type": "llama_lowdim",
20
+ "num_attention_heads": 9,
21
+ "num_hidden_layers": 30,
22
+ "num_key_value_heads": 3,
23
+ "obs_dim": 9,
24
+ "pad_token_id": 2,
25
+ "pretraining_tp": 1,
26
+ "rms_norm_eps": 1e-05,
27
+ "rope_interleaved": false,
28
+ "rope_scaling": null,
29
+ "rope_theta": 100000,
30
+ "tie_word_embeddings": true,
31
+ "torch_dtype": "float32",
32
+ "transformers.js_config": {
33
+ "kv_cache_dtype": {
34
+ "fp16": "float16",
35
+ "q4f16": "float16"
36
+ }
37
+ },
38
+ "transformers_version": "4.47.1",
39
+ "use_cache": true,
40
+ "use_joint_mlp_projector": true,
41
+ "vocab_size": 49152
42
+ }
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/generation_config.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 1,
4
+ "eos_token_id": 2,
5
+ "pad_token_id": 2,
6
+ "transformers_version": "4.47.1"
7
+ }
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e35e7ada606664ef63b93c0a64d73afd048a50cfee7094256033dbb65d3485b5
3
+ size 539452560
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/normalizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7863dd8b1cec54ea35c3840df161a34ee700911175e25f412f15c526ba1f4db9
3
+ size 940
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/train.log ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [2026-03-25 21:49:57,640][numexpr.utils][INFO] - Note: NumExpr detected 24 cores but "NUMEXPR_MAX_THREADS" not set, so enforcing safe limit of 16.
2
+ [2026-03-25 21:49:57,640][numexpr.utils][INFO] - NumExpr defaulting to 16 threads.
3
+ [2026-03-25 21:50:00,145][datasets][INFO] - PyTorch version 2.2.2 available.
4
+ [2026-03-25 21:50:00,146][datasets][INFO] - TensorFlow version 2.15.1 available.
5
+ [2026-03-25 21:50:00,146][datasets][INFO] - JAX version 0.4.30 available.
6
+ [2026-03-25 21:50:09,209][datasets.arrow_dataset][WARNING] - Setting TOKENIZERS_PARALLELISM=false for forked processes.
7
+ [2026-03-25 21:50:20,967][datasets.arrow_dataset][WARNING] - Setting TOKENIZERS_PARALLELISM=false for forked processes.
8
+ [2026-03-25 21:50:26,146][root][INFO] - gcc -pthread -B /home/chyang/miniconda3/envs/llm-bc/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -O2 -Wall -fPIC -O2 -isystem /home/chyang/miniconda3/envs/llm-bc/include -I/home/chyang/miniconda3/envs/llm-bc/include -fPIC -O2 -isystem /home/chyang/miniconda3/envs/llm-bc/include -fPIC -c /tmp/tmpi9u81lm4/test.c -o /tmp/tmpi9u81lm4/test.o
9
+ [2026-03-25 21:50:26,283][root][INFO] - gcc -pthread -B /home/chyang/miniconda3/envs/llm-bc/compiler_compat /tmp/tmpi9u81lm4/test.o -laio -o /tmp/tmpi9u81lm4/a.out
10
+ [2026-03-25 21:50:27,344][root][INFO] - gcc -pthread -B /home/chyang/miniconda3/envs/llm-bc/compiler_compat -Wno-unused-result -Wsign-compare -DNDEBUG -O2 -Wall -fPIC -O2 -isystem /home/chyang/miniconda3/envs/llm-bc/include -I/home/chyang/miniconda3/envs/llm-bc/include -fPIC -O2 -isystem /home/chyang/miniconda3/envs/llm-bc/include -fPIC -c /tmp/tmpbw4d1oth/test.c -o /tmp/tmpbw4d1oth/test.o
11
+ [2026-03-25 21:50:27,408][root][INFO] - gcc -pthread -B /home/chyang/miniconda3/envs/llm-bc/compiler_compat /tmp/tmpbw4d1oth/test.o -L/usr/local/cuda -L/usr/local/cuda/lib64 -lcufile -o /tmp/tmpbw4d1oth/a.out
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/debug-internal.log ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {"time":"2026-03-25T21:50:01.245406678+08:00","level":"INFO","msg":"using version","core version":"0.18.6"}
2
+ {"time":"2026-03-25T21:50:01.245434467+08:00","level":"INFO","msg":"created symlink","path":"/tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/logs/debug-core.log"}
3
+ {"time":"2026-03-25T21:50:01.351032453+08:00","level":"INFO","msg":"created new stream","id":"2h81cyev"}
4
+ {"time":"2026-03-25T21:50:01.35106276+08:00","level":"INFO","msg":"stream: started","id":"2h81cyev"}
5
+ {"time":"2026-03-25T21:50:01.351389803+08:00","level":"INFO","msg":"sender: started","stream_id":"2h81cyev"}
6
+ {"time":"2026-03-25T21:50:01.351542999+08:00","level":"INFO","msg":"writer: Do: started","stream_id":{"value":"2h81cyev"}}
7
+ {"time":"2026-03-25T21:50:01.351277431+08:00","level":"INFO","msg":"handler: started","stream_id":{"value":"2h81cyev"}}
8
+ {"time":"2026-03-25T21:50:02.650018849+08:00","level":"INFO","msg":"Starting system monitor"}
9
+ {"time":"2026-03-25T23:12:45.893092948+08:00","level":"INFO","msg":"Stopping system monitor"}
10
+ {"time":"2026-03-25T23:12:45.893957489+08:00","level":"INFO","msg":"Stopped system monitor"}
11
+ {"time":"2026-03-25T23:12:46.893748698+08:00","level":"INFO","msg":"handler: operation stats","stats":{"operations":[{"desc":"updating run config","runtime_seconds":0.53580153},{"desc":"uploading wandb-summary.json","runtime_seconds":0.198386062,"progress":"499B/499B"}],"total_operations":2}}
12
+ {"time":"2026-03-25T23:12:52.287923232+08:00","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
13
+ {"time":"2026-03-25T23:13:08.222278652+08:00","level":"INFO","msg":"stream: closing","id":"2h81cyev"}
14
+ {"time":"2026-03-25T23:13:08.222329103+08:00","level":"INFO","msg":"handler: closed","stream_id":{"value":"2h81cyev"}}
15
+ {"time":"2026-03-25T23:13:08.222363112+08:00","level":"INFO","msg":"writer: Close: closed","stream_id":{"value":"2h81cyev"}}
16
+ {"time":"2026-03-25T23:13:08.222465337+08:00","level":"INFO","msg":"sender: closed","stream_id":"2h81cyev"}
17
+ {"time":"2026-03-25T23:13:08.222482121+08:00","level":"INFO","msg":"stream: closed","id":"2h81cyev"}
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/debug.log ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Current SDK version is 0.18.6
2
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Configure stats pid to 3457000
3
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Loading settings from /home/chyang/.config/wandb/settings
4
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Loading settings from /tmp2/chyang/workspace/LLM-BC/wandb/settings
5
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Loading settings from environment variables: {}
6
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Applying setup settings: {'mode': 'online', '_disable_service': None}
7
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Inferring run settings from compute environment: {'program_relpath': 'train.py', 'program_abspath': '/tmp2/chyang/workspace/LLM-BC/train.py', 'program': '/tmp2/chyang/workspace/LLM-BC/./train.py'}
8
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Applying login settings: {}
9
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_init.py:_log_setup():533] Logging user logs to /tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/logs/debug.log
10
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_init.py:_log_setup():534] Logging internal logs to /tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/logs/debug-internal.log
11
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_init.py:init():619] calling init triggers
12
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_init.py:init():626] wandb.init called with sweep_config: {}
13
+ config: {'name': 'train_llm_lowdim', '_target_': 'llmbc.workspace.train_llm_workspace.TrainLLMWorkspace', 'obs_dim': 9, 'action_dim': 4, 'horizon': 1, 'n_obs_steps': 1, 'n_action_steps': 1, 'task_name': 'box-close-v2', 'exp_name': 'train llm', 'model_name': 'HuggingFaceTB/SmolLM2-135M-Instruct', 'use_quantization': False, 'lora_config': {'r': 32, 'lora_alpha': 64, 'lora_dropout': 0.05, 'bias': 'none', 'task_type': 'CAUSAL_LM'}, 'dataset': {'test_data_ratio': 0.01}, 'debug': False, 'training': {'seed': 42, 'per_device_train_batch_size': 128, 'per_device_eval_batch_size': 128, 'gradient_accumulation_steps': 1, 'optim': 'paged_adamw_32bit', 'num_train_epochs': 10, 'eval_strategy': 'steps', 'logging_steps': 1, 'warmup_steps': 10, 'logging_strategy': 'steps', 'learning_rate': 5e-05, 'fp16': False, 'bf16': True, 'tf32': True, 'group_by_length': True, 'report_to': 'wandb', 'save_steps': 5000, 'eval_steps': 10, 'use_joint_mlp_projector': True, 'joint_obs_action_mlp_lr': 5e-05}, 'trainer': {'obs_dim': 9, 'action_dim': 4, 'use_joint_mlp_projector': True, 'max_seq_length': 100, 'dataset_text_field': 'text', 'packing': False}, 'logging': {'project': 'llm_module_finetuning', 'resume': True, 'mode': 'online', 'name': '2026.03.25-21.49.56_train_llm_lowdim_box-close-v2', 'tags': ['train_llm_lowdim', 'box-close-v2', 'train llm'], 'id': None, 'group': None}, 'multi_run': {'run_dir': 'data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2', 'wandb_name_base': '2026.03.25-21.49.56_train_llm_lowdim_box-close-v2'}, 'task': {'name': 'box-close-v2', 'obs_dim': 9, 'action_dim': 4, 'env_runner': {'_target_': 'llmbc.env_runner.metaworld_lowdim_runner.MetaworldLowdimRunner', 'env_name': 'llf-metaworld-box-close-v2', 'n_train': 10, 'n_test': 50, 'n_envs': 10, 'max_steps': 30, 'n_obs_steps': 1, 'n_action_steps': 1, 'instruction_type': 'b', 'feedback_type': ['hp', 'hn', 'fp'], 'visual': False, 'discount': 0.9}, 'dataset': {'_target_': 'llmbc.dataset.metaworld_lowdim_dataset.MetaworldLowdimDataset', 'data_path': 'datasets/box-close-v2-general-pref001.pt', 'data_path2': 'datasets/box-close-v2-pref001.pt', 'horizon': 1, 'pad_before': 0, 'pad_after': 0, 'obs_eef_target': True, 'use_manual_normalizer': False, 'val_ratio': 0.05, 'dummy_normalizer': True}, 'instructor': {'_target_': 'llmbc.translator.instructor.metaworld_instructor.box_close_v2_instructor.BoxCloseV2Instructor'}}, 'llm': {'name': 'HuggingFaceTB/SmolLM2-135M-Instruct', 'model_name': 'SmolLM2-135M-Instruct', 'config_target': 'llmbc.model.llm.llama_lowdim_model.LowdimLlamaConfig', 'causal_lm_target': 'llmbc.model.llm.llama_lowdim_model.LowdimLlamaForCausalLM', 'use_quantization': False, 'use_joint_mlp_projector': True, 'llm_mode': 'mlp-finetuned', 'finetune_mode': 'orig', 'checkpoint': 'data/outputs/2026.03.25/00.25.57_train_mlp_projector_box-close-v2/checkpoints/latest.ckpt', 'max_length': 100, 'lora_config': {'r': 32, 'lora_alpha': 64, 'lora_dropout': 0.05, 'bias': 'none', 'task_type': 'CAUSAL_LM'}, 'prompter': {'_target_': 'llmbc.translator.prompter.smollm2_prompter.SmolLM2Prompter', 'use_joint_mlp_projector': True}, 'hydra': {'job': {'override_dirname': 'HuggingFaceTB/SmolLM2-135M-Instruct'}, 'run': {'dir': 'data/outputs/2026.03.25/21.49.56_HuggingFaceTB/SmolLM2-135M-Instruct'}}}}
14
+ 2026-03-25 21:50:01,227 INFO MainThread:3457000 [wandb_init.py:init():669] starting backend
15
+ 2026-03-25 21:50:01,227 INFO MainThread:3457000 [wandb_init.py:init():673] sending inform_init request
16
+ 2026-03-25 21:50:01,228 INFO MainThread:3457000 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
17
+ 2026-03-25 21:50:01,228 INFO MainThread:3457000 [wandb_init.py:init():686] backend started and connected
18
+ 2026-03-25 21:50:01,233 INFO MainThread:3457000 [wandb_init.py:init():781] updated telemetry
19
+ 2026-03-25 21:50:01,265 INFO MainThread:3457000 [wandb_init.py:init():814] communicating run to backend with 90.0 second timeout
20
+ 2026-03-25 21:50:02,646 INFO MainThread:3457000 [wandb_init.py:init():867] starting run threads in backend
21
+ 2026-03-25 21:50:02,757 INFO MainThread:3457000 [wandb_run.py:_console_start():2451] atexit reg
22
+ 2026-03-25 21:50:02,757 INFO MainThread:3457000 [wandb_run.py:_redirect():2299] redirect: wrap_raw
23
+ 2026-03-25 21:50:02,758 INFO MainThread:3457000 [wandb_run.py:_redirect():2364] Wrapping output streams.
24
+ 2026-03-25 21:50:02,758 INFO MainThread:3457000 [wandb_run.py:_redirect():2389] Redirects installed.
25
+ 2026-03-25 21:50:02,761 INFO MainThread:3457000 [wandb_init.py:init():911] run started, returning control to user process
26
+ 2026-03-25 21:50:36,180 INFO MainThread:3457000 [wandb_run.py:_config_callback():1389] config_cb None None {'obs_dim': 9, 'action_dim': 4, 'use_joint_mlp_projector': True, 'vocab_size': 49152, 'max_position_embeddings': 8192, 'hidden_size': 576, 'intermediate_size': 1536, 'num_hidden_layers': 30, 'num_attention_heads': 9, 'num_key_value_heads': 3, 'hidden_act': 'silu', 'initializer_range': 0.041666666666666664, 'rms_norm_eps': 1e-05, 'pretraining_tp': 1, 'use_cache': False, 'rope_theta': 100000, 'rope_scaling': None, 'attention_bias': False, 'attention_dropout': 0.0, 'mlp_bias': False, 'head_dim': 64, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'bfloat16', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['LlamaForCausalLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 1, 'pad_token_id': 2, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'HuggingFaceTB/SmolLM2-135M-Instruct', '_attn_implementation_autoset': True, 'transformers_version': '4.47.1', 'is_llama_config': True, 'model_type': 'llama_lowdim', 'rope_interleaved': False, 'transformers.js_config': {'kv_cache_dtype': {'q4f16': 'float16', 'fp16': 'float16'}}, 'output_dir': '/tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'steps', 'prediction_loss_only': False, 'per_device_train_batch_size': 128, 'per_device_eval_batch_size': 128, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 5e-05, 'weight_decay': 0.0, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 10, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 10, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/runs/Mar25_21-50-25_A6000', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 1, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 5000, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': True, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': True, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 10, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': '/tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'paged_adamw_32bit', 'optim_args': None, 'adafactor': False, 'group_by_length': True, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False, 'dataset_text_field': 'text', 'packing': False, 'max_seq_length': 100, 'dataset_num_proc': None, 'dataset_batch_size': 1000, 'model_init_kwargs': None, 'dataset_kwargs': {}, 'eval_packing': None, 'num_of_sequences': 1024, 'chars_per_token': '<CHARS_PER_TOKEN>', 'use_liger': False, 'joint_obs_action_mlp_lr': 5e-05, 'obs_mlp_lr': None, 'action_mlp_lr': None}
27
+ 2026-03-25 21:50:36,182 INFO MainThread:3457000 [wandb_config.py:__setitem__():154] config set model/num_parameters = 134855424 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x7f56b49b1940>>
28
+ 2026-03-25 21:50:36,182 INFO MainThread:3457000 [wandb_run.py:_config_callback():1389] config_cb model/num_parameters 134855424 None
29
+ 2026-03-25 23:12:45,892 INFO MainThread:3457000 [wandb_run.py:_finish():2146] finishing run chyang25-national-taiwan-university/llm_module_finetuning/2h81cyev
30
+ 2026-03-25 23:12:45,892 INFO MainThread:3457000 [wandb_run.py:_atexit_cleanup():2414] got exitcode: 0
31
+ 2026-03-25 23:12:45,892 INFO MainThread:3457000 [wandb_run.py:_restore():2396] restore
32
+ 2026-03-25 23:12:45,892 INFO MainThread:3457000 [wandb_run.py:_restore():2402] restore done
33
+ 2026-03-25 23:13:08,216 INFO MainThread:3457000 [wandb_run.py:_footer_history_summary_info():3963] rendering history
34
+ 2026-03-25 23:13:08,218 INFO MainThread:3457000 [wandb_run.py:_footer_history_summary_info():3995] rendering summary
35
+ 2026-03-25 23:13:08,221 INFO MainThread:3457000 [wandb_run.py:_footer_sync_info():3922] logging synced files
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/files/config.yaml ADDED
@@ -0,0 +1,713 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ _attn_implementation_autoset:
2
+ value: true
3
+ _name_or_path:
4
+ value: HuggingFaceTB/SmolLM2-135M-Instruct
5
+ _target_:
6
+ value: llmbc.workspace.train_llm_workspace.TrainLLMWorkspace
7
+ _wandb:
8
+ value:
9
+ cli_version: 0.18.6
10
+ m:
11
+ - "1": train/learning_rate
12
+ "5": 2
13
+ "6":
14
+ - 1
15
+ - 3
16
+ "7": []
17
+ - "1": train/global_step
18
+ "6":
19
+ - 3
20
+ "7": []
21
+ - "1": train/epoch
22
+ "5": 2
23
+ "6":
24
+ - 1
25
+ - 3
26
+ "7": []
27
+ - "1": eval/steps_per_second
28
+ "5": 2
29
+ "6":
30
+ - 1
31
+ - 3
32
+ "7": []
33
+ - "1": eval/loss
34
+ "5": 2
35
+ "6":
36
+ - 1
37
+ - 3
38
+ "7": []
39
+ - "1": eval/runtime
40
+ "5": 2
41
+ "6":
42
+ - 1
43
+ - 3
44
+ "7": []
45
+ - "1": train/loss
46
+ "5": 2
47
+ "6":
48
+ - 1
49
+ - 3
50
+ "7": []
51
+ - "1": train/grad_norm
52
+ "5": 2
53
+ "6":
54
+ - 1
55
+ - 3
56
+ "7": []
57
+ - "1": eval/samples_per_second
58
+ "5": 2
59
+ "6":
60
+ - 1
61
+ - 3
62
+ "7": []
63
+ python_version: 3.9.25
64
+ t:
65
+ "1":
66
+ - 1
67
+ - 2
68
+ - 3
69
+ - 5
70
+ - 11
71
+ - 12
72
+ - 41
73
+ - 49
74
+ - 50
75
+ - 51
76
+ - 53
77
+ - 55
78
+ - 71
79
+ - 84
80
+ - 98
81
+ - 105
82
+ "2":
83
+ - 1
84
+ - 2
85
+ - 3
86
+ - 5
87
+ - 11
88
+ - 12
89
+ - 41
90
+ - 49
91
+ - 50
92
+ - 51
93
+ - 53
94
+ - 55
95
+ - 71
96
+ - 84
97
+ - 98
98
+ - 105
99
+ "3":
100
+ - 2
101
+ - 7
102
+ - 13
103
+ - 15
104
+ - 16
105
+ - 19
106
+ - 23
107
+ - 55
108
+ - 62
109
+ - 66
110
+ "4": 3.9.25
111
+ "5": 0.18.6
112
+ "6": 4.47.1
113
+ "8":
114
+ - 5
115
+ "9":
116
+ "1": transformers_trainer
117
+ "12": 0.18.6
118
+ "13": linux-x86_64
119
+ accelerator_config:
120
+ value:
121
+ dispatch_batches: null
122
+ even_batches: true
123
+ gradient_accumulation_kwargs: null
124
+ non_blocking: false
125
+ split_batches: false
126
+ use_seedable_sampler: true
127
+ action_dim:
128
+ value: 4
129
+ action_mlp_lr:
130
+ value: null
131
+ adafactor:
132
+ value: false
133
+ adam_beta1:
134
+ value: 0.9
135
+ adam_beta2:
136
+ value: 0.999
137
+ adam_epsilon:
138
+ value: 1e-08
139
+ add_cross_attention:
140
+ value: false
141
+ architectures:
142
+ value:
143
+ - LlamaForCausalLM
144
+ attention_bias:
145
+ value: false
146
+ attention_dropout:
147
+ value: 0
148
+ auto_find_batch_size:
149
+ value: false
150
+ average_tokens_across_devices:
151
+ value: false
152
+ bad_words_ids:
153
+ value: null
154
+ batch_eval_metrics:
155
+ value: false
156
+ begin_suppress_tokens:
157
+ value: null
158
+ bf16:
159
+ value: true
160
+ bf16_full_eval:
161
+ value: false
162
+ bos_token_id:
163
+ value: 1
164
+ chars_per_token:
165
+ value: <CHARS_PER_TOKEN>
166
+ chunk_size_feed_forward:
167
+ value: 0
168
+ cross_attention_hidden_size:
169
+ value: null
170
+ data_seed:
171
+ value: null
172
+ dataloader_drop_last:
173
+ value: false
174
+ dataloader_num_workers:
175
+ value: 0
176
+ dataloader_persistent_workers:
177
+ value: false
178
+ dataloader_pin_memory:
179
+ value: true
180
+ dataloader_prefetch_factor:
181
+ value: null
182
+ dataset:
183
+ value:
184
+ test_data_ratio: 0.01
185
+ dataset_batch_size:
186
+ value: 1000
187
+ dataset_num_proc:
188
+ value: null
189
+ dataset_text_field:
190
+ value: text
191
+ ddp_backend:
192
+ value: null
193
+ ddp_broadcast_buffers:
194
+ value: null
195
+ ddp_bucket_cap_mb:
196
+ value: null
197
+ ddp_find_unused_parameters:
198
+ value: null
199
+ ddp_timeout:
200
+ value: 1800
201
+ debug:
202
+ value: []
203
+ decoder_start_token_id:
204
+ value: null
205
+ deepspeed:
206
+ value: null
207
+ disable_tqdm:
208
+ value: false
209
+ dispatch_batches:
210
+ value: null
211
+ diversity_penalty:
212
+ value: 0
213
+ do_eval:
214
+ value: true
215
+ do_predict:
216
+ value: false
217
+ do_sample:
218
+ value: false
219
+ do_train:
220
+ value: false
221
+ early_stopping:
222
+ value: false
223
+ encoder_no_repeat_ngram_size:
224
+ value: 0
225
+ eos_token_id:
226
+ value: 2
227
+ eval_accumulation_steps:
228
+ value: null
229
+ eval_delay:
230
+ value: 0
231
+ eval_do_concat_batches:
232
+ value: true
233
+ eval_on_start:
234
+ value: false
235
+ eval_packing:
236
+ value: null
237
+ eval_steps:
238
+ value: 10
239
+ eval_strategy:
240
+ value: steps
241
+ eval_use_gather_object:
242
+ value: false
243
+ evaluation_strategy:
244
+ value: null
245
+ exp_name:
246
+ value: train llm
247
+ exponential_decay_length_penalty:
248
+ value: null
249
+ finetuning_task:
250
+ value: null
251
+ forced_bos_token_id:
252
+ value: null
253
+ forced_eos_token_id:
254
+ value: null
255
+ fp16:
256
+ value: false
257
+ fp16_backend:
258
+ value: auto
259
+ fp16_full_eval:
260
+ value: false
261
+ fp16_opt_level:
262
+ value: O1
263
+ fsdp:
264
+ value: []
265
+ fsdp_config:
266
+ value:
267
+ min_num_params: 0
268
+ xla: false
269
+ xla_fsdp_grad_ckpt: false
270
+ xla_fsdp_v2: false
271
+ fsdp_min_num_params:
272
+ value: 0
273
+ fsdp_transformer_layer_cls_to_wrap:
274
+ value: null
275
+ full_determinism:
276
+ value: false
277
+ gradient_accumulation_steps:
278
+ value: 1
279
+ gradient_checkpointing:
280
+ value: false
281
+ gradient_checkpointing_kwargs:
282
+ value: null
283
+ greater_is_better:
284
+ value: null
285
+ group_by_length:
286
+ value: true
287
+ half_precision_backend:
288
+ value: auto
289
+ head_dim:
290
+ value: 64
291
+ hidden_act:
292
+ value: silu
293
+ hidden_size:
294
+ value: 576
295
+ horizon:
296
+ value: 1
297
+ hub_always_push:
298
+ value: false
299
+ hub_model_id:
300
+ value: null
301
+ hub_private_repo:
302
+ value: null
303
+ hub_strategy:
304
+ value: every_save
305
+ hub_token:
306
+ value: <HUB_TOKEN>
307
+ id2label:
308
+ value:
309
+ "0": LABEL_0
310
+ "1": LABEL_1
311
+ ignore_data_skip:
312
+ value: false
313
+ include_for_metrics:
314
+ value: []
315
+ include_inputs_for_metrics:
316
+ value: false
317
+ include_num_input_tokens_seen:
318
+ value: false
319
+ include_tokens_per_second:
320
+ value: false
321
+ initializer_range:
322
+ value: 0.041666666666666664
323
+ intermediate_size:
324
+ value: 1536
325
+ is_decoder:
326
+ value: false
327
+ is_encoder_decoder:
328
+ value: false
329
+ is_llama_config:
330
+ value: true
331
+ jit_mode_eval:
332
+ value: false
333
+ joint_obs_action_mlp_lr:
334
+ value: 5e-05
335
+ label_names:
336
+ value: null
337
+ label_smoothing_factor:
338
+ value: 0
339
+ label2id:
340
+ value:
341
+ LABEL_0: 0
342
+ LABEL_1: 1
343
+ learning_rate:
344
+ value: 5e-05
345
+ length_column_name:
346
+ value: length
347
+ length_penalty:
348
+ value: 1
349
+ llm:
350
+ value:
351
+ causal_lm_target: llmbc.model.llm.llama_lowdim_model.LowdimLlamaForCausalLM
352
+ checkpoint: data/outputs/2026.03.25/00.25.57_train_mlp_projector_box-close-v2/checkpoints/latest.ckpt
353
+ config_target: llmbc.model.llm.llama_lowdim_model.LowdimLlamaConfig
354
+ finetune_mode: orig
355
+ hydra:
356
+ job:
357
+ override_dirname: HuggingFaceTB/SmolLM2-135M-Instruct
358
+ run:
359
+ dir: data/outputs/2026.03.25/21.49.56_HuggingFaceTB/SmolLM2-135M-Instruct
360
+ llm_mode: mlp-finetuned
361
+ lora_config:
362
+ bias: none
363
+ lora_alpha: 64
364
+ lora_dropout: 0.05
365
+ r: 32
366
+ task_type: CAUSAL_LM
367
+ max_length: 100
368
+ model_name: SmolLM2-135M-Instruct
369
+ name: HuggingFaceTB/SmolLM2-135M-Instruct
370
+ prompter:
371
+ _target_: llmbc.translator.prompter.smollm2_prompter.SmolLM2Prompter
372
+ use_joint_mlp_projector: true
373
+ use_joint_mlp_projector: true
374
+ use_quantization: false
375
+ load_best_model_at_end:
376
+ value: false
377
+ local_rank:
378
+ value: 0
379
+ log_level:
380
+ value: passive
381
+ log_level_replica:
382
+ value: warning
383
+ log_on_each_node:
384
+ value: true
385
+ logging:
386
+ value:
387
+ group: null
388
+ id: null
389
+ mode: online
390
+ name: 2026.03.25-21.49.56_train_llm_lowdim_box-close-v2
391
+ project: llm_module_finetuning
392
+ resume: true
393
+ tags:
394
+ - train_llm_lowdim
395
+ - box-close-v2
396
+ - train llm
397
+ logging_dir:
398
+ value: /tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/runs/Mar25_21-50-25_A6000
399
+ logging_first_step:
400
+ value: false
401
+ logging_nan_inf_filter:
402
+ value: true
403
+ logging_steps:
404
+ value: 1
405
+ logging_strategy:
406
+ value: steps
407
+ lora_config:
408
+ value:
409
+ bias: none
410
+ lora_alpha: 64
411
+ lora_dropout: 0.05
412
+ r: 32
413
+ task_type: CAUSAL_LM
414
+ lr_scheduler_type:
415
+ value: linear
416
+ max_grad_norm:
417
+ value: 1
418
+ max_length:
419
+ value: 20
420
+ max_position_embeddings:
421
+ value: 8192
422
+ max_seq_length:
423
+ value: 100
424
+ max_steps:
425
+ value: -1
426
+ metric_for_best_model:
427
+ value: null
428
+ min_length:
429
+ value: 0
430
+ mlp_bias:
431
+ value: false
432
+ model/num_parameters:
433
+ value: 134855424
434
+ model_init_kwargs:
435
+ value: null
436
+ model_name:
437
+ value: HuggingFaceTB/SmolLM2-135M-Instruct
438
+ model_type:
439
+ value: llama_lowdim
440
+ mp_parameters:
441
+ value: ""
442
+ multi_run:
443
+ value:
444
+ run_dir: data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2
445
+ wandb_name_base: 2026.03.25-21.49.56_train_llm_lowdim_box-close-v2
446
+ n_action_steps:
447
+ value: 1
448
+ n_obs_steps:
449
+ value: 1
450
+ name:
451
+ value: train_llm_lowdim
452
+ neftune_noise_alpha:
453
+ value: null
454
+ no_cuda:
455
+ value: false
456
+ no_repeat_ngram_size:
457
+ value: 0
458
+ num_attention_heads:
459
+ value: 9
460
+ num_beam_groups:
461
+ value: 1
462
+ num_beams:
463
+ value: 1
464
+ num_hidden_layers:
465
+ value: 30
466
+ num_key_value_heads:
467
+ value: 3
468
+ num_of_sequences:
469
+ value: 1024
470
+ num_return_sequences:
471
+ value: 1
472
+ num_train_epochs:
473
+ value: 10
474
+ obs_dim:
475
+ value: 9
476
+ obs_mlp_lr:
477
+ value: null
478
+ optim:
479
+ value: paged_adamw_32bit
480
+ optim_args:
481
+ value: null
482
+ optim_target_modules:
483
+ value: null
484
+ output_attentions:
485
+ value: false
486
+ output_dir:
487
+ value: /tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2
488
+ output_hidden_states:
489
+ value: false
490
+ output_scores:
491
+ value: false
492
+ overwrite_output_dir:
493
+ value: false
494
+ packing:
495
+ value: false
496
+ pad_token_id:
497
+ value: 2
498
+ past_index:
499
+ value: -1
500
+ per_device_eval_batch_size:
501
+ value: 128
502
+ per_device_train_batch_size:
503
+ value: 128
504
+ per_gpu_eval_batch_size:
505
+ value: null
506
+ per_gpu_train_batch_size:
507
+ value: null
508
+ prediction_loss_only:
509
+ value: false
510
+ prefix:
511
+ value: null
512
+ pretraining_tp:
513
+ value: 1
514
+ problem_type:
515
+ value: null
516
+ push_to_hub:
517
+ value: false
518
+ push_to_hub_model_id:
519
+ value: null
520
+ push_to_hub_organization:
521
+ value: null
522
+ push_to_hub_token:
523
+ value: <PUSH_TO_HUB_TOKEN>
524
+ ray_scope:
525
+ value: last
526
+ remove_invalid_values:
527
+ value: false
528
+ remove_unused_columns:
529
+ value: true
530
+ repetition_penalty:
531
+ value: 1
532
+ report_to:
533
+ value:
534
+ - wandb
535
+ restore_callback_states_from_checkpoint:
536
+ value: false
537
+ resume_from_checkpoint:
538
+ value: null
539
+ return_dict:
540
+ value: true
541
+ return_dict_in_generate:
542
+ value: false
543
+ rms_norm_eps:
544
+ value: 1e-05
545
+ rope_interleaved:
546
+ value: false
547
+ rope_scaling:
548
+ value: null
549
+ rope_theta:
550
+ value: 100000
551
+ run_name:
552
+ value: /tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2
553
+ save_on_each_node:
554
+ value: false
555
+ save_only_model:
556
+ value: false
557
+ save_safetensors:
558
+ value: true
559
+ save_steps:
560
+ value: 5000
561
+ save_strategy:
562
+ value: steps
563
+ save_total_limit:
564
+ value: null
565
+ seed:
566
+ value: 42
567
+ sep_token_id:
568
+ value: null
569
+ skip_memory_metrics:
570
+ value: true
571
+ split_batches:
572
+ value: null
573
+ suppress_tokens:
574
+ value: null
575
+ task:
576
+ value:
577
+ action_dim: 4
578
+ dataset:
579
+ _target_: llmbc.dataset.metaworld_lowdim_dataset.MetaworldLowdimDataset
580
+ data_path: datasets/box-close-v2-general-pref001.pt
581
+ data_path2: datasets/box-close-v2-pref001.pt
582
+ dummy_normalizer: true
583
+ horizon: 1
584
+ obs_eef_target: true
585
+ pad_after: 0
586
+ pad_before: 0
587
+ use_manual_normalizer: false
588
+ val_ratio: 0.05
589
+ env_runner:
590
+ _target_: llmbc.env_runner.metaworld_lowdim_runner.MetaworldLowdimRunner
591
+ discount: 0.9
592
+ env_name: llf-metaworld-box-close-v2
593
+ feedback_type:
594
+ - hp
595
+ - hn
596
+ - fp
597
+ instruction_type: b
598
+ max_steps: 30
599
+ n_action_steps: 1
600
+ n_envs: 10
601
+ n_obs_steps: 1
602
+ n_test: 50
603
+ n_train: 10
604
+ visual: false
605
+ instructor:
606
+ _target_: llmbc.translator.instructor.metaworld_instructor.box_close_v2_instructor.BoxCloseV2Instructor
607
+ name: box-close-v2
608
+ obs_dim: 9
609
+ task_name:
610
+ value: box-close-v2
611
+ task_specific_params:
612
+ value: null
613
+ temperature:
614
+ value: 1
615
+ tf_legacy_loss:
616
+ value: false
617
+ tf32:
618
+ value: true
619
+ tie_encoder_decoder:
620
+ value: false
621
+ tie_word_embeddings:
622
+ value: true
623
+ tokenizer_class:
624
+ value: null
625
+ top_k:
626
+ value: 50
627
+ top_p:
628
+ value: 1
629
+ torch_compile:
630
+ value: false
631
+ torch_compile_backend:
632
+ value: null
633
+ torch_compile_mode:
634
+ value: null
635
+ torch_dtype:
636
+ value: bfloat16
637
+ torch_empty_cache_steps:
638
+ value: null
639
+ torchdynamo:
640
+ value: null
641
+ torchscript:
642
+ value: false
643
+ tpu_metrics_debug:
644
+ value: false
645
+ tpu_num_cores:
646
+ value: null
647
+ trainer:
648
+ value:
649
+ action_dim: 4
650
+ dataset_text_field: text
651
+ max_seq_length: 100
652
+ obs_dim: 9
653
+ packing: false
654
+ use_joint_mlp_projector: true
655
+ training:
656
+ value:
657
+ bf16: true
658
+ eval_steps: 10
659
+ eval_strategy: steps
660
+ fp16: false
661
+ gradient_accumulation_steps: 1
662
+ group_by_length: true
663
+ joint_obs_action_mlp_lr: 5e-05
664
+ learning_rate: 5e-05
665
+ logging_steps: 1
666
+ logging_strategy: steps
667
+ num_train_epochs: 10
668
+ optim: paged_adamw_32bit
669
+ per_device_eval_batch_size: 128
670
+ per_device_train_batch_size: 128
671
+ report_to: wandb
672
+ save_steps: 5000
673
+ seed: 42
674
+ tf32: true
675
+ use_joint_mlp_projector: true
676
+ warmup_steps: 10
677
+ transformers.js_config:
678
+ value:
679
+ kv_cache_dtype:
680
+ fp16: float16
681
+ q4f16: float16
682
+ transformers_version:
683
+ value: 4.47.1
684
+ typical_p:
685
+ value: 1
686
+ use_bfloat16:
687
+ value: false
688
+ use_cache:
689
+ value: false
690
+ use_cpu:
691
+ value: false
692
+ use_ipex:
693
+ value: false
694
+ use_joint_mlp_projector:
695
+ value: true
696
+ use_legacy_prediction_loop:
697
+ value: false
698
+ use_liger:
699
+ value: false
700
+ use_liger_kernel:
701
+ value: false
702
+ use_mps_device:
703
+ value: false
704
+ use_quantization:
705
+ value: false
706
+ vocab_size:
707
+ value: 49152
708
+ warmup_ratio:
709
+ value: 0
710
+ warmup_steps:
711
+ value: 10
712
+ weight_decay:
713
+ value: 0
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/files/output.log ADDED
The diff for this file is too large to render. See raw diff
 
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/files/wandb-metadata.json ADDED
@@ -0,0 +1,55 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "os": "Linux-5.15.0-83-generic-x86_64-with-glibc2.31",
3
+ "python": "3.9.25",
4
+ "startedAt": "2026-03-25T13:50:01.228518Z",
5
+ "args": [
6
+ "--config-path",
7
+ "config/lang_compose",
8
+ "--config-name",
9
+ "llmbc_llm_box-close-v2_pref001.yaml"
10
+ ],
11
+ "program": "/tmp2/chyang/workspace/LLM-BC/./train.py",
12
+ "codePath": "train.py",
13
+ "git": {
14
+ "remote": "https://github.com/CHYang25/LLM-BC.git",
15
+ "commit": "01bf8944cfd6fe87f1846cba5b7d22f432a59359"
16
+ },
17
+ "email": "chris920325@gmail.com",
18
+ "root": "/tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2",
19
+ "host": "A6000",
20
+ "username": "chyang",
21
+ "executable": "/home/chyang/miniconda3/envs/llm-bc/bin/python3",
22
+ "codePathLocal": "train.py",
23
+ "cpu_count": 12,
24
+ "cpu_count_logical": 24,
25
+ "gpu": "NVIDIA RTX A6000",
26
+ "gpu_count": 2,
27
+ "disk": {
28
+ "/": {
29
+ "total": "982820896768",
30
+ "used": "888463732736"
31
+ }
32
+ },
33
+ "memory": {
34
+ "total": "134536777728"
35
+ },
36
+ "cpu": {
37
+ "count": 12,
38
+ "countLogical": 24
39
+ },
40
+ "gpu_nvidia": [
41
+ {
42
+ "name": "NVIDIA RTX A6000",
43
+ "memoryTotal": "51527024640",
44
+ "cudaCores": 10752,
45
+ "architecture": "Ampere"
46
+ },
47
+ {
48
+ "name": "NVIDIA RTX A6000",
49
+ "memoryTotal": "51527024640",
50
+ "cudaCores": 10752,
51
+ "architecture": "Ampere"
52
+ }
53
+ ],
54
+ "cudaVersion": "12.2"
55
+ }
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/files/wandb-summary.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"_timestamp":1.7744515658910995e+09,"train_loss":0.6542348089161469,"eval/steps_per_second":4.312,"train/epoch":10,"eval/samples_per_second":546.878,"eval/loss":0.6098324656486511,"_wandb":{"runtime":4964},"train/grad_norm":20.35529899597168,"train_runtime":4929.7238,"train_samples_per_second":152.686,"_runtime":4964.662926878,"eval/runtime":1.3915,"total_flos":5.82219856018944e+16,"_step":6479,"train/learning_rate":0,"train/global_step":5890,"train_steps_per_second":1.195,"train/loss":0.5583}
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/logs/debug-core.log ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {"time":"2026-03-25T21:50:00.457194+08:00","level":"INFO","msg":"started logging, with flags","port-filename":"/tmp/tmpducnlo2q/port-3457000.txt","pid":3457000,"debug":false,"disable-analytics":false}
2
+ {"time":"2026-03-25T21:50:00.457218833+08:00","level":"INFO","msg":"FeatureState","shutdownOnParentExitEnabled":false}
3
+ {"time":"2026-03-25T21:50:00.462244058+08:00","level":"INFO","msg":"server is running","addr":{"IP":"127.0.0.1","Port":36989,"Zone":""}}
4
+ {"time":"2026-03-25T21:50:00.462272874+08:00","level":"INFO","msg":"Will exit if parent process dies.","ppid":3457000}
5
+ {"time":"2026-03-25T21:50:00.654840304+08:00","level":"INFO","msg":"connection: ManageConnectionData: new connection created","id":"127.0.0.1:41682"}
6
+ {"time":"2026-03-25T21:50:01.22918137+08:00","level":"INFO","msg":"handleInformInit: received","streamId":"2h81cyev","id":"127.0.0.1:41682"}
7
+ {"time":"2026-03-25T21:50:01.351067283+08:00","level":"INFO","msg":"handleInformInit: stream started","streamId":"2h81cyev","id":"127.0.0.1:41682"}
8
+ {"time":"2026-03-25T23:13:08.222168721+08:00","level":"INFO","msg":"handleInformFinish: finish message received","streamId":"2h81cyev","id":"127.0.0.1:41682"}
9
+ {"time":"2026-03-25T23:13:08.222492464+08:00","level":"INFO","msg":"handleInformFinish: stream closed","streamId":"2h81cyev","id":"127.0.0.1:41682"}
10
+ {"time":"2026-03-25T23:13:09.511954744+08:00","level":"INFO","msg":"handleInformTeardown: server teardown initiated","id":"127.0.0.1:41682"}
11
+ {"time":"2026-03-25T23:13:09.512026639+08:00","level":"INFO","msg":"handleInformTeardown: server shutdown complete","id":"127.0.0.1:41682"}
12
+ {"time":"2026-03-25T23:13:09.512041907+08:00","level":"INFO","msg":"server is shutting down"}
13
+ {"time":"2026-03-25T23:13:09.512077937+08:00","level":"INFO","msg":"connection: Close: initiating connection closure","id":"127.0.0.1:41682"}
14
+ {"time":"2026-03-25T23:13:09.512328129+08:00","level":"INFO","msg":"connection: Close: connection successfully closed","id":"127.0.0.1:41682"}
15
+ {"time":"2026-03-25T23:13:09.512422298+08:00","level":"INFO","msg":"connection: ManageConnectionData: connection closed","id":"127.0.0.1:41682"}
16
+ {"time":"2026-03-25T23:13:09.51244136+08:00","level":"INFO","msg":"server is closed"}
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/logs/debug-internal.log ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {"time":"2026-03-25T21:50:01.245406678+08:00","level":"INFO","msg":"using version","core version":"0.18.6"}
2
+ {"time":"2026-03-25T21:50:01.245434467+08:00","level":"INFO","msg":"created symlink","path":"/tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/logs/debug-core.log"}
3
+ {"time":"2026-03-25T21:50:01.351032453+08:00","level":"INFO","msg":"created new stream","id":"2h81cyev"}
4
+ {"time":"2026-03-25T21:50:01.35106276+08:00","level":"INFO","msg":"stream: started","id":"2h81cyev"}
5
+ {"time":"2026-03-25T21:50:01.351389803+08:00","level":"INFO","msg":"sender: started","stream_id":"2h81cyev"}
6
+ {"time":"2026-03-25T21:50:01.351542999+08:00","level":"INFO","msg":"writer: Do: started","stream_id":{"value":"2h81cyev"}}
7
+ {"time":"2026-03-25T21:50:01.351277431+08:00","level":"INFO","msg":"handler: started","stream_id":{"value":"2h81cyev"}}
8
+ {"time":"2026-03-25T21:50:02.650018849+08:00","level":"INFO","msg":"Starting system monitor"}
9
+ {"time":"2026-03-25T23:12:45.893092948+08:00","level":"INFO","msg":"Stopping system monitor"}
10
+ {"time":"2026-03-25T23:12:45.893957489+08:00","level":"INFO","msg":"Stopped system monitor"}
11
+ {"time":"2026-03-25T23:12:46.893748698+08:00","level":"INFO","msg":"handler: operation stats","stats":{"operations":[{"desc":"updating run config","runtime_seconds":0.53580153},{"desc":"uploading wandb-summary.json","runtime_seconds":0.198386062,"progress":"499B/499B"}],"total_operations":2}}
12
+ {"time":"2026-03-25T23:12:52.287923232+08:00","level":"INFO","msg":"fileTransfer: Close: file transfer manager closed"}
13
+ {"time":"2026-03-25T23:13:08.222278652+08:00","level":"INFO","msg":"stream: closing","id":"2h81cyev"}
14
+ {"time":"2026-03-25T23:13:08.222329103+08:00","level":"INFO","msg":"handler: closed","stream_id":{"value":"2h81cyev"}}
15
+ {"time":"2026-03-25T23:13:08.222363112+08:00","level":"INFO","msg":"writer: Close: closed","stream_id":{"value":"2h81cyev"}}
16
+ {"time":"2026-03-25T23:13:08.222465337+08:00","level":"INFO","msg":"sender: closed","stream_id":"2h81cyev"}
17
+ {"time":"2026-03-25T23:13:08.222482121+08:00","level":"INFO","msg":"stream: closed","id":"2h81cyev"}
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/logs/debug.log ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Current SDK version is 0.18.6
2
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Configure stats pid to 3457000
3
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Loading settings from /home/chyang/.config/wandb/settings
4
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Loading settings from /tmp2/chyang/workspace/LLM-BC/wandb/settings
5
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Loading settings from environment variables: {}
6
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Applying setup settings: {'mode': 'online', '_disable_service': None}
7
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Inferring run settings from compute environment: {'program_relpath': 'train.py', 'program_abspath': '/tmp2/chyang/workspace/LLM-BC/train.py', 'program': '/tmp2/chyang/workspace/LLM-BC/./train.py'}
8
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_setup.py:_flush():79] Applying login settings: {}
9
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_init.py:_log_setup():533] Logging user logs to /tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/logs/debug.log
10
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_init.py:_log_setup():534] Logging internal logs to /tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/logs/debug-internal.log
11
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_init.py:init():619] calling init triggers
12
+ 2026-03-25 21:50:01,226 INFO MainThread:3457000 [wandb_init.py:init():626] wandb.init called with sweep_config: {}
13
+ config: {'name': 'train_llm_lowdim', '_target_': 'llmbc.workspace.train_llm_workspace.TrainLLMWorkspace', 'obs_dim': 9, 'action_dim': 4, 'horizon': 1, 'n_obs_steps': 1, 'n_action_steps': 1, 'task_name': 'box-close-v2', 'exp_name': 'train llm', 'model_name': 'HuggingFaceTB/SmolLM2-135M-Instruct', 'use_quantization': False, 'lora_config': {'r': 32, 'lora_alpha': 64, 'lora_dropout': 0.05, 'bias': 'none', 'task_type': 'CAUSAL_LM'}, 'dataset': {'test_data_ratio': 0.01}, 'debug': False, 'training': {'seed': 42, 'per_device_train_batch_size': 128, 'per_device_eval_batch_size': 128, 'gradient_accumulation_steps': 1, 'optim': 'paged_adamw_32bit', 'num_train_epochs': 10, 'eval_strategy': 'steps', 'logging_steps': 1, 'warmup_steps': 10, 'logging_strategy': 'steps', 'learning_rate': 5e-05, 'fp16': False, 'bf16': True, 'tf32': True, 'group_by_length': True, 'report_to': 'wandb', 'save_steps': 5000, 'eval_steps': 10, 'use_joint_mlp_projector': True, 'joint_obs_action_mlp_lr': 5e-05}, 'trainer': {'obs_dim': 9, 'action_dim': 4, 'use_joint_mlp_projector': True, 'max_seq_length': 100, 'dataset_text_field': 'text', 'packing': False}, 'logging': {'project': 'llm_module_finetuning', 'resume': True, 'mode': 'online', 'name': '2026.03.25-21.49.56_train_llm_lowdim_box-close-v2', 'tags': ['train_llm_lowdim', 'box-close-v2', 'train llm'], 'id': None, 'group': None}, 'multi_run': {'run_dir': 'data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2', 'wandb_name_base': '2026.03.25-21.49.56_train_llm_lowdim_box-close-v2'}, 'task': {'name': 'box-close-v2', 'obs_dim': 9, 'action_dim': 4, 'env_runner': {'_target_': 'llmbc.env_runner.metaworld_lowdim_runner.MetaworldLowdimRunner', 'env_name': 'llf-metaworld-box-close-v2', 'n_train': 10, 'n_test': 50, 'n_envs': 10, 'max_steps': 30, 'n_obs_steps': 1, 'n_action_steps': 1, 'instruction_type': 'b', 'feedback_type': ['hp', 'hn', 'fp'], 'visual': False, 'discount': 0.9}, 'dataset': {'_target_': 'llmbc.dataset.metaworld_lowdim_dataset.MetaworldLowdimDataset', 'data_path': 'datasets/box-close-v2-general-pref001.pt', 'data_path2': 'datasets/box-close-v2-pref001.pt', 'horizon': 1, 'pad_before': 0, 'pad_after': 0, 'obs_eef_target': True, 'use_manual_normalizer': False, 'val_ratio': 0.05, 'dummy_normalizer': True}, 'instructor': {'_target_': 'llmbc.translator.instructor.metaworld_instructor.box_close_v2_instructor.BoxCloseV2Instructor'}}, 'llm': {'name': 'HuggingFaceTB/SmolLM2-135M-Instruct', 'model_name': 'SmolLM2-135M-Instruct', 'config_target': 'llmbc.model.llm.llama_lowdim_model.LowdimLlamaConfig', 'causal_lm_target': 'llmbc.model.llm.llama_lowdim_model.LowdimLlamaForCausalLM', 'use_quantization': False, 'use_joint_mlp_projector': True, 'llm_mode': 'mlp-finetuned', 'finetune_mode': 'orig', 'checkpoint': 'data/outputs/2026.03.25/00.25.57_train_mlp_projector_box-close-v2/checkpoints/latest.ckpt', 'max_length': 100, 'lora_config': {'r': 32, 'lora_alpha': 64, 'lora_dropout': 0.05, 'bias': 'none', 'task_type': 'CAUSAL_LM'}, 'prompter': {'_target_': 'llmbc.translator.prompter.smollm2_prompter.SmolLM2Prompter', 'use_joint_mlp_projector': True}, 'hydra': {'job': {'override_dirname': 'HuggingFaceTB/SmolLM2-135M-Instruct'}, 'run': {'dir': 'data/outputs/2026.03.25/21.49.56_HuggingFaceTB/SmolLM2-135M-Instruct'}}}}
14
+ 2026-03-25 21:50:01,227 INFO MainThread:3457000 [wandb_init.py:init():669] starting backend
15
+ 2026-03-25 21:50:01,227 INFO MainThread:3457000 [wandb_init.py:init():673] sending inform_init request
16
+ 2026-03-25 21:50:01,228 INFO MainThread:3457000 [backend.py:_multiprocessing_setup():104] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
17
+ 2026-03-25 21:50:01,228 INFO MainThread:3457000 [wandb_init.py:init():686] backend started and connected
18
+ 2026-03-25 21:50:01,233 INFO MainThread:3457000 [wandb_init.py:init():781] updated telemetry
19
+ 2026-03-25 21:50:01,265 INFO MainThread:3457000 [wandb_init.py:init():814] communicating run to backend with 90.0 second timeout
20
+ 2026-03-25 21:50:02,646 INFO MainThread:3457000 [wandb_init.py:init():867] starting run threads in backend
21
+ 2026-03-25 21:50:02,757 INFO MainThread:3457000 [wandb_run.py:_console_start():2451] atexit reg
22
+ 2026-03-25 21:50:02,757 INFO MainThread:3457000 [wandb_run.py:_redirect():2299] redirect: wrap_raw
23
+ 2026-03-25 21:50:02,758 INFO MainThread:3457000 [wandb_run.py:_redirect():2364] Wrapping output streams.
24
+ 2026-03-25 21:50:02,758 INFO MainThread:3457000 [wandb_run.py:_redirect():2389] Redirects installed.
25
+ 2026-03-25 21:50:02,761 INFO MainThread:3457000 [wandb_init.py:init():911] run started, returning control to user process
26
+ 2026-03-25 21:50:36,180 INFO MainThread:3457000 [wandb_run.py:_config_callback():1389] config_cb None None {'obs_dim': 9, 'action_dim': 4, 'use_joint_mlp_projector': True, 'vocab_size': 49152, 'max_position_embeddings': 8192, 'hidden_size': 576, 'intermediate_size': 1536, 'num_hidden_layers': 30, 'num_attention_heads': 9, 'num_key_value_heads': 3, 'hidden_act': 'silu', 'initializer_range': 0.041666666666666664, 'rms_norm_eps': 1e-05, 'pretraining_tp': 1, 'use_cache': False, 'rope_theta': 100000, 'rope_scaling': None, 'attention_bias': False, 'attention_dropout': 0.0, 'mlp_bias': False, 'head_dim': 64, 'return_dict': True, 'output_hidden_states': False, 'output_attentions': False, 'torchscript': False, 'torch_dtype': 'bfloat16', 'use_bfloat16': False, 'tf_legacy_loss': False, 'pruned_heads': {}, 'tie_word_embeddings': True, 'chunk_size_feed_forward': 0, 'is_encoder_decoder': False, 'is_decoder': False, 'cross_attention_hidden_size': None, 'add_cross_attention': False, 'tie_encoder_decoder': False, 'max_length': 20, 'min_length': 0, 'do_sample': False, 'early_stopping': False, 'num_beams': 1, 'num_beam_groups': 1, 'diversity_penalty': 0.0, 'temperature': 1.0, 'top_k': 50, 'top_p': 1.0, 'typical_p': 1.0, 'repetition_penalty': 1.0, 'length_penalty': 1.0, 'no_repeat_ngram_size': 0, 'encoder_no_repeat_ngram_size': 0, 'bad_words_ids': None, 'num_return_sequences': 1, 'output_scores': False, 'return_dict_in_generate': False, 'forced_bos_token_id': None, 'forced_eos_token_id': None, 'remove_invalid_values': False, 'exponential_decay_length_penalty': None, 'suppress_tokens': None, 'begin_suppress_tokens': None, 'architectures': ['LlamaForCausalLM'], 'finetuning_task': None, 'id2label': {0: 'LABEL_0', 1: 'LABEL_1'}, 'label2id': {'LABEL_0': 0, 'LABEL_1': 1}, 'tokenizer_class': None, 'prefix': None, 'bos_token_id': 1, 'pad_token_id': 2, 'eos_token_id': 2, 'sep_token_id': None, 'decoder_start_token_id': None, 'task_specific_params': None, 'problem_type': None, '_name_or_path': 'HuggingFaceTB/SmolLM2-135M-Instruct', '_attn_implementation_autoset': True, 'transformers_version': '4.47.1', 'is_llama_config': True, 'model_type': 'llama_lowdim', 'rope_interleaved': False, 'transformers.js_config': {'kv_cache_dtype': {'q4f16': 'float16', 'fp16': 'float16'}}, 'output_dir': '/tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2', 'overwrite_output_dir': False, 'do_train': False, 'do_eval': True, 'do_predict': False, 'eval_strategy': 'steps', 'prediction_loss_only': False, 'per_device_train_batch_size': 128, 'per_device_eval_batch_size': 128, 'per_gpu_train_batch_size': None, 'per_gpu_eval_batch_size': None, 'gradient_accumulation_steps': 1, 'eval_accumulation_steps': None, 'eval_delay': 0, 'torch_empty_cache_steps': None, 'learning_rate': 5e-05, 'weight_decay': 0.0, 'adam_beta1': 0.9, 'adam_beta2': 0.999, 'adam_epsilon': 1e-08, 'max_grad_norm': 1.0, 'num_train_epochs': 10, 'max_steps': -1, 'lr_scheduler_type': 'linear', 'lr_scheduler_kwargs': {}, 'warmup_ratio': 0.0, 'warmup_steps': 10, 'log_level': 'passive', 'log_level_replica': 'warning', 'log_on_each_node': True, 'logging_dir': '/tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2/runs/Mar25_21-50-25_A6000', 'logging_strategy': 'steps', 'logging_first_step': False, 'logging_steps': 1, 'logging_nan_inf_filter': True, 'save_strategy': 'steps', 'save_steps': 5000, 'save_total_limit': None, 'save_safetensors': True, 'save_on_each_node': False, 'save_only_model': False, 'restore_callback_states_from_checkpoint': False, 'no_cuda': False, 'use_cpu': False, 'use_mps_device': False, 'seed': 42, 'data_seed': None, 'jit_mode_eval': False, 'use_ipex': False, 'bf16': True, 'fp16': False, 'fp16_opt_level': 'O1', 'half_precision_backend': 'auto', 'bf16_full_eval': False, 'fp16_full_eval': False, 'tf32': True, 'local_rank': 0, 'ddp_backend': None, 'tpu_num_cores': None, 'tpu_metrics_debug': False, 'debug': [], 'dataloader_drop_last': False, 'eval_steps': 10, 'dataloader_num_workers': 0, 'dataloader_prefetch_factor': None, 'past_index': -1, 'run_name': '/tmp2/chyang/workspace/LLM-BC/data/outputs/2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/HuggingFaceTB/SmolLM2-135M-Instruct-finetuned-box-close-v2', 'disable_tqdm': False, 'remove_unused_columns': True, 'label_names': None, 'load_best_model_at_end': False, 'metric_for_best_model': None, 'greater_is_better': None, 'ignore_data_skip': False, 'fsdp': [], 'fsdp_min_num_params': 0, 'fsdp_config': {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}, 'fsdp_transformer_layer_cls_to_wrap': None, 'accelerator_config': {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}, 'deepspeed': None, 'label_smoothing_factor': 0.0, 'optim': 'paged_adamw_32bit', 'optim_args': None, 'adafactor': False, 'group_by_length': True, 'length_column_name': 'length', 'report_to': ['wandb'], 'ddp_find_unused_parameters': None, 'ddp_bucket_cap_mb': None, 'ddp_broadcast_buffers': None, 'dataloader_pin_memory': True, 'dataloader_persistent_workers': False, 'skip_memory_metrics': True, 'use_legacy_prediction_loop': False, 'push_to_hub': False, 'resume_from_checkpoint': None, 'hub_model_id': None, 'hub_strategy': 'every_save', 'hub_token': '<HUB_TOKEN>', 'hub_private_repo': None, 'hub_always_push': False, 'gradient_checkpointing': False, 'gradient_checkpointing_kwargs': None, 'include_inputs_for_metrics': False, 'include_for_metrics': [], 'eval_do_concat_batches': True, 'fp16_backend': 'auto', 'evaluation_strategy': None, 'push_to_hub_model_id': None, 'push_to_hub_organization': None, 'push_to_hub_token': '<PUSH_TO_HUB_TOKEN>', 'mp_parameters': '', 'auto_find_batch_size': False, 'full_determinism': False, 'torchdynamo': None, 'ray_scope': 'last', 'ddp_timeout': 1800, 'torch_compile': False, 'torch_compile_backend': None, 'torch_compile_mode': None, 'dispatch_batches': None, 'split_batches': None, 'include_tokens_per_second': False, 'include_num_input_tokens_seen': False, 'neftune_noise_alpha': None, 'optim_target_modules': None, 'batch_eval_metrics': False, 'eval_on_start': False, 'use_liger_kernel': False, 'eval_use_gather_object': False, 'average_tokens_across_devices': False, 'dataset_text_field': 'text', 'packing': False, 'max_seq_length': 100, 'dataset_num_proc': None, 'dataset_batch_size': 1000, 'model_init_kwargs': None, 'dataset_kwargs': {}, 'eval_packing': None, 'num_of_sequences': 1024, 'chars_per_token': '<CHARS_PER_TOKEN>', 'use_liger': False, 'joint_obs_action_mlp_lr': 5e-05, 'obs_mlp_lr': None, 'action_mlp_lr': None}
27
+ 2026-03-25 21:50:36,182 INFO MainThread:3457000 [wandb_config.py:__setitem__():154] config set model/num_parameters = 134855424 - <bound method Run._config_callback of <wandb.sdk.wandb_run.Run object at 0x7f56b49b1940>>
28
+ 2026-03-25 21:50:36,182 INFO MainThread:3457000 [wandb_run.py:_config_callback():1389] config_cb model/num_parameters 134855424 None
29
+ 2026-03-25 23:12:45,892 INFO MainThread:3457000 [wandb_run.py:_finish():2146] finishing run chyang25-national-taiwan-university/llm_module_finetuning/2h81cyev
30
+ 2026-03-25 23:12:45,892 INFO MainThread:3457000 [wandb_run.py:_atexit_cleanup():2414] got exitcode: 0
31
+ 2026-03-25 23:12:45,892 INFO MainThread:3457000 [wandb_run.py:_restore():2396] restore
32
+ 2026-03-25 23:12:45,892 INFO MainThread:3457000 [wandb_run.py:_restore():2402] restore done
33
+ 2026-03-25 23:13:08,216 INFO MainThread:3457000 [wandb_run.py:_footer_history_summary_info():3963] rendering history
34
+ 2026-03-25 23:13:08,218 INFO MainThread:3457000 [wandb_run.py:_footer_history_summary_info():3995] rendering summary
35
+ 2026-03-25 23:13:08,221 INFO MainThread:3457000 [wandb_run.py:_footer_sync_info():3922] logging synced files
2026.03.25/21.49.56_train_llm_lowdim_box-close-v2/wandb/run-20260325_215001-2h81cyev/run-2h81cyev.wandb ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:569e8439e1468172247777b9d539061903397dda5973706064b00579c30f21f3
3
+ size 17959313