Hugging Face's logo

CharlesLi
/
llama_2_cot_simplest_code_math_5_full

Text Generation
Transformers
TensorBoard
Safetensors
llama
alignment-handbook
trl
sft
Generated from Trainer
conversational
text-generation-inference
Model card Files
xet
Metrics Community
CharlesLi commited on
Commit
561b236
·
verified ·
1 Parent(s): 1ec5586

Model save

Browse files
Files changed (9) hide show
  1. README.md +3 -6
  2. all_results.json +4 -4
  3. config.json +1 -1
  4. model-00001-of-00003.safetensors +1 -1
  5. model-00002-of-00003.safetensors +1 -1
  6. model-00003-of-00003.safetensors +1 -1
  7. runs/Jan20_13-18-14_dgx-a100-16/events.out.tfevents.1737375519.dgx-a100-16.3048174.0 +3 -0
  8. train_results.json +4 -4
  9. training_args.bin +1 -1
README.md CHANGED
@@ -3,12 +3,9 @@ library_name: transformers
3
  license: llama2
4
  base_model: meta-llama/Llama-2-7b-chat-hf
5
  tags:
6
- - alignment-handbook
7
- - trl
8
- - sft
9
- - generated_from_trainer
10
  - trl
11
  - sft
 
12
  - generated_from_trainer
13
  datasets:
14
  - generator
@@ -24,7 +21,7 @@ should probably proofread and complete it, then remove this comment. -->
24
 
25
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on the generator dataset.
26
  It achieves the following results on the evaluation set:
27
- - Loss: 0.5659
28
 
29
  ## Model description
30
 
@@ -61,7 +58,7 @@ The following hyperparameters were used during training:
61
 
62
  | Training Loss | Epoch | Step | Validation Loss |
63
  |:-------------:|:------:|:----:|:---------------:|
64
- | 0.61 | 0.8333 | 100 | 0.5682 |
65
 
66
 
67
  ### Framework versions
 
3
  license: llama2
4
  base_model: meta-llama/Llama-2-7b-chat-hf
5
  tags:
 
 
 
 
6
  - trl
7
  - sft
8
+ - alignment-handbook
9
  - generated_from_trainer
10
  datasets:
11
  - generator
 
21
 
22
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on the generator dataset.
23
  It achieves the following results on the evaluation set:
24
+ - Loss: 0.5445
25
 
26
  ## Model description
27
 
 
58
 
59
  | Training Loss | Epoch | Step | Validation Loss |
60
  |:-------------:|:------:|:----:|:---------------:|
61
+ | 0.6119 | 0.8333 | 100 | 0.5445 |
62
 
63
 
64
  ### Framework versions
all_results.json CHANGED
@@ -6,9 +6,9 @@
6
  "eval_samples_per_second": 7.511,
7
  "eval_steps_per_second": 1.502,
8
  "total_flos": 12510434426880.0,
9
- "train_loss": 0.6028374413649241,
10
- "train_runtime": 645.7467,
11
  "train_samples": 15980,
12
- "train_samples_per_second": 5.937,
13
- "train_steps_per_second": 0.186
14
  }
 
6
  "eval_samples_per_second": 7.511,
7
  "eval_steps_per_second": 1.502,
8
  "total_flos": 12510434426880.0,
9
+ "train_loss": 0.6044951339562734,
10
+ "train_runtime": 648.7175,
11
  "train_samples": 15980,
12
+ "train_samples_per_second": 5.91,
13
+ "train_steps_per_second": 0.185
14
  }
config.json CHANGED
@@ -24,6 +24,6 @@
24
  "tie_word_embeddings": false,
25
  "torch_dtype": "bfloat16",
26
  "transformers_version": "4.44.2",
27
- "use_cache": true,
28
  "vocab_size": 32000
29
  }
 
24
  "tie_word_embeddings": false,
25
  "torch_dtype": "bfloat16",
26
  "transformers_version": "4.44.2",
27
+ "use_cache": false,
28
  "vocab_size": 32000
29
  }
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3a40362ddb35a85ccdc41e67ce687977b20e5b61094e30332919e7e56eb5fac2
3
  size 4938985352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:35c74af15524d0369817e2a35bc12e3fb9aadcf91b0ac9633ab4f2d8768233a6
3
  size 4938985352
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3356c0ce2c7a143001bb3fc8f7cb81ea3fb205eec714bf7c1ebed423ea47c05c
3
  size 4947390880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2c6cb5e750c8368f18896a9b31fa79724a87839d0fdc533b4453a0ff568fc67
3
  size 4947390880
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:14f4eb7df28e8ce71fe7cebe7780ce485c4494d94489c5c5b4044d1eabe4323b
3
  size 3590488816
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ea6769c0facc92cce852d165537fe5add19e18e5007dfb7689c45067364da13
3
  size 3590488816
runs/Jan20_13-18-14_dgx-a100-16/events.out.tfevents.1737375519.dgx-a100-16.3048174.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6be1d335425405a2deab9d0eb36f3a81d24f553cff52139779d5f926ff82dcd8
3
+ size 6725
train_results.json CHANGED
@@ -1,9 +1,9 @@
1
  {
2
  "epoch": 1.0,
3
  "total_flos": 12510434426880.0,
4
- "train_loss": 0.6028374413649241,
5
- "train_runtime": 645.7467,
6
  "train_samples": 15980,
7
- "train_samples_per_second": 5.937,
8
- "train_steps_per_second": 0.186
9
  }
 
1
  {
2
  "epoch": 1.0,
3
  "total_flos": 12510434426880.0,
4
+ "train_loss": 0.6044951339562734,
5
+ "train_runtime": 648.7175,
6
  "train_samples": 15980,
7
+ "train_samples_per_second": 5.91,
8
+ "train_steps_per_second": 0.185
9
  }
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f635249059635a04e5128b6342f1601440e60ee227f82169d47b7a9f60af9764
3
  size 7032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:466becbd206ac75817ef9a3264d01b26a2527a346d371bdd48ca9e6f19c593e5
3
  size 7032