Hugging Face's logo

CharlesLi
/
llama_2_llama_2_code_math_5_full

Text Generation
Transformers
TensorBoard
Safetensors
llama
alignment-handbook
trl
sft
Generated from Trainer
conversational
text-generation-inference
Model card Files
xet
Metrics Community
CharlesLi commited on
Commit
2648e05
·
verified ·
1 Parent(s): f94d8c8

Model save

Browse files
Files changed (9) hide show
  1. README.md +2 -6
  2. all_results.json +3 -3
  3. config.json +1 -1
  4. model-00001-of-00003.safetensors +1 -1
  5. model-00002-of-00003.safetensors +1 -1
  6. model-00003-of-00003.safetensors +1 -1
  7. runs/Jan20_15-31-19_dgx-a100-16/events.out.tfevents.1737383504.dgx-a100-16.3159106.0 +3 -0
  8. train_results.json +3 -3
  9. training_args.bin +1 -1
README.md CHANGED
@@ -3,10 +3,6 @@ library_name: transformers
3
  license: llama2
4
  base_model: meta-llama/Llama-2-7b-chat-hf
5
  tags:
6
- - alignment-handbook
7
- - trl
8
- - sft
9
- - generated_from_trainer
10
  - trl
11
  - sft
12
  - alignment-handbook
@@ -25,7 +21,7 @@ should probably proofread and complete it, then remove this comment. -->
25
 
26
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on the generator dataset.
27
  It achieves the following results on the evaluation set:
28
- - Loss: 0.5805
29
 
30
  ## Model description
31
 
@@ -62,7 +58,7 @@ The following hyperparameters were used during training:
62
 
63
  | Training Loss | Epoch | Step | Validation Loss |
64
  |:-------------:|:------:|:----:|:---------------:|
65
- | 0.6233 | 0.8969 | 100 | 0.5806 |
66
 
67
 
68
  ### Framework versions
 
3
  license: llama2
4
  base_model: meta-llama/Llama-2-7b-chat-hf
5
  tags:
 
 
 
 
6
  - trl
7
  - sft
8
  - alignment-handbook
 
21
 
22
  This model is a fine-tuned version of [meta-llama/Llama-2-7b-chat-hf](https://huggingface.co/meta-llama/Llama-2-7b-chat-hf) on the generator dataset.
23
  It achieves the following results on the evaluation set:
24
+ - Loss: 0.5814
25
 
26
  ## Model description
27
 
 
58
 
59
  | Training Loss | Epoch | Step | Validation Loss |
60
  |:-------------:|:------:|:----:|:---------------:|
61
+ | 0.6223 | 0.8969 | 100 | 0.5814 |
62
 
63
 
64
  ### Framework versions
all_results.json CHANGED
@@ -6,9 +6,9 @@
6
  "eval_samples_per_second": 7.41,
7
  "eval_steps_per_second": 1.482,
8
  "total_flos": 11568225976320.0,
9
- "train_loss": 0.6208126437556636,
10
- "train_runtime": 598.696,
11
  "train_samples": 15980,
12
- "train_samples_per_second": 5.948,
13
  "train_steps_per_second": 0.185
14
  }
 
6
  "eval_samples_per_second": 7.41,
7
  "eval_steps_per_second": 1.482,
8
  "total_flos": 11568225976320.0,
9
+ "train_loss": 0.6199138357832625,
10
+ "train_runtime": 600.1237,
11
  "train_samples": 15980,
12
+ "train_samples_per_second": 5.934,
13
  "train_steps_per_second": 0.185
14
  }
config.json CHANGED
@@ -24,6 +24,6 @@
24
  "tie_word_embeddings": false,
25
  "torch_dtype": "bfloat16",
26
  "transformers_version": "4.44.2",
27
- "use_cache": true,
28
  "vocab_size": 32000
29
  }
 
24
  "tie_word_embeddings": false,
25
  "torch_dtype": "bfloat16",
26
  "transformers_version": "4.44.2",
27
+ "use_cache": false,
28
  "vocab_size": 32000
29
  }
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c6287bce6d1cb2a9c45cb5e950e2ffbae039ff9680989275352937885783ffb6
3
  size 4938985352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7d79cd30c3d2b53295ec16d2195a9f9a80091be74c56b93f290d01a912bfeed
3
  size 4938985352
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7ec70aafb02c58541c7eca5afbb585da63bfffb5bed2e445c39358cf89c6a4f0
3
  size 4947390880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3375da220a7f85215a1c73ff43877aacb2485f028557cff5d5a774259fb7510c
3
  size 4947390880
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d710c295634e3495f14e8a8742482213e17cc669adf7c483e0112aa22afcef7b
3
  size 3590488816
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a269b9b6f4bfc53824b18e063b447fb0d0e0c62d6f98e9ee59f05c2e83f6753
3
  size 3590488816
runs/Jan20_15-31-19_dgx-a100-16/events.out.tfevents.1737383504.dgx-a100-16.3159106.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31325496a0fd478dde2fae38753c737ec66b7267c59e0faedeee21eca57df770
3
+ size 6705
train_results.json CHANGED
@@ -1,9 +1,9 @@
1
  {
2
  "epoch": 0.9955156950672646,
3
  "total_flos": 11568225976320.0,
4
- "train_loss": 0.6208126437556636,
5
- "train_runtime": 598.696,
6
  "train_samples": 15980,
7
- "train_samples_per_second": 5.948,
8
  "train_steps_per_second": 0.185
9
  }
 
1
  {
2
  "epoch": 0.9955156950672646,
3
  "total_flos": 11568225976320.0,
4
+ "train_loss": 0.6199138357832625,
5
+ "train_runtime": 600.1237,
6
  "train_samples": 15980,
7
+ "train_samples_per_second": 5.934,
8
  "train_steps_per_second": 0.185
9
  }
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:277c5fb07595bb4930a0132e276dadd8a868d17d8bf44b29eb91847a271f8b1d
3
  size 7032
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37a79deb2b80b0877af05bb00f5d5e6e009b066cd083fb105831adeeeeffc119
3
  size 7032