Hugging Face's logo

wookidoki
/
model

Text Generation
Transformers
Safetensors
llama
Generated from Trainer
text-generation-inference
Model card Files
xet
 Community
wookidoki commited on
Commit
db1da6e
·
verified ·
1 Parent(s): 6c5da33

End of training

Browse files
Files changed (8) hide show
  1. README.md +7 -5
  2. model-00001-of-00006.safetensors +1 -1
  3. model-00002-of-00006.safetensors +1 -1
  4. model-00003-of-00006.safetensors +1 -1
  5. model-00004-of-00006.safetensors +1 -1
  6. model-00005-of-00006.safetensors +1 -1
  7. model-00006-of-00006.safetensors +1 -1
  8. training_args.bin +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [h2oai/h2ogpt-16k-codellama-7b-instruct](https://huggingface.co/h2oai/h2ogpt-16k-codellama-7b-instruct) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: nan
19
 
20
  ## Model description
21
 
@@ -42,14 +42,16 @@ The following hyperparameters were used during training:
42
  - total_train_batch_size: 32
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
- - num_epochs: 1
46
  - mixed_precision_training: Native AMP
47
 
48
  ### Training results
49
 
50
- | Training Loss | Epoch | Step | Validation Loss |
51
- |:---------------------------------:|:-----:|:----:|:---------------:|
52
- | 3807147538302121082657701888.0000 | 0.58 | 20 | nan |
 
 
53
 
54
 
55
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [h2oai/h2ogpt-16k-codellama-7b-instruct](https://huggingface.co/h2oai/h2ogpt-16k-codellama-7b-instruct) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 0.1710
19
 
20
  ## Model description
21
 
 
42
  - total_train_batch_size: 32
43
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
44
  - lr_scheduler_type: linear
45
+ - num_epochs: 2
46
  - mixed_precision_training: Native AMP
47
 
48
  ### Training results
49
 
50
+ | Training Loss | Epoch | Step | Validation Loss |
51
+ |:-------------:|:-----:|:----:|:---------------:|
52
+ | 0.801 | 0.58 | 20 | 0.4678 |
53
+ | 0.4313 | 1.17 | 40 | 0.2828 |
54
+ | 0.2631 | 1.75 | 60 | 0.1710 |
55
 
56
 
57
  ### Framework versions
model-00001-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8977d6bda20aa41125b99bcec5e3b92f8bdfe09852e5cf2b5f20b62272622c3d
3
  size 4840658560
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e5345624ec6ed037844c3c6144bc23c792aa863a8359ce61239ce8afb4ac167f
3
  size 4840658560
model-00002-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:524f27909291786befbd9efa2802f9b8a10ea1628bc92c45ed38f72a83e01d27
3
  size 4857206856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25b7a09eb6e744604e025718453c6dd94117abd297a64c437b78ca23c409b5a0
3
  size 4857206856
model-00003-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:41d661f7bee4ddf2667555940df7c15eebf59633168749d474c65bdb792186b3
3
  size 4857206904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b10f0ee4172030c84d3fb43dd3173468bd5540db5f4fc1c6821e2212ccd91b05
3
  size 4857206904
model-00004-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:42c947059ae5245c89af95eb8805aa5192ea2e91250cac7466c9bafd73dbad77
3
  size 4857206904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7915c077a0233b20194f732d6e9c9ac995668552041062922e8b3fb4ccfa5a35
3
  size 4857206904
model-00005-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fca49b698d597ec212eb7f3abb377b63af542015a3e340a90805f2aec69c065d
3
  size 4857206904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:76a32ceb99dd6c16b0632676de660b7ae7c8814eef32648e5e00f02f1080d50e
3
  size 4857206904
model-00006-of-00006.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7ad84f4543c62267be9669b02eee3be51fe9375e72207a8b45af0598a711a915
3
  size 2684734256
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e144a29a6bfdd100260514dbf78ad84d8d4bd7dd8e47bbdc3727808341316f0
3
  size 2684734256
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:48eac033b58c8e1a6722eae87a52c8a4943f0630a1beb0b778f467276928d2c1
3
  size 4856
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:96a2cc92e099bf416e007f5cea87806fd6522294e4ef37bb311a62c884f0fda6
3
  size 4856