AngelRaychev commited on
Commit
12efb1b
·
verified ·
1 Parent(s): 5fc693e

End of training

Browse files
Files changed (4) hide show
  1. README.md +2 -2
  2. config.json +1 -1
  3. pytorch_model.bin +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- base_model: AngelRaychev/0.5B-policy-iteration_1
3
  library_name: transformers
4
  model_name: 0.5B-policy-iteration_1
5
  tags:
@@ -11,7 +11,7 @@ licence: license
11
 
12
  # Model Card for 0.5B-policy-iteration_1
13
 
14
- This model is a fine-tuned version of [AngelRaychev/0.5B-policy-iteration_1](https://huggingface.co/AngelRaychev/0.5B-policy-iteration_1).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
 
1
  ---
2
+ base_model: AngelRaychev/0.5B-policy-iteration_0
3
  library_name: transformers
4
  model_name: 0.5B-policy-iteration_1
5
  tags:
 
11
 
12
  # Model Card for 0.5B-policy-iteration_1
13
 
14
+ This model is a fine-tuned version of [AngelRaychev/0.5B-policy-iteration_0](https://huggingface.co/AngelRaychev/0.5B-policy-iteration_0).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
config.json CHANGED
@@ -11,7 +11,7 @@
11
  "intermediate_size": 4864,
12
  "max_position_embeddings": 32768,
13
  "max_window_layers": 24,
14
- "model_card": "\nFinal Loss: 0.1864\nBatch Size: 128\nLearning Rate: 2e-05\nDataset Size: 12000\n",
15
  "model_type": "qwen2",
16
  "num_attention_heads": 14,
17
  "num_hidden_layers": 24,
 
11
  "intermediate_size": 4864,
12
  "max_position_embeddings": 32768,
13
  "max_window_layers": 24,
14
+ "model_card": "\nFinal Loss: 0.1322\nBatch Size: 256\nLearning Rate: 5e-05\nDataset Size: 12000\n",
15
  "model_type": "qwen2",
16
  "num_attention_heads": 14,
17
  "num_hidden_layers": 24,
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dc78273a56022f074818e0d16161820ac4f2dac511b02132da715ce9b0225407
3
  size 988163026
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63f1ae89b0acabcd1fc5db8f0ce8353a20ff8321b30e4b74f6ea034e53ed4e8b
3
  size 988163026
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:af82e20d6685d8bda2a261d6cac813e0b25393aa6cfc65f951a5fefc3de380c7
3
  size 5624
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef97afc57949b18fd2288785835675a046bec5061a59df155b12db886a97da6e
3
  size 5624