Hugging Face's logo

KotshinZ
/
gpt2-RMT-2

Transformers
PyTorch
Safetensors
rmt_gpt2
Generated from Trainer
open-r1
trl
sft
Model card Files
xet
Community
KotshinZ commited on
Commit
1c229f3
·
verified ·
1 Parent(s): 72635bf

Model save

Browse files
Files changed (6) hide show
  1. README.md +2 -4
  2. all_results.json +4 -4
  3. model.safetensors +1 -1
  4. train_results.json +4 -4
  5. trainer_state.json +0 -0
  6. training_args.bin +1 -1
README.md CHANGED
@@ -1,17 +1,15 @@
1
  ---
2
  base_model: openai-community/gpt2
3
- datasets: HuggingFaceH4/Bespoke-Stratos-17k
4
  library_name: transformers
5
  model_name: gpt2-RMT-2
6
  tags:
7
  - generated_from_trainer
8
- - open-r1
9
  licence: license
10
  ---
11
 
12
  # Model Card for gpt2-RMT-2
13
 
14
- This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on the [HuggingFaceH4/Bespoke-Stratos-17k](https://huggingface.co/datasets/HuggingFaceH4/Bespoke-Stratos-17k) dataset.
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
@@ -27,7 +25,7 @@ print(output["generated_text"])
27
 
28
  ## Training procedure
29
 
30
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/s18574s18574-/huggingface/runs/cvgunpd7)
31
 
32
 
33
  This model was trained with SFT.
 
1
  ---
2
  base_model: openai-community/gpt2
 
3
  library_name: transformers
4
  model_name: gpt2-RMT-2
5
  tags:
6
  - generated_from_trainer
 
7
  licence: license
8
  ---
9
 
10
  # Model Card for gpt2-RMT-2
11
 
12
+ This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2).
13
  It has been trained using [TRL](https://github.com/huggingface/trl).
14
 
15
  ## Quick start
 
25
 
26
  ## Training procedure
27
 
28
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/s18574s18574-/huggingface/runs/qiwktvbf)
29
 
30
 
31
  This model was trained with SFT.
all_results.json CHANGED
@@ -4,9 +4,9 @@
4
  "eval_samples_per_second": 265.729,
5
  "eval_steps_per_second": 66.614,
6
  "total_flos": 0.0,
7
- "train_loss": 2.016458841995117,
8
- "train_runtime": 997.6055,
9
  "train_samples": 16610,
10
- "train_samples_per_second": 91.954,
11
- "train_steps_per_second": 5.748
12
  }
 
4
  "eval_samples_per_second": 265.729,
5
  "eval_steps_per_second": 66.614,
6
  "total_flos": 0.0,
7
+ "train_loss": 2.839574353448276,
8
+ "train_runtime": 8.9764,
9
  "train_samples": 16610,
10
+ "train_samples_per_second": 102.195,
11
+ "train_steps_per_second": 6.461
12
  }
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8c1eac6af26e7d9bc716da8201dd940277d0992dcf499246be62e9109198c04b
3
  size 326110968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:58d5e0dc13a323943aae2894b7668f8dbe8ce152207af552e1747c76b2052c2d
3
  size 326110968
train_results.json CHANGED
@@ -1,8 +1,8 @@
1
  {
2
  "total_flos": 0.0,
3
- "train_loss": 2.016458841995117,
4
- "train_runtime": 997.6055,
5
  "train_samples": 16610,
6
- "train_samples_per_second": 91.954,
7
- "train_steps_per_second": 5.748
8
  }
 
1
  {
2
  "total_flos": 0.0,
3
+ "train_loss": 2.839574353448276,
4
+ "train_runtime": 8.9764,
5
  "train_samples": 16610,
6
+ "train_samples_per_second": 102.195,
7
+ "train_steps_per_second": 6.461
8
  }
trainer_state.json CHANGED
The diff for this file is too large to render. See raw diff
 
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:451c5f9e05ecfee261beb7a55baab3777c57dc8ada048b4636e9d2b55c96c8d2
3
  size 7352
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:687b30bdda8c062f901bc710f949dce7a9b706604d6917216cf1a525db3f22c7
3
  size 7352