MHGanainy commited on
Commit
430fe42
·
verified ·
1 Parent(s): e9da063

MHGanainy/gpt2-xl-lora-multi-shared-512

Browse files
README.md CHANGED
@@ -15,6 +15,8 @@ should probably proofread and complete it, then remove this comment. -->
15
  # gpt2-xl-lora-multi-shared-512
16
 
17
  This model is a fine-tuned version of [openai-community/gpt2-xl](https://huggingface.co/openai-community/gpt2-xl) on an unknown dataset.
 
 
18
 
19
  ## Model description
20
 
 
15
  # gpt2-xl-lora-multi-shared-512
16
 
17
  This model is a fine-tuned version of [openai-community/gpt2-xl](https://huggingface.co/openai-community/gpt2-xl) on an unknown dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 2.1271
20
 
21
  ## Model description
22
 
all_results.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 1.0,
3
+ "eval_loss": 2.1270644664764404,
4
+ "eval_runtime": 1317.2806,
5
+ "eval_samples_per_second": 143.783,
6
+ "eval_steps_per_second": 8.987,
7
+ "perplexity": 8.39020090932304,
8
+ "total_flos": 1.2729340395184456e+19,
9
+ "train_loss": 2.32545618685814,
10
+ "train_runtime": 27204.7388,
11
+ "train_samples_per_second": 51.377,
12
+ "train_steps_per_second": 3.211
13
+ }
eval_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 1.0,
3
+ "eval_loss": 2.1270644664764404,
4
+ "eval_runtime": 1317.2806,
5
+ "eval_samples_per_second": 143.783,
6
+ "eval_steps_per_second": 8.987,
7
+ "perplexity": 8.39020090932304
8
+ }
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 1.0,
3
+ "total_flos": 1.2729340395184456e+19,
4
+ "train_loss": 2.32545618685814,
5
+ "train_runtime": 27204.7388,
6
+ "train_samples_per_second": 51.377,
7
+ "train_steps_per_second": 3.211
8
+ }
trainer_state.json ADDED
The diff for this file is too large to render. See raw diff