witcher
commited on
Commit
·
ae0fc7b
1
Parent(s):
55aa619
Update README.md
Browse files
README.md
CHANGED
|
@@ -4,14 +4,14 @@ This model is fine-tuned on 200k text scraped from Mechanical/Automotive pdf boo
|
|
| 4 |
Base model is DistilGPT2(https://huggingface.co/gpt2) (the smallest version of GPT2)
|
| 5 |
|
| 6 |
## Fine-Tuning
|
| 7 |
-
Default Training Args
|
| 8 |
-
Epochs = 3
|
| 9 |
-
Perplexity = 48
|
| 10 |
-
Training set = 200k sentences
|
| 11 |
-
Validation set = 40k sentences
|
| 12 |
|
| 13 |
## Framework versions
|
| 14 |
-
Transformers 4.7.0.dev0
|
| 15 |
-
Pytorch 1.8.1+cu111
|
| 16 |
-
Datasets 1.6.2
|
| 17 |
-
Tokenizers 0.10.2
|
|
|
|
| 4 |
Base model is DistilGPT2(https://huggingface.co/gpt2) (the smallest version of GPT2)
|
| 5 |
|
| 6 |
## Fine-Tuning
|
| 7 |
+
* Default Training Args
|
| 8 |
+
* Epochs = 3
|
| 9 |
+
* Perplexity = 48
|
| 10 |
+
* Training set = 200k sentences
|
| 11 |
+
* Validation set = 40k sentences
|
| 12 |
|
| 13 |
## Framework versions
|
| 14 |
+
* Transformers 4.7.0.dev0
|
| 15 |
+
* Pytorch 1.8.1+cu111
|
| 16 |
+
* Datasets 1.6.2
|
| 17 |
+
* Tokenizers 0.10.2
|