Kevin Ripper commited on
Commit ·
ff715d8
1
Parent(s): 9e2ddfb
Update README.md
Browse files
README.md
CHANGED
|
@@ -11,21 +11,16 @@ widget:
|
|
| 11 |
|
| 12 |
# ReviewTrainingBot
|
| 13 |
|
| 14 |
-
This model was trained
|
| 15 |
-
It achieves the following results on the evaluation set:
|
| 16 |
-
- Loss: 2.9745
|
| 17 |
|
| 18 |
-
## Model description
|
| 19 |
-
|
| 20 |
-
More information needed
|
| 21 |
|
| 22 |
## Intended uses & limitations
|
| 23 |
|
| 24 |
-
|
|
|
|
|
|
|
| 25 |
|
| 26 |
-
## Training and evaluation data
|
| 27 |
|
| 28 |
-
More information needed
|
| 29 |
|
| 30 |
## Training procedure
|
| 31 |
|
|
@@ -42,13 +37,6 @@ The following hyperparameters were used during training:
|
|
| 42 |
- lr_scheduler_warmup_steps: 100
|
| 43 |
- training_steps: 5000
|
| 44 |
|
| 45 |
-
### Training results
|
| 46 |
-
|
| 47 |
-
| Training Loss | Epoch | Step | Validation Loss |
|
| 48 |
-
|:-------------:|:-----:|:----:|:---------------:|
|
| 49 |
-
| 2.9576 | 0.19 | 2000 | 3.0142 |
|
| 50 |
-
| 2.9666 | 0.38 | 4000 | 2.9745 |
|
| 51 |
-
|
| 52 |
|
| 53 |
### Framework versions
|
| 54 |
|
|
|
|
| 11 |
|
| 12 |
# ReviewTrainingBot
|
| 13 |
|
| 14 |
+
This model was trained for the purpose of generating scores and reviews for any given movie. It is fine-tuned on distilgpt2 as a baseline and trained on a custom dataset created by scraping around 120k letterboxd reviews. The current state of the model can get the correct formatting reliably but oftentimes is prone to gibberish. Further training will hopefully add coherency.
|
|
|
|
|
|
|
| 15 |
|
|
|
|
|
|
|
|
|
|
| 16 |
|
| 17 |
## Intended uses & limitations
|
| 18 |
|
| 19 |
+
This model is intended to be used for entertainment.
|
| 20 |
+
|
| 21 |
+
Limitations for this model will be much of the same as distilgpt2 which can be viewed here https://huggingface.co/distilgpt2. These may include persistent biases. Another issue may be through language specifically on letterboxd that the algorithm may not be able to understand. i.e. an LGBT+ film on letterboxd may have multiple reviews that mention the word "gay" positively, this model has not been able to understand this contextual usage and will use the word as a slur. As the current model also struggles to find a connection between movie titles and the reviews, this could happen with any listed movie.
|
| 22 |
|
|
|
|
| 23 |
|
|
|
|
| 24 |
|
| 25 |
## Training procedure
|
| 26 |
|
|
|
|
| 37 |
- lr_scheduler_warmup_steps: 100
|
| 38 |
- training_steps: 5000
|
| 39 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 40 |
|
| 41 |
### Framework versions
|
| 42 |
|