Commit Β·
fb03d85
1
Parent(s): b854631
Model & README Update
Browse files
README.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
|
| 2 |
# πΈ π₯ Rockbot π€ π§
|
| 3 |
-
A [GPT-2](https://
|
| 4 |
|
| 5 |
**Instructions:** Type in a fake song title, pick an artist, click "Generate".
|
| 6 |
|
|
@@ -8,13 +8,15 @@ Note: Due to the nature of language models, lyrics bleed across artists and you
|
|
| 8 |
|
| 9 |
Finally, these lyrics are computer generated. Not all of these will be non-repetitive and/or coherent. Just have fun.
|
| 10 |
|
| 11 |
-
[Repository](https://github.com/bigjoedata/rockbot)
|
| 12 |
|
| 13 |
-
[Model page on Hugging Face](https://huggingface.co/bigjoedata/rockbot)
|
|
|
|
|
|
|
| 14 |
|
| 15 |
πΉ πͺ π· πΊ πͺ πͺ π»
|
| 16 |
## Background
|
| 17 |
-
With the shutdown of [Google Play Music](https://en.wikipedia.org/wiki/Google_Play_Music) I used Google's takeout function to gather the metadata from artists I've listened to over the past several years. I wanted to take advantage of this bounty to build something fun. I scraped the top 50 lyrics for artists I'd listened to at least once from [Genius](https://genius.com/), then fine tuned [GPT-2's](https://openai.com/blog/better-language-models/) 124M token model using the [AITextGen](https://github.com/minimaxir/aitextgen) framework after considerable post-processing.
|
| 18 |
|
| 19 |
### Full Tech Stack
|
| 20 |
[Google Play Music](https://en.wikipedia.org/wiki/Google_Play_Music) (R.I.P.).
|
|
|
|
| 1 |
|
| 2 |
# πΈ π₯ Rockbot π€ π§
|
| 3 |
+
A [GPT-2](https://openai.com/blog/better-language-models/) based lyrics generator fine-tuned on the writing styles of 16000 songs by 270 artists across MANY genres (not just rock).
|
| 4 |
|
| 5 |
**Instructions:** Type in a fake song title, pick an artist, click "Generate".
|
| 6 |
|
|
|
|
| 8 |
|
| 9 |
Finally, these lyrics are computer generated. Not all of these will be non-repetitive and/or coherent. Just have fun.
|
| 10 |
|
| 11 |
+
[Github Repository](https://github.com/bigjoedata/rockbot)
|
| 12 |
|
| 13 |
+
[GPT-2 124M version Model page on Hugging Face](https://huggingface.co/bigjoedata/rockbot)
|
| 14 |
+
|
| 15 |
+
[DistilGPT2 version Model page on Hugging Face](https://huggingface.co/bigjoedata/rockbot-distilgpt2/) This is leaner but the lyrics are much more simplistic.
|
| 16 |
|
| 17 |
πΉ πͺ π· πΊ πͺ πͺ π»
|
| 18 |
## Background
|
| 19 |
+
With the shutdown of [Google Play Music](https://en.wikipedia.org/wiki/Google_Play_Music) I used Google's takeout function to gather the metadata from artists I've listened to over the past several years. I wanted to take advantage of this bounty to build something fun. I scraped the top 50 lyrics for artists I'd listened to at least once from [Genius](https://genius.com/), then fine tuned [GPT-2's](https://openai.com/blog/better-language-models/) 124M token model using the [AITextGen](https://github.com/minimaxir/aitextgen) framework after considerable post-processing. For more on generation, see [here.](https://huggingface.co/blog/how-to-generate)
|
| 20 |
|
| 21 |
### Full Tech Stack
|
| 22 |
[Google Play Music](https://en.wikipedia.org/wiki/Google_Play_Music) (R.I.P.).
|