Update README.md
Browse files
README.md
CHANGED
|
@@ -13,11 +13,11 @@ tags:
|
|
| 13 |
|
| 14 |
# This Model
|
| 15 |
This is a partially fine tuned Llama 3.1 8B LLM for poetry generation. It is based on a 10% of 1 epoch continued pretraining of the
|
| 16 |
-
Llama 3.1 8B LLM. Training was done on [200k articles from Arabic Wikipedia 2023](akhooli/arwiki_128).
|
| 17 |
This is just a proof of concept demo and should never be used for production. It is also not aligned and is likely to produce strange and unaccepted content.
|
| 18 |
-
Only the adapter is available (along with other config files). To use it, you can either install Unsloth or use the HuggingFace PEFT API.
|
| 19 |
-
See installation instructions at the Unsloth's link below (only one GPU).
|
| 20 |
-
Here's a simple usage example (raw output) - and remember, it is a primitive toy model using freely available compute.
|
| 21 |
|
| 22 |
```python
|
| 23 |
max_seq_length = 256
|
|
|
|
| 13 |
|
| 14 |
# This Model
|
| 15 |
This is a partially fine tuned Llama 3.1 8B LLM for poetry generation. It is based on a 10% of 1 epoch continued pretraining of the
|
| 16 |
+
[Llama 3.1 8B LLM](akhooli/llama31pretrained2). Training was done on [200k articles from Arabic Wikipedia 2023](akhooli/arwiki_128).
|
| 17 |
This is just a proof of concept demo and should never be used for production. It is also not aligned and is likely to produce strange and unaccepted content.
|
| 18 |
+
Only the adapter is available (along with other config files). To use it, you can either install Unsloth or use the HuggingFace PEFT API.
|
| 19 |
+
See installation instructions at the Unsloth's link below (only one GPU).
|
| 20 |
+
Here's a simple usage example (raw output) - and remember, it is a primitive toy model using freely available compute.
|
| 21 |
|
| 22 |
```python
|
| 23 |
max_seq_length = 256
|