Update README.md

README.md

@@ -1,7 +1,7 @@
 ---
 base_model: akhooli/llama31pretrained2
 language:
-- en
+- ar
 license: apache-2.0
 tags:
 - text-generation-inference
@@ -11,16 +11,17 @@ tags:
 - trl
 ---
 
-# This Model 
-This is a partially fine tuned Llama 3.1 8B LLM for poetry generation. It is based on a 10% of 1 epoch continued pretraining of the 
-[Llama 3.1 8B LLM](akhooli/llama31pretrained2). Training was done on [200k articles from Arabic Wikipedia 2023](akhooli/arwiki_128).  
+# This Model (toy Arabic classical poetry llm)
+This is a partially (one epoch, subset of Arabic classical poetry dataset) fine tuned Llama 3.1 8B LLM for poetry generation. It is based on a 10% of 1 epoch continued pretraining of the 
+[Llama 3.1 8B LLM](akhooli/llama31pretrained2). Training was done on [200k articles from Arabic Wikipedia 2023](akhooli/arwiki_128) 
+with article lengh in the range 128 - 8192 words (not tokens).  
 This is just a proof of concept demo and should never be used for production. It is also not aligned and is likely to produce strange and unaccepted content. 
 Only the adapter is available (along with other config files). To use it, you can either install Unsloth or use the HuggingFace PEFT API.  
 See installation instructions at the Unsloth's link below (only one GPU).  
 See the [LinkedIn Post](https://www.linkedin.com/posts/akhooli_a-toy-arabic-poetry-llm-finally-i-am-sharing-activity-7242053356062466048-xRUq)   
 and [X tweet](https://x.com/akhooli/status/1836307030488895886)
 
-Here's a simple usage example (raw output) - and remember, it is a primitive toy model using freely available compute. 
+Here's a simple usage example (raw output) - and remember, it is a __primitive toy model__ using freely available compute. 
 
 ```python
 max_seq_length = 256
@@ -72,4 +73,4 @@ pprint(r)
 
 This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
-[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
+[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)