Update README.md

README.md

@@ -1,3 +1,64 @@
----
-license: mit
----
+---
+license: mit
+language:
+- en
+- fr
+- de
+- es
+- it
+- pt
+- ja
+- ko
+- zh
+- ar
+- el
+- fa
+- pl
+- id
+- cs
+- he
+- hi
+- nl
+- ro
+- ru
+- tr
+- uk
+- vi
+---
+
+# Hormoz 8B 
+
+## Introduction
+
+## How to run (transformers)
+
+### Install transformers
+
+```
+pip install transformers --upgrade
+```
+
+_Note:_ For better performance, you may need to install `accelerate` package as well. 
+
+### Inference 
+
+```python
+from transformers import AutoTokenizer, AutoModelForCausalLM
+
+model_id = "mann-e/Hormoz-8B"
+tokenizer = AutoTokenizer.from_pretrained(model_id)
+model = AutoModelForCausalLM.from_pretrained(model_id).to("cuda")
+
+messages = [{"role": "user", "content": "What is the answer to universe, life and everything?"}]
+input_ids = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt").to("cuda")
+
+gen_tokens = model.generate(
+    input_ids, 
+    max_new_tokens=1024, 
+    do_sample=True, 
+    temperature=1.0,
+    )
+
+gen_text = tokenizer.decode(gen_tokens[0])
+print(gen_text)
+```