Update README.md

README.md

@@ -38,12 +38,29 @@ ZAYA1-base performs extremely competitively against other base models of a simil
 
 ### Prerequisites
 
-TODO instructions to use our branch
+To use ZAYA1, install `zaya` branch from our fork of `transformers` library, which is based on the v4.57.1 of `transformers`:  
+```bash
+pip install "transformers @ git+https://github.com/Zyphra/transformers.git@zaya"
+```
 
+The command above relies on requirements for `transformers v4.57.1` being installed in your environment. If you're installing in a fresh Python environment, you might want to specify a specific extra, like `[dev-torch]`, to install all the dependencies:  
+```bash
+pip install "transformers[dev-torch] @ git+https://github.com/Zyphra/transformers.git@zaya"
+```
 
 
 ### Inference
 
-TODO
+```python
+from transformers import AutoTokenizer, AutoModelForCausalLM
+import torch
 
+tokenizer = AutoTokenizer.from_pretrained("Zyphra/ZAYA1-base")
+model = AutoModelForCausalLM.from_pretrained("Zyphra/ZAYA1-base", device_map="cuda", dtype=torch.bfloat16)
 
+input_text = "What factors contributed to the fall of the Roman Empire?"
+input_ids = tokenizer(input_text, return_tensors="pt").to("cuda")
+
+outputs = model.generate(**input_ids, max_new_tokens=100)
+print(tokenizer.decode(outputs[0]))
+```