Update README.md

README.md

@@ -8,8 +8,10 @@ language:
 pipeline_tag: text-generation
 ---
 ## Anacondia
-Anacondia is a Pythia model fine-tuned using QLoRA on an instruction dataset
+Anacondia-70m is a Pythia-70m-deduped model fine-tuned with QLoRA on [timdettmers/openassistant-guanaco](https://huggingface.co/datasets/timdettmers/openassistant-guanaco)
 
+## Usage
+Anacondia is not intended for any real usage and was trained for educational purposes. Please consider more serious models for inference.
 
 ## Training procedure
 
@@ -27,4 +29,24 @@ The following `bitsandbytes` quantization config was used during training:
 ### Framework versions
 
 
-- PEFT 0.4.0
+- PEFT 0.4.0
+
+## Inference
+
+```python
+
+#import necessary modules
+from transformers import AutoTokenizer, AutoModelForCausalLM
+import torch
+
+model_id = "UncleanCode/anacondia-70m"
+
+tokenizer = AutoTokenizer.from_pretrained(model_id)
+model = AutoModelForCausalLM.from_pretrained(model_id)
+
+input= tokenizer("This is a sentence ",return_tensors="pt")
+output= model.generate(**input)
+
+tokenizer.decode(output[0])
+
+```