Add example Usage

README.md

@@ -5,9 +5,21 @@ tags: []
 
 # Model Card for Model ID
 
-<!-- Provide a quick summary of what the model is/does. -->
-
-
+## Usage
+```python
+from transformers import AutoTokenizer, T5ForConditionalGeneration, BitsAndBytesConfig
+import torch
+
+tokenizer = AutoTokenizer.from_pretrained("wisdominanutshell/coedit-xxl-8bit")
+model = T5ForConditionalGeneration.from_pretrained("wisdominanutshell/coedit-xxl-8bit", quantization_config=BitsAndBytesConfig(load_in_8bit=True))
+device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
+input_text = 'Fix grammatical errors in this sentence: When I graw up, I start to understand what he said is quite right.'
+input_ids = tokenizer(input_text, return_tensors="pt").input_ids.to(device)
+outputs = model.generate(input_ids, max_length=256)
+edited_text = tokenizer.decode(outputs[0], skip_special_tokens=True)
+
+print(edited_text)
+```
 
 ## Model Details