Update README.md

README.md

@@ -125,4 +125,36 @@ Downloading shards: 100%|██████████████████
 Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████████| 2/2 [00:08<00:00,  4.05s/it]
 Setting `pad_token_id` to `eos_token_id`:128001 for open-end generation.
  The percentage change of the net income from Q4 FY23 to Q4 FY24 is 769%. This is calculated by taking the difference between the two net incomes ($12,285 million and $1,414 million) and dividing it by the net income from Q4 FY23 ($1,414 million), then multiplying by 100 to get the percentage change. So, the formula is ((12,285 - 1,414) / 1,414) * 100 = 769%.
+```
+
+Sample run on classification tasks, positive labelling still works
+
+```
+import torch
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+model_id = "saucam/PowerBot-8B"
+tokenizer = AutoTokenizer.from_pretrained(model_id)
+model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype=torch.float16, device_map="auto")
+
+messages = [{"role": "user", "content": "Is this comment toxic or non-toxic: RefuelLLM is the new way to label text data!"}]
+
+inputs = tokenizer.apply_chat_template(messages, return_tensors="pt", add_generation_prompt=True).to("cuda")
+
+outputs = model.generate(inputs, max_new_tokens=20)
+print(tokenizer.decode(outputs[0]))
+```
+
+```
+Loading checkpoint shards: 100%|██████████████████████████████████████████████████████████████| 2/2 [00:07<00:00,  3.89s/it]
+
+No chat template is defined for this tokenizer - using a default chat template that implements the ChatML format (without BOS/EOS tokens!). If the default is not appropriate for your model, please set `tokenizer.chat_template` to an appropriate template. See https://huggingface.co/docs/transformers/main/chat_templating for more information.
+
+The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.
+Setting `pad_token_id` to `eos_token_id`:128001 for open-end generation.
+<|im_start|>user
+Is this comment toxic or non-toxic: RefuelLLM is the new way to label text data!<|im_end|>
+<|im_start|>assistant
+This comment is non-toxic.
+<|im_end|><|end_of_text|>
 ```