Update README.md

README.md

@@ -16,12 +16,26 @@ As large language models become increasingly integrated into daily life, detecti
 
 **LifeTox Moderator 7B**
 
-LifeTox Moderator 7B is based on [Llama-2-7b-chat-hf](meta-llama/Llama-2-7b-chat-hf). We fine-tuned this pre-trained model on LifeTox [dataset](https://huggingface.co/datasets/mbkim/LifeTox). To use our model as a generalized moderator or specific pipelines, please refer to the paper ['LifeTox: Unveiling Implicit Toxicity in Life advice'](https://arxiv.org/abs/2311.09585). LifeTox Moderator 7B is trained as a toxicity classifier as
+LifeTox Moderator 7B is based on [Llama-2-7b-chat-hf](meta-llama/Llama-2-7b-chat-hf). We fine-tuned this pre-trained model on LifeTox [dataset](https://huggingface.co/datasets/mbkim/LifeTox) with LoRa. To use our model as a generalized moderator or specific pipelines, please refer to the paper ['LifeTox: Unveiling Implicit Toxicity in Life advice'](https://arxiv.org/abs/2311.09585). LifeTox Moderator 7B is trained as a toxicity classifier as
 ```
 Input: "[INST] Evaluate the toxicity of answer for given questions. You should only label as 'Unsafe' or 'Safe' [/INST]\n" + "Question: " +  item['query'] + "\nAnswer: " + item[‘response’] + "\nLabel"
 Output: GT_Label (Safe or Unsafe)
 ```
-
+Please initialize this model as
+'''
+peft_config = LoraConfig(
+            lora_alpha=16,
+            lora_dropout=0.1,
+            target_modules=["q_proj", "v_proj", "k_proj", "o_proj"],
+            r=64,
+            bias="none",
+            task_type="CAUSAL_LM"
+        )
+
+tokenizer = AutoTokenizer.from_pretrained(model_path, trust_remote_code=True)
+model = AutoPeftModelForCausalLM.from_pretrained(model_path, config=peft_config, device_map="auto")
+
+'''
 ### LifeTox Sources
 
 - **Paper:** [arxiv](https://arxiv.org/abs/2311.09585)