Update README.md

README.md

@@ -1,3 +1,36 @@
+---
+language:
+- en
+library_name: transformers
+base_model: meta-llama/Llama-3.2-3B-Instruct
+base_model_relation: finetune
+tags:
+- llama
+- chatgpt-prompts
+- role-playing
+- instruction-tuning
+- conversational
+- lora
+- peft
+license: llama3.2
+datasets:
+- fka/awesome-chatgpt-prompts
+pipeline_tag: text-generation
+model-index:
+- name: Llama-3.2-3B-ChatGPT-Prompts-Instruct
+  results:
+  - task:
+      type: text-generation
+      name: Text Generation
+    dataset:
+      name: awesome-chatgpt-prompts
+      type: fka/awesome-chatgpt-prompts
+    metrics:
+    - name: Training Loss
+      type: loss
+      value: 0.28
+---
+
 # Llama-3.2-3B-ChatGPT-Prompts-Instruct
 
 ## Model Description
@@ -37,16 +70,41 @@ This is a fine-tuned version of Meta's Llama-3.2-3B-Instruct model, specifically
 
 ```python
 from transformers import AutoTokenizer, AutoModelForCausalLM
+import torch
 
 model_name = "sweatSmile/Llama-3.2-3B-ChatGPT-Prompts-Instruct"
 tokenizer = AutoTokenizer.from_pretrained(model_name)
-model = AutoModelForCausalLM.from_pretrained(model_name)
+model = AutoModelForCausalLM.from_pretrained(
+    model_name,
+    torch_dtype=torch.float16,
+    device_map="auto"
+)
 
 # Example usage
 prompt = "Linux Terminal"
-inputs = tokenizer(prompt, return_tensors="pt")
-outputs = model.generate(**inputs, max_length=512, temperature=0.7)
-response = tokenizer.decode(outputs[0], skip_special_tokens=True)
+messages = [
+    {"role": "user", "content": prompt}
+]
+
+# Apply chat template
+formatted_prompt = tokenizer.apply_chat_template(
+    messages, 
+    tokenize=False, 
+    add_generation_prompt=True
+)
+
+inputs = tokenizer(formatted_prompt, return_tensors="pt")
+with torch.no_grad():
+    outputs = model.generate(
+        **inputs,
+        max_new_tokens=512,
+        temperature=0.7,
+        do_sample=True,
+        pad_token_id=tokenizer.eos_token_id
+    )
+
+response = tokenizer.decode(outputs[0][inputs['input_ids'].shape[1]:], skip_special_tokens=True)
+print(response)
 ```
 
 ## Intended Use
@@ -88,12 +146,12 @@ The model excels at:
 - The model should not be used to impersonate real individuals or for deceptive purposes
 - Always disclose when content is AI-generated in professional or public contexts
 
-## Technical Specifications
-
-- **Framework:** Transformers, PEFT
-- **Precision:** FP16
-- **Memory Optimization:** Gradient checkpointing enabled
-- **Hardware Requirements:** GPU recommended for inference
+## Framework Versions
+- **Transformers:** 4.x
+- **PyTorch:** 2.x
+- **PEFT:** Latest
+- **Datasets:** Latest
+- **Tokenizers:** Latest
 
 ## License