Update README.md

README.md

@@ -22,7 +22,20 @@ It achieves the following results on the evaluation set:
 
 ## Model description
 
-More information needed
+```
+
+MODEL_NAME = "/content/blackhole33/llama-5000-sample-peft"
+quantization_config = BitsAndBytesConfig(
+    load_in_4bit=True, bnb_4bit_quant_type="nf4", bnb_4bit_compute_dtype=torch.bfloat16
+)
+
+tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME, use_fast=True)
+
+model = AutoModelForCausalLM.from_pretrained(
+    MODEL_NAME, quantization_config=quantization_config, device_map="auto"
+)
+
+```
 
 ## Intended uses & limitations