Update README.md

README.md

@@ -1,3 +1,36 @@
 ---
 license: apache-2.0
+datasets:
+- daven3/geosignal
+language:
+- en
 ---
+
+# Adapter Model in K2
+
+## Quick Start
+
+**After deploying the model [k2_fp_delta](https://huggingface.co/daven3/k2_fp_delta), we need to use the `PEFT` API from `transformers` to load the entire K2!**
+
+```python
+base_model = /path/to/geollama
+lora_weights = /path/to/adapter/model
+tokenizer = LlamaTokenizer.from_pretrained(base_model)
+model = LlamaForCausalLM.from_pretrained(
+    base_model,
+    load_in_8bit=load_8bit,
+    device_map=device_map
+    torch_dtype=torch.float16
+)
+model = PeftModel.from_pretrained(
+    model,
+    lora_weights,
+    torch_dtype=torch.float16,
+    device_map=device_map,
+)
+model.config.pad_token_id = tokenizer.pad_token_id = 0
+model.config.bos_token_id = 1
+model.config.eos_token_id = 2
+```
+
+