Update README.md

README.md

@@ -7,6 +7,10 @@ language:
 pipeline_tag: text-generation
 ---
 
+**Explanation**
+- Merge two base models using [mergekit](https://github.com/arcee-ai/mergekit) (slerp)
+- Apply DPO to the merged model, just an adapter part is saved
+- merge the adpater and the merged model
 
 **Base Model**
 - [upstage/SOLAR-10.7B-Instruct-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-Instruct-v1.0)
@@ -15,11 +19,6 @@ pipeline_tag: text-generation
 **Training Corpus**
 - [Intel/orca_dpo_pairs](https://huggingface.co/datasets/Intel/orca_dpo_pairs)
 
-**Explanation**
-- Merge two base models using [mergekit](https://github.com/arcee-ai/mergekit) (slerp)
-- Apply DPO to the merged model, just an adapter part is saved
-- merge the adpater and the merged model
-
 **Merge Script**
 ```
 slices:
@@ -45,21 +44,9 @@ dtype: float16
 |:---:|:---:|:---:|:---:|:---:|:---:|:---:|
 |65.96|63.91|84.58|63.18|51.49|82|50.57|
 
-**Usage**
-```python
-from transformers import AutoModelForCausalLM, AutoTokenizer, BitsAndBytesConfig
-model = AutoModelForCausalLM.from_pretrained(
-        "dddsaty/SOLAR_Merge_Adapter_DPO_Orca",
-        low_cpu_mem_usage = True,
-        torch_dtype = torch.float16,
-        device_map = device_map,
-    )
-
-tokenizer = AutoTokenizer.from_pretrained("dddsaty/SOLAR_Merge_Adapter_DPO_Orca")
-```
-
 **Log**
 - 2024.02.05: Initial version Upload
+- 2024.02.10: Readme update
 
 **LICENSE**  
 Following the upstage/SOLAR-10.7B-Instruct-v1.0 License