Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
A straightforward implementation of the final **Self-Alignment model**, inspired by the paper "Self-Alignment with Instruction Backtranslation."
|
| 2 |
+
|
| 3 |
+
This model was fine-tuned on LLaMA-2-hf using **self-curation LIMA dataset** with high-quality sythetic (Instruction, Answer) pairs.
|
| 4 |
+
|
| 5 |
+
The fine-tuning process was conducted using LoRA, and the uploaded model is provided in its **merged** form.
|