Update README.md
Browse files
README.md
CHANGED
|
@@ -116,7 +116,7 @@ base_model:
|
|
| 116 |
</div>
|
| 117 |
<div class="procedure">
|
| 118 |
<h2 class="section-title">Procedure</h2>
|
| 119 |
-
<p>The pretrained base model was fine-
|
| 120 |
</div>
|
| 121 |
<div class="data">
|
| 122 |
<h2 class="section-title">Data</h2>
|
|
|
|
| 116 |
</div>
|
| 117 |
<div class="procedure">
|
| 118 |
<h2 class="section-title">Procedure</h2>
|
| 119 |
+
<p>The pretrained base model was fine-tuned on instruct and roleplaying data in a single step. Once the supervised fine-tuning was complete, a Kahneman-Tversky optimization was applied as a final alignment step.</p>
|
| 120 |
</div>
|
| 121 |
<div class="data">
|
| 122 |
<h2 class="section-title">Data</h2>
|