Update README.md
Browse files
README.md
CHANGED
|
@@ -5,13 +5,13 @@ datasets:
|
|
| 5 |
---
|
| 6 |
|
| 7 |
# Instruct_Phi2_Dolly15K
|
| 8 |
-
Fine-tuned from phi2,
|
| 9 |
|
| 10 |
# Model Details
|
| 11 |
* **Trained by**: trained by HenryJJ.
|
| 12 |
* **Model type:** **Instruct_Phi2_Dolly15K** is an auto-regressive language model based on the phi 2 transformer architecture.
|
| 13 |
* **Language(s)**: English
|
| 14 |
-
* **License for
|
| 15 |
|
| 16 |
|
| 17 |
# Prompting
|
|
|
|
| 5 |
---
|
| 6 |
|
| 7 |
# Instruct_Phi2_Dolly15K
|
| 8 |
+
Fine-tuned from phi2,used Dolly15k for the dataset. 90% for training, 10% validation. Trained for 2.0 epochs using QLora. Trained with 1024 context window.
|
| 9 |
|
| 10 |
# Model Details
|
| 11 |
* **Trained by**: trained by HenryJJ.
|
| 12 |
* **Model type:** **Instruct_Phi2_Dolly15K** is an auto-regressive language model based on the phi 2 transformer architecture.
|
| 13 |
* **Language(s)**: English
|
| 14 |
+
* **License for HenryJJ/Instruct_Phi2_Dolly15K**: apache-2.0 license
|
| 15 |
|
| 16 |
|
| 17 |
# Prompting
|