Update README.md
Browse files
README.md
CHANGED
|
@@ -57,10 +57,6 @@ or
|
|
| 57 |
|
| 58 |
[Stanford Alpaca Dataset](https://github.com/tatsu-lab/stanford_alpaca/blob/main/alpaca_data.json)
|
| 59 |
|
| 60 |
-
### Training Procedure
|
| 61 |
-
|
| 62 |
-
Followed the guide [here](https://lightning.ai/pages/blog/falcon-a-guide-to-finetune-and-inference/)
|
| 63 |
-
|
| 64 |
|
| 65 |
#### Training Hyperparameters
|
| 66 |
|
|
@@ -79,6 +75,7 @@ warmup_iters = 50000
|
|
| 79 |
|
| 80 |
|
| 81 |
|
| 82 |
-
##
|
|
|
|
|
|
|
| 83 |
|
| 84 |
-
[More Information Needed]
|
|
|
|
| 57 |
|
| 58 |
[Stanford Alpaca Dataset](https://github.com/tatsu-lab/stanford_alpaca/blob/main/alpaca_data.json)
|
| 59 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 60 |
|
| 61 |
#### Training Hyperparameters
|
| 62 |
|
|
|
|
| 75 |
|
| 76 |
|
| 77 |
|
| 78 |
+
## More Information
|
| 79 |
+
|
| 80 |
+
[HeitechSoft](https://heitechsoft.com/blog/heitechsoft-s-falcon-7b-fine-tuned-model-paves-the-way-for-advanced-ai-chatbots)
|
| 81 |
|
|
|