Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
This is a fine-tuning of the LLaMa13B model in the style of the Alpaca dataset and setting but using LoRa.
|
| 2 |
+
|
| 3 |
+
For details of the data and hyper params - https://crfm.stanford.edu/2023/03/13/alpaca.html
|
| 4 |
+
|
| 5 |
+
This repo only contains the LoRa weights and not the original LLaMa weights which are research only.
|