Spaces:
Running
Running
Upload lora_finetune.ipynb
Browse files- lora_finetune.ipynb +5 -29
lora_finetune.ipynb
CHANGED
|
@@ -478,30 +478,6 @@
|
|
| 478 |
"## Train! 🧪"
|
| 479 |
]
|
| 480 |
},
|
| 481 |
-
{
|
| 482 |
-
"cell_type": "markdown",
|
| 483 |
-
"id": "733a8ebd-bcc0-4b41-92b4-e95c2e91d363",
|
| 484 |
-
"metadata": {
|
| 485 |
-
"id": "733a8ebd-bcc0-4b41-92b4-e95c2e91d363",
|
| 486 |
-
"pycharm": {
|
| 487 |
-
"name": "#%% md\n"
|
| 488 |
-
},
|
| 489 |
-
"tags": []
|
| 490 |
-
},
|
| 491 |
-
"source": [
|
| 492 |
-
"### `Diffusers` 🧨 Training loop"
|
| 493 |
-
]
|
| 494 |
-
},
|
| 495 |
-
{
|
| 496 |
-
"cell_type": "markdown",
|
| 497 |
-
"id": "72b2491e-16fe-4b0c-bb50-41db70766c7b",
|
| 498 |
-
"metadata": {
|
| 499 |
-
"id": "72b2491e-16fe-4b0c-bb50-41db70766c7b"
|
| 500 |
-
},
|
| 501 |
-
"source": [
|
| 502 |
-
"### Launch training 🚀🚀🚀"
|
| 503 |
-
]
|
| 504 |
-
},
|
| 505 |
{
|
| 506 |
"cell_type": "markdown",
|
| 507 |
"id": "6dbd7ec5-d4e2-470f-97f2-011a30d04e63",
|
|
@@ -509,11 +485,11 @@
|
|
| 509 |
"id": "6dbd7ec5-d4e2-470f-97f2-011a30d04e63"
|
| 510 |
},
|
| 511 |
"source": [
|
| 512 |
-
"**
|
| 513 |
-
"
|
| 514 |
-
"The
|
| 515 |
"\n",
|
| 516 |
-
"
|
| 517 |
]
|
| 518 |
},
|
| 519 |
{
|
|
@@ -535,7 +511,7 @@
|
|
| 535 |
"id": "78325966",
|
| 536 |
"metadata": {},
|
| 537 |
"source": [
|
| 538 |
-
"
|
| 539 |
]
|
| 540 |
},
|
| 541 |
{
|
|
|
|
| 478 |
"## Train! 🧪"
|
| 479 |
]
|
| 480 |
},
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 481 |
{
|
| 482 |
"cell_type": "markdown",
|
| 483 |
"id": "6dbd7ec5-d4e2-470f-97f2-011a30d04e63",
|
|
|
|
| 485 |
"id": "6dbd7ec5-d4e2-470f-97f2-011a30d04e63"
|
| 486 |
},
|
| 487 |
"source": [
|
| 488 |
+
"**Adjust your LoRA rank**\n",
|
| 489 |
+
"\n",
|
| 490 |
+
"The rank determines how expressive your LoRA will be. Higher ranks bring it closer to standard DreamBooth, offering more expressive capabilities but also increasing the model’s size.\n",
|
| 491 |
"\n",
|
| 492 |
+
"A recommend rank is between 8 and 64 based on your concept and your priority to balance expressiveness with a smaller LoRA size."
|
| 493 |
]
|
| 494 |
},
|
| 495 |
{
|
|
|
|
| 511 |
"id": "78325966",
|
| 512 |
"metadata": {},
|
| 513 |
"source": [
|
| 514 |
+
"Free some memory if needed"
|
| 515 |
]
|
| 516 |
},
|
| 517 |
{
|