End of training
Browse files- README.md +75 -0
- checkpoint-1000/optimizer.bin +3 -0
- checkpoint-1000/pytorch_lora_weights.safetensors +3 -0
- checkpoint-1000/random_states_0.pkl +3 -0
- checkpoint-1000/scaler.pt +3 -0
- checkpoint-1000/scheduler.bin +3 -0
- checkpoint-2000/optimizer.bin +3 -0
- checkpoint-2000/pytorch_lora_weights.safetensors +3 -0
- checkpoint-2000/random_states_0.pkl +3 -0
- checkpoint-2000/scaler.pt +3 -0
- checkpoint-2000/scheduler.bin +3 -0
- pytorch_lora_weights.safetensors +3 -0
- test_video_0_zlkwdnk_liquid_art_of_A_v.mp4 +0 -0
- test_video_0_zlkwdnk_liquid_art_of_a_c.mp4 +0 -0
- validation_video_0_zlkwdnk_liquid_art_of_A_v.mp4 +0 -0
- validation_video_0_zlkwdnk_liquid_art_of_a_c.mp4 +0 -0
README.md
ADDED
|
@@ -0,0 +1,75 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
base_model: THUDM/CogVideoX-2b
|
| 3 |
+
library_name: diffusers
|
| 4 |
+
license: other
|
| 5 |
+
tags:
|
| 6 |
+
- text-to-video
|
| 7 |
+
- diffusers-training
|
| 8 |
+
- diffusers
|
| 9 |
+
- lora
|
| 10 |
+
- cogvideox
|
| 11 |
+
- cogvideox-diffusers
|
| 12 |
+
- template:sd-lora
|
| 13 |
+
widget: []
|
| 14 |
+
---
|
| 15 |
+
|
| 16 |
+
<!-- This model card has been generated automatically according to the information the training script had access to. You
|
| 17 |
+
should probably proofread and complete it, then remove this comment. -->
|
| 18 |
+
|
| 19 |
+
|
| 20 |
+
# CogVideoX LoRA - Zlikwid/ZlikwidCogVideoXLoRa
|
| 21 |
+
|
| 22 |
+
<Gallery />
|
| 23 |
+
|
| 24 |
+
## Model description
|
| 25 |
+
|
| 26 |
+
These are Zlikwid/ZlikwidCogVideoXLoRa LoRA weights for THUDM/CogVideoX-2b.
|
| 27 |
+
|
| 28 |
+
The weights were trained using the [CogVideoX Diffusers trainer](https://github.com/huggingface/diffusers/blob/main/examples/cogvideo/train_cogvideox_lora.py).
|
| 29 |
+
|
| 30 |
+
Was LoRA for the text encoder enabled? No.
|
| 31 |
+
|
| 32 |
+
## Download model
|
| 33 |
+
|
| 34 |
+
[Download the *.safetensors LoRA](Zlikwid/ZlikwidCogVideoXLoRa/tree/main) in the Files & versions tab.
|
| 35 |
+
|
| 36 |
+
## Use it with the [🧨 diffusers library](https://github.com/huggingface/diffusers)
|
| 37 |
+
|
| 38 |
+
```py
|
| 39 |
+
from diffusers import CogVideoXPipeline
|
| 40 |
+
import torch
|
| 41 |
+
|
| 42 |
+
pipe = CogVideoXPipeline.from_pretrained("THUDM/CogVideoX-5b", torch_dtype=torch.bfloat16).to("cuda")
|
| 43 |
+
pipe.load_lora_weights("Zlikwid/ZlikwidCogVideoXLoRa", weight_name="pytorch_lora_weights.safetensors", adapter_name=["cogvideox-lora"])
|
| 44 |
+
|
| 45 |
+
# The LoRA adapter weights are determined by what was used for training.
|
| 46 |
+
# In this case, we assume `--lora_alpha` is 32 and `--rank` is 64.
|
| 47 |
+
# It can be made lower or higher from what was used in training to decrease or amplify the effect
|
| 48 |
+
# of the LoRA upto a tolerance, beyond which one might notice no effect at all or overflows.
|
| 49 |
+
pipe.set_adapters(["cogvideox-lora"], [32 / 64])
|
| 50 |
+
|
| 51 |
+
video = pipe("None", guidance_scale=6, use_dynamic_cfg=True).frames[0]
|
| 52 |
+
```
|
| 53 |
+
|
| 54 |
+
For more details, including weighting, merging and fusing LoRAs, check the [documentation on loading LoRAs in diffusers](https://huggingface.co/docs/diffusers/main/en/using-diffusers/loading_adapters)
|
| 55 |
+
|
| 56 |
+
## License
|
| 57 |
+
|
| 58 |
+
Please adhere to the licensing terms as described [here](https://huggingface.co/THUDM/CogVideoX-5b/blob/main/LICENSE) and [here](https://huggingface.co/THUDM/CogVideoX-2b/blob/main/LICENSE).
|
| 59 |
+
|
| 60 |
+
|
| 61 |
+
## Intended uses & limitations
|
| 62 |
+
|
| 63 |
+
#### How to use
|
| 64 |
+
|
| 65 |
+
```python
|
| 66 |
+
# TODO: add an example code snippet for running this diffusion pipeline
|
| 67 |
+
```
|
| 68 |
+
|
| 69 |
+
#### Limitations and bias
|
| 70 |
+
|
| 71 |
+
[TODO: provide examples of latent issues and potential remediations]
|
| 72 |
+
|
| 73 |
+
## Training details
|
| 74 |
+
|
| 75 |
+
[TODO: describe the data used to train the model]
|
checkpoint-1000/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3fe97c47fe955f6b352371ef23c2780735b244d29a48ee36f00c9a459bff0c09
|
| 3 |
+
size 60186810
|
checkpoint-1000/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7c80c5cc6135f480dba007196cd8c877a912339196c99168cdd344c31d801b2b
|
| 3 |
+
size 117996224
|
checkpoint-1000/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:2fffe0ac9d80271d0c3a62f28a7b2ef71e05f3c2d042d41c6fbebde848bd5d93
|
| 3 |
+
size 14604
|
checkpoint-1000/scaler.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9d8fdcd0311eba9854fff738038ed4c1a269832665b4d88ba4e4e3d02a1a7e0e
|
| 3 |
+
size 988
|
checkpoint-1000/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e28cc7d09de3334ca2ec47037c0d83a6e236487735944c263910f5ac3f538447
|
| 3 |
+
size 1000
|
checkpoint-2000/optimizer.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b08d3c7e4e829336a802852cb45a469d017b2b3058e75e78a45dd27d4ff3892c
|
| 3 |
+
size 60186810
|
checkpoint-2000/pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b112a9a983a2d6508f2d2df01abd491e612ccb54ce4d847607e8f7ac512f65c4
|
| 3 |
+
size 117996224
|
checkpoint-2000/random_states_0.pkl
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bbc8cac79c7c5d01257e51b41b8b6f8aacb8f0323849756532005ac052ce63c0
|
| 3 |
+
size 14604
|
checkpoint-2000/scaler.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3c50a9cebe5d66d453d25b140738bff479749ac03e0a43597d8776bc22f6ed0c
|
| 3 |
+
size 988
|
checkpoint-2000/scheduler.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:db91deb01f551b2babf95ab15f5e7133a5b5c9433697afb0d19c24ab40042d5e
|
| 3 |
+
size 1000
|
pytorch_lora_weights.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:18d333c06cb38574c0dfe09284969040c8b3a75412bd25ebf359ec7d032d63f3
|
| 3 |
+
size 59013712
|
test_video_0_zlkwdnk_liquid_art_of_A_v.mp4
ADDED
|
Binary file (425 kB). View file
|
|
|
test_video_0_zlkwdnk_liquid_art_of_a_c.mp4
ADDED
|
Binary file (555 kB). View file
|
|
|
validation_video_0_zlkwdnk_liquid_art_of_A_v.mp4
ADDED
|
Binary file (504 kB). View file
|
|
|
validation_video_0_zlkwdnk_liquid_art_of_a_c.mp4
ADDED
|
Binary file (621 kB). View file
|
|
|