Instructions to use CompVis/WhatMoves with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Wan2.2
How to use CompVis/WhatMoves with Wan2.2:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Ressler-Antal commited on
Commit ·
60bdbc0
1
Parent(s): 31820f6
Updated README
Browse files
README.md
CHANGED
|
@@ -1,3 +1,42 @@
|
|
| 1 |
---
|
| 2 |
-
license:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: mixed-mit-and-apache-2.0
|
| 4 |
+
license_link: https://github.com/CompVis/WhatMoves/blob/main/THIRD_PARTY_NOTICES.md
|
| 5 |
+
library_name: pytorch
|
| 6 |
+
pipeline_tag: image-to-video
|
| 7 |
+
tags:
|
| 8 |
+
- motion-representation
|
| 9 |
+
- motion-transfer
|
| 10 |
+
- wan2.2
|
| 11 |
---
|
| 12 |
+
|
| 13 |
+
# WhatMoves checkpoints
|
| 14 |
+
|
| 15 |
+
Released checkpoints for [WhatMoves](https://github.com/CompVis/WhatMoves), a
|
| 16 |
+
promptable model for localized motion representations and transfer.
|
| 17 |
+
|
| 18 |
+
| File | Contents |
|
| 19 |
+
|---|---|
|
| 20 |
+
| `what_moves/gated_static_step600000.pt` | Compact inference checkpoint for the WhatMoves motion encoder |
|
| 21 |
+
| `wan/gated_static_step600000/adapter_step30500.pt` | Motion projector and LoRA deltas for Wan2.2 I2V-A14B |
|
| 22 |
+
| `wan/gated_static_step600000/metadata.json` | Architecture, provenance, and SHA-256 metadata |
|
| 23 |
+
|
| 24 |
+
The source repository provides the model definitions and Torch Hub entrypoints;
|
| 25 |
+
these files are not intended to be loaded with a generic Diffusers pipeline.
|
| 26 |
+
|
| 27 |
+
## Licensing
|
| 28 |
+
|
| 29 |
+
This repository contains mixed-license model artifacts:
|
| 30 |
+
|
| 31 |
+
- Original WhatMoves parameters are released under the MIT License.
|
| 32 |
+
- The WhatMoves checkpoint incorporates parameters initialized from
|
| 33 |
+
[DINOv2](https://github.com/facebookresearch/dinov2), licensed under Apache
|
| 34 |
+
License 2.0.
|
| 35 |
+
- The motion-transfer adapter is designed to operate over
|
| 36 |
+
[Wan2.2 I2V-A14B](https://huggingface.co/Wan-AI/Wan2.2-I2V-A14B), whose code
|
| 37 |
+
and base weights are licensed under Apache License 2.0. The base Wan weights
|
| 38 |
+
are not redistributed here.
|
| 39 |
+
|
| 40 |
+
The MIT license does not supersede the licenses or notices of the upstream
|
| 41 |
+
components. See the source repository's `LICENSE`, `THIRD_PARTY_NOTICES.md`,
|
| 42 |
+
and bundled Apache License 2.0 text for the complete notices.
|