Upload folder using huggingface_hub
Browse files- BABEL_streamed.zip +3 -0
- HumanML3D.zip +3 -0
- README.md +99 -0
- deps.zip +3 -0
- outputs.zip +3 -0
BABEL_streamed.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a57f15499ae542faf21deeda43af1ebcb5b81fa892a18b9dc77f11ce1158e72b
|
| 3 |
+
size 4573050968
|
HumanML3D.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:de9a2b643e3fde06a2692ce4a96719369f36a0d538eb08388a4b3fb8462e9ff1
|
| 3 |
+
size 20245809673
|
README.md
ADDED
|
@@ -0,0 +1,99 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
library_name: generic
|
| 4 |
+
tags:
|
| 5 |
+
- motion-generation
|
| 6 |
+
- diffusion
|
| 7 |
+
- 3d
|
| 8 |
+
- humanml3d
|
| 9 |
+
- babel
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# FloodDiffusion Downloads
|
| 13 |
+
|
| 14 |
+
This repository contains the datasets, dependencies, and pretrained models for **FloodDiffusion: Tailored Diffusion Forcing for Streaming Motion Generation**.
|
| 15 |
+
|
| 16 |
+
Code repository: [GitHub](https://github.com/Shanda-AI/FloodDiffusion)
|
| 17 |
+
|
| 18 |
+
## Repository Structure
|
| 19 |
+
|
| 20 |
+
The files in this repository are organized to match the directory structure required by FloodDiffusion.
|
| 21 |
+
|
| 22 |
+
### 1. Model Checkpoints (`outputs.zip`)
|
| 23 |
+
The `outputs.zip` archive contains the pretrained model weights.
|
| 24 |
+
|
| 25 |
+
* **Target**: Unzip into your project root. It should create an `outputs/` folder.
|
| 26 |
+
|
| 27 |
+
```
|
| 28 |
+
outputs/
|
| 29 |
+
βββ vae_1d_z4_step=300000.ckpt # VAE model (1D, z_dim=4)
|
| 30 |
+
βββ 20251106_063218_ldf/
|
| 31 |
+
β βββ step_step=50000.ckpt # LDF model checkpoint (HumanML3D)
|
| 32 |
+
βββ 20251107_021814_ldf_stream/
|
| 33 |
+
βββ step_step=240000.ckpt # Streaming LDF model checkpoint (BABEL)
|
| 34 |
+
```
|
| 35 |
+
|
| 36 |
+
### 2. Datasets
|
| 37 |
+
Due to the large number of files, datasets are provided as ZIP archives.
|
| 38 |
+
|
| 39 |
+
* **`HumanML3D.zip`**: Contains the HumanML3D dataset (extracted features and texts).
|
| 40 |
+
* **Target**: Unzip into `raw_data/`. It should create `raw_data/HumanML3D/` containing `new_joint_vecs`, `texts`, etc.
|
| 41 |
+
* **`BABEL_streamed.zip`**: Contains the BABEL dataset processed for streaming generation.
|
| 42 |
+
* **Target**: Unzip into `raw_data/`. It should create `raw_data/BABEL_streamed/`.
|
| 43 |
+
|
| 44 |
+
### 3. Dependencies (`deps.zip`)
|
| 45 |
+
* **`deps.zip`**: Contains necessary dependencies like the T5 text encoder, evaluation models (T2M), and GloVe embeddings.
|
| 46 |
+
* **Target**: Unzip into your project root. It should create a `deps/` folder.
|
| 47 |
+
|
| 48 |
+
```
|
| 49 |
+
deps/
|
| 50 |
+
βββ t2m/ # Text-to-Motion evaluation models
|
| 51 |
+
βββ glove/ # GloVe word embeddings
|
| 52 |
+
βββ t5_umt5-xxl-enc-bf16/ # T5 text encoder
|
| 53 |
+
```
|
| 54 |
+
|
| 55 |
+
## How to Download & Setup
|
| 56 |
+
|
| 57 |
+
We recommend using the python script below to automatically download and place files in the correct structure.
|
| 58 |
+
|
| 59 |
+
### Python Script (Recommended)
|
| 60 |
+
|
| 61 |
+
Save this as `download_assets.py` in your `FloodDiffusion` project root:
|
| 62 |
+
|
| 63 |
+
```python
|
| 64 |
+
from huggingface_hub import hf_hub_download
|
| 65 |
+
import zipfile
|
| 66 |
+
import os
|
| 67 |
+
|
| 68 |
+
REPO_ID = "ShandaAI/FloodDiffusionDownloads"
|
| 69 |
+
|
| 70 |
+
def download_extract_zip(filename, target_dir="."):
|
| 71 |
+
print(f"Downloading {filename}...")
|
| 72 |
+
path = hf_hub_download(repo_id=REPO_ID, filename=filename, repo_type="model")
|
| 73 |
+
print(f"Extracting {filename} to {target_dir}...")
|
| 74 |
+
with zipfile.ZipFile(path, 'r') as zip_ref:
|
| 75 |
+
zip_ref.extractall(target_dir)
|
| 76 |
+
|
| 77 |
+
# 1. Download and extract Dependencies (creates ./deps/)
|
| 78 |
+
download_extract_zip("deps.zip", ".")
|
| 79 |
+
|
| 80 |
+
# 2. Download and extract Datasets (creates ./raw_data/HumanML3D and ./raw_data/BABEL_streamed)
|
| 81 |
+
os.makedirs("raw_data", exist_ok=True)
|
| 82 |
+
download_extract_zip("HumanML3D.zip", "raw_data")
|
| 83 |
+
download_extract_zip("BABEL_streamed.zip", "raw_data")
|
| 84 |
+
|
| 85 |
+
# 3. Download Models (creates ./outputs/)
|
| 86 |
+
download_extract_zip("outputs.zip", ".")
|
| 87 |
+
|
| 88 |
+
print("Done! Your project is ready.")
|
| 89 |
+
```
|
| 90 |
+
|
| 91 |
+
## Data License & Acknowledgements
|
| 92 |
+
|
| 93 |
+
This repository provides pre-processed motion features (263-dim) to facilitate the reproduction of FloodDiffusion.
|
| 94 |
+
|
| 95 |
+
- **HumanML3D**: The motion features are derived from the [HumanML3D](https://github.com/EricGuo5513/HumanML3D) pipeline, originally built upon [AMASS](https://amass.is.tue.mpg.de/) and [HumanAct12](https://github.com/guhemian/HumanAct12).
|
| 96 |
+
- **BABEL**: The streaming motion features are derived from the [BABEL](https://babel.is.tue.mpg.de/) dataset, which also builds upon AMASS.
|
| 97 |
+
|
| 98 |
+
**Important Note**:
|
| 99 |
+
We only distribute the **extracted motion features and text annotations**, which is standard practice in the research community. We do **not** distribute the raw AMASS data (SMPL parameters/meshes). If you require the raw motion data or plan to use it for commercial purposes, you must register and agree to the licenses on the [AMASS website](https://amass.is.tue.mpg.de/).
|
deps.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bd12f617474bf9f2a4321308b6ee3697b34b11a4ce77f47ff7d50db0d6fe7d85
|
| 3 |
+
size 12992154753
|
outputs.zip
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:20995d1c0e9f6dee98a1eacdd3be6fadae120642c61aed38a7368e08fb906758
|
| 3 |
+
size 5250192356
|