I0u0I commited on
Commit
220442f
·
verified ·
1 Parent(s): 25d2e58

Simplify model card assets overview

Browse files
Files changed (1) hide show
  1. README.md +13 -33
README.md CHANGED
@@ -4,51 +4,31 @@ tags:
4
  - 3d
5
  - human-motion-generation
6
  - diffusion
 
7
  ---
8
 
9
  # DrawMotion: Generating 3D Human Motions by Freehand Drawing
10
 
11
- DrawMotion is an efficient diffusion-based framework designed for multi-condition scenarios, generating 3D human motions based on both conventional text conditions and a novel hand-drawing condition. This approach provides both semantic and spatial control over the generated motions.
12
 
13
  - **Paper:** [DrawMotion: Generating 3D Human Motions by Freehand Drawing](https://huggingface.co/papers/2605.20955)
14
  - **Repository:** [InvertedForest/DrawMotion](https://github.com/InvertedForest/DrawMotion)
15
  - **Demo Video:** [YouTube](https://youtu.be/sy2QTdDD09A)
16
 
17
- ## Overview
18
 
19
- Text-to-motion generation often faces challenges in precisely conveying intended motions through text alone. DrawMotion addresses this by introducing a multi-condition fusion module (MCM) that integrates text prompts with freehand stickman sketches and 2D trajectories. It also utilizes a training-free guidance strategy to align generated motions with user intentions while preserving fidelity.
20
 
21
- ## Sample Usage
22
 
23
- ### Prepare Weights
 
 
 
 
 
24
 
25
- You can download the required model assets from this repository using the `huggingface_hub` CLI:
26
-
27
- ```bash
28
- pip install -U huggingface_hub
29
- hf download I0u0I/DrawMotion \
30
- --local-dir . \
31
- --include "logs/human_ml3d/last.ckpt" \
32
- "mid_feat/t2m/mid_feat.pt" \
33
- "stickman/weight/real_init/t2m/stickman_encoder.ckpt"
34
- ```
35
-
36
- The model also requires the OpenAI CLIP text encoder:
37
- ```python
38
- import clip
39
- # Download the OpenAI CLIP text encoder used by DrawMotion.
40
- python -c 'import clip; clip.load("ViT-B/32", device="cpu")'
41
- ```
42
-
43
- ### Running the Web Demo
44
-
45
- To run the interactive DrawMotion experience locally, use the following command from the repository root:
46
-
47
- ```bash
48
- DRAWMOTION_CKPT=logs/human_ml3d/last.ckpt \
49
- DRAWMOTION_GPU=0 \
50
- uvicorn demo.drawmotion_studio.app:app --host 0.0.0.0 --port 12008
51
- ```
52
 
53
  ## Citation
54
 
@@ -63,4 +43,4 @@ If you find DrawMotion useful, please cite:
63
  pages={1--17},
64
  doi={10.1109/TPAMI.2026.3679530}
65
  }
66
- ```
 
4
  - 3d
5
  - human-motion-generation
6
  - diffusion
7
+ - arxiv:2605.20955
8
  ---
9
 
10
  # DrawMotion: Generating 3D Human Motions by Freehand Drawing
11
 
12
+ DrawMotion is a diffusion-based framework for generating 3D human motions from text and freehand drawing conditions, including 2D trajectories and stickman sketches.
13
 
14
  - **Paper:** [DrawMotion: Generating 3D Human Motions by Freehand Drawing](https://huggingface.co/papers/2605.20955)
15
  - **Repository:** [InvertedForest/DrawMotion](https://github.com/InvertedForest/DrawMotion)
16
  - **Demo Video:** [YouTube](https://youtu.be/sy2QTdDD09A)
17
 
18
+ ## Model Assets
19
 
20
+ This Hugging Face repository hosts the public model assets used by DrawMotion. For installation, web demo reproduction, training, and evaluation instructions, please refer to the GitHub repository.
21
 
22
+ Included assets:
23
 
24
+ - `logs/human_ml3d/last.ckpt`
25
+ - `mid_feat/t2m/mid_feat.pt`
26
+ - `stickman/weight/real_init/t2m/stickman_encoder.ckpt`
27
+ - `logs/kit_ml/last.ckpt`
28
+ - `mid_feat/kit/mid_feat.pt`
29
+ - `stickman/weight/kit_ml/split_weight/stickman_encoder.ckpt`
30
 
31
+ The current public web demo exposes text and trajectory control. Stickman-conditioned interaction is coming soon.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
32
 
33
  ## Citation
34
 
 
43
  pages={1--17},
44
  doi={10.1109/TPAMI.2026.3679530}
45
  }
46
+ ```