ErnestBeckham commited on
Commit
6d5b4be
·
verified ·
1 Parent(s): ac884f2

Phase 1 checkpoint, epoch 39

Browse files
Files changed (1) hide show
  1. phase1_mamba_10m/README.md +83 -0
phase1_mamba_10m/README.md ADDED
@@ -0,0 +1,83 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mmm
3
+ tags:
4
+ - motion-matching
5
+ - character-animation
6
+ - state-space-model
7
+ - mamba
8
+ ---
9
+
10
+ # MMM-versions
11
+
12
+ State space model for real time character animation: a Mamba backbone that
13
+ takes a joystick request and its own previous pose, and predicts the next
14
+ pose. There is no retrieval in the input.
15
+
16
+ This is a **Phase 1** checkpoint (pre-training on mocap).
17
+
18
+ The database this checkpoint was trained against:
19
+
20
+ | | |
21
+ | --- | --- |
22
+ | fingerprint | `9eedcabf407c9605` |
23
+ | rows (frames) | 962,891 |
24
+ | pose width | 151 |
25
+ | frame time | 0.016666666666666666 s |
26
+ | clips | 77 (aiming1_subject1, aiming1_subject4, aiming2_subject2, aiming2_subject3...) |
27
+
28
+ The database is built from LaFAN1 and is **not** distributed here. Rebuild it
29
+ with `scripts/build_databases.py`; the fingerprint above must match, or the
30
+ retrieved poses are in a different space from the ones the model learned on.
31
+
32
+ ## Architecture
33
+
34
+ | | |
35
+ | --- | --- |
36
+ | backbone | MambaBackbone |
37
+ | n_layers | 6 |
38
+ | d_model | 512 |
39
+ | d_state | 16 |
40
+ | d_conv | 4 |
41
+ | d_inner | 1024 |
42
+ | head | full |
43
+ | pose_dim | 151 |
44
+ | joystick_dim | 12 |
45
+ | input_dim | 163 |
46
+ | output_dim | 153 |
47
+ | predict_contacts | True |
48
+ | parameters | 10,334,361 |
49
+ | n_heads | None |
50
+ | window | None |
51
+
52
+ ## Training
53
+
54
+ | epoch | train | validation |
55
+ | --- | --- | --- |
56
+ | 1 (first) | 1.1930 | 0.6068 |
57
+ | 5 (best) | 0.2292 | 0.2349 |
58
+ | 49 (last) | 0.2854 | 0.2834 |
59
+
60
+ Trained for 49 epochs.
61
+
62
+ ## Provenance
63
+
64
+ - Rotation maths cross validated against GenoViewPython's `quat.py`
65
+ (MIT, Copyright (c) 2024 Daniel Holden) to 1e-9.
66
+ - Spring damper after Holden, *Spring-It-On*; inertialization after Bollo,
67
+ GDC 2018; 6D rotations after Zhou et al., CVPR 2019.
68
+ - Learned Motion Matching (Holden et al., SIGGRAPH 2020) is background and
69
+ baseline for this work, not its architecture.
70
+
71
+ See `NOTICE.md` in the source repository for the full attribution.
72
+
73
+ ## Format
74
+
75
+ `safetensors`, with the run's architecture, config and calibrated loss weights
76
+ JSON encoded in the metadata header. No pickle is involved in loading.
77
+
78
+ ```python
79
+ from safetensors import safe_open
80
+
81
+ with safe_open("best.safetensors", framework="pt") as f:
82
+ print(f.metadata()["architecture"])
83
+ ```