Nano-prime commited on
Commit
42f735f
·
0 Parent(s):

Add ComplexityDiT checkpoint

Browse files
Files changed (4) hide show
  1. .gitattributes +35 -0
  2. README.md +59 -0
  3. complexity-dit.safetensors +3 -0
  4. config.json +20 -0
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,59 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ ---
4
+
5
+ # ComplexityDiT - Diffusion Transformer with INL Dynamics
6
+
7
+ Diffusion Transformer enhanced with PID-style dynamics control for smoother denoising.
8
+
9
+ ## Architecture
10
+
11
+ ```
12
+ Input -> [Attention -> MLP -> Dynamics] x 12 -> Output
13
+ ```
14
+
15
+ **Core equations:**
16
+ - Attention: `softmax(QK^T/sqrt(d)) * V`
17
+ - MLP: `W2 * GELU(W1 * x)`
18
+ - Dynamics: `h += dt * gate * (alpha*v - beta*(h - mu))`
19
+
20
+ ## Model Details
21
+
22
+ | Parameter | Value |
23
+ |-----------|-------|
24
+ | Architecture | ComplexityDiT-S |
25
+ | Parameters | 114M |
26
+ | Layers | 12 |
27
+ | Hidden dim | 384 |
28
+ | Heads | 6 |
29
+ | Experts | 4 |
30
+ | Dynamics | Enabled |
31
+
32
+ ## Training
33
+
34
+ - Dataset: huggan/wikiart
35
+ - Steps: 20,000
36
+ - Batch size: 16
37
+ - Mixed precision: FP16
38
+
39
+ ## Usage
40
+
41
+ ```python
42
+ from safetensors.torch import load_file
43
+ from complexity_diffusion import ComplexityDiT
44
+
45
+ # Load model
46
+ model = ComplexityDiT.from_config('S', context_dim=768)
47
+ state_dict = load_file('model.safetensors')
48
+ model.load_state_dict(state_dict)
49
+ ```
50
+
51
+ ## INL Dynamics
52
+
53
+ The dynamics layer adds robotics-grade control to stabilize denoising trajectories:
54
+ - `mu` - learnable equilibrium (target position)
55
+ - `alpha` - inertia (momentum)
56
+ - `beta` - correction strength (spring constant)
57
+ - `gate` - amplitude control
58
+
59
+ This creates smooth, stable trajectories like a PID controller guiding the model toward clean images.
complexity-dit.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:53d988bef8dad7ef93d32db358ebf4372d84913f9984791d9db89d7d26a78672
3
+ size 456055600
config.json ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_type": "complexity-dit",
3
+ "architecture": "ComplexityDiT-S",
4
+ "d_model": 384,
5
+ "num_layers": 12,
6
+ "num_heads": 6,
7
+ "num_experts": 4,
8
+ "context_dim": 768,
9
+ "patch_size": 2,
10
+ "in_channels": 4,
11
+ "image_size": 32,
12
+ "dynamics_enabled": true,
13
+ "dynamics_alpha": 0.9,
14
+ "dynamics_beta": 0.1,
15
+ "dynamics_dt": 0.1,
16
+ "parameters": "114M",
17
+ "training_steps": 20000,
18
+ "training_dataset": "huggan/wikiart",
19
+ "framework": "pytorch"
20
+ }