inde5media ruv commited on
Commit
cc301c3
·
0 Parent(s):

Duplicate from ruv/ruview

Browse files

Co-authored-by: Reuven Cohen <ruv@users.noreply.huggingface.co>

.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,150 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - wifi-sensing
5
+ - vital-signs
6
+ - presence-detection
7
+ - pose-estimation
8
+ - edge-ai
9
+ - esp32
10
+ - self-supervised
11
+ - camera-supervised
12
+ - cognitum
13
+ - through-wall
14
+ - privacy-preserving
15
+ - spiking-neural-network
16
+ - ruvector
17
+ - wiflow
18
+ language:
19
+ - en
20
+ library_name: onnxruntime
21
+ pipeline_tag: other
22
+ ---
23
+
24
+ # RuView — WiFi Sensing Models
25
+
26
+ **Turn WiFi signals into spatial intelligence.** Detect people, measure breathing and heart rate, estimate pose, track movement, and monitor rooms — through walls, in the dark, with no cameras. Just radio physics.
27
+
28
+ ## What This Does
29
+
30
+ WiFi signals bounce off people. When someone breathes, their chest moves the air, which subtly changes the WiFi signal. When they walk, the changes are bigger. These models learned to read those changes from a $9 ESP32 chip.
31
+
32
+ | What it senses | How well | Without |
33
+ |----------------|----------|---------|
34
+ | **Pose estimation** | **92.9% PCK@20** (17 COCO keypoints) | No camera at deployment |
35
+ | **Is someone there?** | 100% accuracy | No camera needed |
36
+ | **Are they moving?** | Detects typing vs walking vs standing | No wearable needed |
37
+ | **Breathing rate** | 6-30 BPM, contactless | No chest strap |
38
+ | **Heart rate** | 40-120 BPM, through clothes | No smartwatch |
39
+ | **How many people?** | 1-4, via subcarrier graph analysis | No headcount camera |
40
+ | **Through walls** | Works through drywall, wood, fabric | No line of sight |
41
+ | **Sleep quality** | Deep/Light/REM/Awake classification | No mattress sensor |
42
+ | **Fall detection** | <2 second alert | No pendant |
43
+
44
+ ## Benchmarks
45
+
46
+ | Metric | Result | Context |
47
+ |--------|--------|---------|
48
+ | **Pose PCK@20** | **92.9%** | Camera-supervised WiFlow model (v0.7.0) |
49
+ | **Presence accuracy** | **100%** | Never misses, never false alarms |
50
+ | **Inference speed** | **0.008 ms** | 125,000x faster than real-time |
51
+ | **Throughput** | **164,183 emb/sec** | One laptop handles 1,600+ sensors |
52
+ | **Model size (pose)** | **974 KB** | WiFlow lite, 189K params |
53
+ | **Model size (sensing)** | **8 KB** (4-bit quantized) | Fits in ESP32 SRAM |
54
+ | **Training time (pose)** | **19 minutes** | 5-min data collection + lite training |
55
+ | **Training time (sensing)** | **12 minutes** | On Mac Mini M4 Pro, no GPU needed |
56
+ | **Hardware cost** | **$9** | Single ESP32-S3 |
57
+
58
+ ## Models in This Repo
59
+
60
+ ### WiFlow Pose Model (v0.7.0) — NEW
61
+
62
+ | File | Size | Description |
63
+ |------|------|-------------|
64
+ | `wiflow-v1/wiflow-v1.json` | 974 KB | **Camera-supervised pose model** — 92.9% PCK@20, 17 COCO keypoints |
65
+ | `wiflow-v1/training-log.json` | 13 KB | Loss curves per training phase |
66
+ | `wiflow-v1/baseline-report.json` | 1 KB | Pre-training baseline metrics |
67
+ | `wiflow-v1/MODEL_CARD.md` | 1 KB | Model documentation |
68
+
69
+ Trained on real ESP32 CSI (7,000 frames) + real webcam keypoints via MediaPipe (6,470 frames). 5-minute data collection, 19-minute training. See [ADR-079](https://github.com/ruvnet/RuView/blob/main/docs/adr/ADR-079-camera-ground-truth-training.md).
70
+
71
+ ### Contrastive Sensing Model (v0.6.0)
72
+
73
+ | File | Size | Description |
74
+ |------|------|-------------|
75
+ | `model.safetensors` | 48 KB | Full contrastive encoder (128-dim embeddings) |
76
+ | `model-q4.bin` | 8 KB | **Recommended** — 4-bit quantized, 8x compression |
77
+ | `model-q2.bin` | 4 KB | Ultra-compact for ESP32 edge inference |
78
+ | `model-q8.bin` | 16 KB | High quality 8-bit |
79
+ | `presence-head.json` | 2.6 KB | Presence detection head (100% accuracy) |
80
+ | `node-1.json` | 21 KB | LoRA adapter for room/node 1 |
81
+ | `node-2.json` | 21 KB | LoRA adapter for room/node 2 |
82
+ | `config.json` | 586 B | Model configuration |
83
+
84
+ ## Quick Start
85
+
86
+ ```bash
87
+ # Download all models
88
+ pip install huggingface_hub
89
+ huggingface-cli download ruv/ruview --local-dir models/
90
+
91
+ # Use with RuView sensing pipeline
92
+ git clone https://github.com/ruvnet/RuView.git
93
+ cd RuView
94
+
95
+ # Flash an ESP32-S3 ($9 on Amazon/AliExpress)
96
+ python -m esptool --chip esp32s3 --port COM9 --baud 460800 \
97
+ write_flash 0x0 bootloader.bin 0x8000 partition-table.bin \
98
+ 0xf000 ota_data_initial.bin 0x20000 esp32-csi-node.bin
99
+
100
+ # Train your own pose model (5 min data + 19 min training)
101
+ python scripts/collect-ground-truth.py --duration 300 --preview
102
+ python scripts/record-csi-udp.py --duration 300
103
+ node scripts/align-ground-truth.js --gt data/ground-truth/*.jsonl --csi data/recordings/*.csi.jsonl
104
+ node scripts/train-wiflow-supervised.js --data data/paired/*.jsonl --scale lite
105
+ ```
106
+
107
+ ## Architecture
108
+
109
+ ### WiFlow Pose Model
110
+ ```
111
+ CSI amplitude [35, 20] (ruvector-selected subcarriers)
112
+ |
113
+ TCN: 2 dilated causal conv blocks (k=3, d=[1,2])
114
+ 35 -> 32 -> 32 channels
115
+ |
116
+ Flatten [640] -> FC [256] -> FC [34] -> Sigmoid
117
+ |
118
+ 17 COCO keypoints [x, y] in [0, 1]
119
+ ```
120
+
121
+ ### Contrastive Sensing Model
122
+ ```
123
+ WiFi signals -> ESP32-S3 ($9) -> 8-dim features @ 1 Hz -> Encoder -> 128-dim embedding
124
+ |
125
+ Presence head (threshold 0.3) -> person/no-person
126
+ Activity head -> stationary/walking/typing
127
+ Vitals extraction -> breathing BPM, heart rate BPM
128
+ ```
129
+
130
+ ## Training Your Own Pose Model
131
+
132
+ The camera is only needed during a one-time 5-minute training session. After that, the model runs on CSI alone — no camera at deployment.
133
+
134
+ 1. **Collect** — Run `collect-ground-truth.py` + `record-csi-udp.py` simultaneously for 5 minutes
135
+ 2. **Align** — `align-ground-truth.js` pairs camera keypoints with CSI windows by timestamp
136
+ 3. **Train** — `train-wiflow-supervised.js` trains WiFlow with curriculum learning + bone constraints
137
+ 4. **Deploy** — Load `wiflow-v1.json` and run inference on CSI only
138
+
139
+ See the [v0.7.0 release](https://github.com/ruvnet/RuView/releases/tag/v0.7.0) for details.
140
+
141
+ ## License
142
+
143
+ MIT — see [LICENSE](https://github.com/ruvnet/RuView/blob/main/LICENSE)
144
+
145
+ ## Links
146
+
147
+ - [GitHub](https://github.com/ruvnet/RuView)
148
+ - [v0.7.0 Release](https://github.com/ruvnet/RuView/releases/tag/v0.7.0)
149
+ - [ADR-079: Camera Ground-Truth Training](https://github.com/ruvnet/RuView/blob/main/docs/adr/ADR-079-camera-ground-truth-training.md)
150
+ - [Cognitum.one](https://cognitum.one)
config.json ADDED
@@ -0,0 +1,32 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model_type": "sona-lora",
3
+ "name": "wifi-densepose-csi-embedding",
4
+ "version": "1.0.0",
5
+ "architecture": "csi-encoder-8-64-128",
6
+ "training": {
7
+ "steps": 12212300,
8
+ "loss": 0.06543377335206552,
9
+ "learningRate": 0.001
10
+ },
11
+ "custom": {
12
+ "inputDim": 8,
13
+ "hiddenDim": 64,
14
+ "embeddingDim": 128,
15
+ "totalFrames": 60630,
16
+ "totalTriplets": 610615,
17
+ "nodes": [
18
+ 2,
19
+ 1
20
+ ],
21
+ "quantizationBits": 4
22
+ },
23
+ "lora_config": {
24
+ "rank": 8,
25
+ "alpha": 16,
26
+ "dropout": 0.05,
27
+ "targetModules": [
28
+ "encoder",
29
+ "task_heads"
30
+ ]
31
+ }
32
+ }
model-q2.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1ebcafeb2d05c21fc83e73d18a13f9898f56f6174e8b10a23ec0acbb18a5a9ad
3
+ size 4096
model-q4.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c97dd3696f724389cdd4f423cdc75c18ccb9248a26319257177f4c211674a83
3
+ size 8192
model-q8.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c1356de682be372c9fe56308a2f690c20c962505ca85492cf1bffadcfbf3be8
3
+ size 16384
model.rvf.jsonl ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ {"type":"metadata","name":"wifi-densepose-csi-embedding","version":"1.0.0","architecture":"csi-encoder-8-64-128","training":{"steps":12212300,"loss":0.06543377335206552,"learningRate":0.001},"custom":{"inputDim":8,"hiddenDim":64,"embeddingDim":128,"totalFrames":60630,"totalTriplets":610615,"nodes":[2,1],"quantizationBits":4}}
2
+ {"type":"encoder","w1_shape":[8,64],"w2_shape":[64,128]}
3
+ {"type":"lora","config":{"rank":8,"alpha":16,"dropout":0.05,"targetModules":["encoder","task_heads"]},"parameters":2048}
4
+ {"type":"ewc","stats":{"tasksLearned":4,"fisherComputed":true,"protectionStrength":2000,"forgettingRate":0.3296799539643607}}
5
+ {"type":"quantization","default_bits":4,"variants":[2,4,8]}
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d85fbc9e839908de1d8b885ae3b59dbdf369336c836ecf3f4053c2ce45f6a994
3
+ size 48840
node-1.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"config":{"rank":4,"alpha":8,"dropout":0.1,"targetModules":["room_adapt"]},"inputDim":128,"outputDim":128,"weights":{"loraA":[[0.18184647127077033,-0.015476187119936475,-0.05639649410101404,0.24239228360022247],[-0.09370577920727219,-0.015431398793792706,-0.025366554834842434,0.27942813857830273],[0.04464627361734741,0.2271495448362324,-0.15330643894291515,-0.014541170725153749],[-0.011676237277165687,0.03673000649184334,0.15325582033168877,-0.1329993399356404],[-0.16328624861578914,-0.13945636806414904,0.06458345086302208,-0.00719718213710738],[-0.0166260044571914,-0.04121678497364583,-0.032647127992047074,-0.061393242153063576],[0.008104334771988436,0.08572713998922611,-0.15126716982049362,0.16341573293104938],[-0.008993889698916534,-0.044575287498068356,0.14431160170680904,0.07889623525385187],[0.10917548176082585,0.11424995394897015,-0.2168857094671769,0.301675884506516],[-0.022870831901804094,-0.05523997102661461,0.09985826840749568,0.056194428407257295],[0.01779434944893148,-0.04998158732334278,-0.05636289062292971,-0.17067633627991657],[0.008530875164913793,-0.009180272717383406,0.04448603419518528,-0.15909524285853666],[0.0047710700230009446,0.0125379692580855,-0.08783465071898847,-0.020906335931312244],[-0.1602849766387915,-0.027881737443372835,-0.05184859223092139,-0.10528210261875007],[-0.013786463550257276,-0.00024317954851752678,0.037933777521827514,-0.02801778900602862],[-0.15577945647173752,-0.015492762681578068,0.01603176349331743,-0.09694625547346164],[-0.026992233719418196,-0.12835045979430265,-0.02871022470085172,-0.00849997901610815],[-0.06171027537725856,0.0001487777828934804,0.000031034030167547864,0.09336061832573106],[0.11341794752871326,-0.024106948982917143,-0.021665598499331667,-0.055393057651482475],[-0.012735688007260559,0.15581325200081353,0.003441898747656193,0.232550833164677],[-0.0502662124214458,-0.058033571368309875,0.07514935745376503,-0.24744393458449387],[0.12669095283575477,-0.13727479535930226,0.07893247615534608,-0.018630749849243174],[0.17838935270413345,-0.07185924761668652,-0.05889809542474304,0.18980614487367858],[0.21170314834850282,0.027014009211094186,-0.12698214268483973,0.36211165350653696],[-0.03752264508025162,0.022158992419799555,-0.016260962256866098,-0.06873507895506872],[-0.1366521248189402,0.03445055723363444,-0.00253133778599814,0.04537953882377927],[0.04819673563863875,0.12066011773751954,-0.01970914847931262,-0.060511880463177146],[-0.06314319130144269,-0.02094952741205135,0.08293118049376244,0.09635246149060603],[-0.04524287334832352,0.06153243731823666,0.14821945210217966,-0.07678688219535477],[0.07051961695445005,0.033291571874319484,-0.018868791499540592,0.2505049783227031],[-0.013379229364808946,0.04509228750056316,0.1374591407288256,0.0026928498092671283],[-0.006104071575896596,0.044707969117638365,0.05511409048328555,-0.09505285919238478],[0.08998241446382964,0.12227248881584817,-0.006783565225386585,0.08789594610045073],[0.08521900058959547,-0.006784624264337408,0.025255580638789885,0.18690580417441327],[-0.08850080922006098,0.09999952213895186,0.11651307697801723,-0.11070720818275633],[-0.09091421033911108,0.02135251994963615,0.14866097996741134,0.016674452723315934],[0.11141549002211187,0.06167944429299063,-0.07478619577534498,0.06598359548684256],[0.059247958374548305,0.05101965506452456,-0.015097543187774768,-0.047176862640064474],[0.06650771827763508,-0.023262579408586656,-0.012519296506750918,0.22712381991998346],[-0.09800624607534404,-0.16443145593183747,0.04088073472054844,-0.014633323110270373],[-0.06386611079732726,0.09045893380835424,0.08455469153312781,-0.1181716433942671],[0.05744223970248645,-0.11697983095521863,0.11598380592757017,-0.1330564058388034],[0.03255978625630131,0.016859157988742015,-0.0282206244796194,-0.19761464539777748],[0.06232818262198986,0.004274952520672903,0.022290578685952203,0.2231013600725746],[-0.052191191618055,0.12365310944465106,0.06472410691864276,-0.05155255448406772],[-0.07637021062705883,0.011735446123679006,0.13735796321186383,-0.05316883453146849],[0.013172948785223864,-0.11190824110860403,0.021286545754390027,0.10779559518970351],[0.004740929368694134,-0.030714203430868937,0.14935633289368452,-0.06073051804269015],[-0.008739505954681502,0.04388452876449959,-0.10697055754731195,0.2876712274532549],[0.06575192803570201,0.020315984570445752,0.032384922611627634,0.23501563568891726],[-0.03651106567081088,0.08727715478455006,-0.03488162095574408,0.13410282389026815],[0.11840916339241801,0.12163460773461664,-0.10441107460479684,0.11083310018828751],[-0.12488993794788002,-0.006779053671964784,-0.09716481665342336,0.027312762790859313],[0.009828365854519334,-0.03552574575844859,0.04017957307902815,-0.04343518156172026],[-0.03472064595001295,-0.1857117739582771,0.04439532223603619,0.0036434064892549886],[-0.04207128296814519,0.04509619982191049,-0.028508779538053725,0.04181253781524173],[-0.05778783780630216,-0.040915330034817544,0.13412272717407728,-0.07190290119924642],[0.035735621101903293,0.02402316182805875,0.1297468707134103,-0.080855611619736],[0.1721644903415101,-0.15914520761426543,-0.031161159166933825,0.010486125978674838],[-0.10284152825825905,0.007869682042112709,-0.03560642565372291,-0.13041253283455412],[-0.03993562891961551,-0.07519478083108687,0.049682766069753914,0.16728490608563146],[-0.0016581834888635212,-0.015718276929520443,-0.08937474675259865,-0.11719870455011776],[-0.08232560426438838,0.04099102580159935,-0.02376455086808535,0.010983657233139134],[0.0002712448249051399,-0.0310034601050604,0.07468847473833552,0.005427649939169579],[0.10812962527184279,0.008731430683637452,-0.05120912442363879,0.14687105427704275],[0.04207049396317712,0.10833080565735025,-0.11091092940647246,0.12313371146144901],[-0.02503321963017445,-0.08011900516015558,-0.06482893830875262,-0.30390855254505417],[-0.058380817778003045,0.01208594633051974,0.020734163420128963,0.055853510855753734],[-0.17071427665344857,-0.04885448843232955,-0.0015931967529079112,-0.062223075759226996],[-0.12520973026207619,-0.08535815031605783,-0.111317842755435,0.11670830559290118],[0.1090097413514892,-0.031945664925200436,-0.008098996867319654,0.050515440213827895],[-0.03228614128611631,0.012134419782868215,0.13124980766056665,-0.05551903578999828],[-0.039138385586229285,0.1637649952760336,0.019650474240187742,-0.125294632260089],[0.12420918239437788,0.05936923612423965,-0.038341220455277304,0.1579237368343054],[0.11932040159807616,0.15555334282937644,0.015916147230447295,0.17553161078022878],[-0.02023269097167174,-0.048868009523508185,-0.12892216111488491,0.17543236273718515],[-0.1084961835537877,-0.10205225881729411,0.1053404477228489,-0.07239983012634467],[-0.01980154148432526,-0.1484571331641538,0.05381425700018781,-0.000047214466664371987],[0.04186825301130449,0.05403210301891147,0.14939382416055288,-0.06515117669022658],[0.00780920596362436,0.10032713255005746,-0.00781545269869021,-0.11600421891111569],[-0.041741643720308225,-0.006810676471914395,0.01902927874956122,-0.18955979945437304],[0.029824650824764355,0.029199542518382395,-0.13224666813375832,0.06669323668681851],[-0.006051013336096558,-0.07070519354387492,0.07389015632964138,0.01923855410069327],[0.0606823448356127,-0.12854119568656613,-0.08403401444080581,-0.009147274210164306],[-0.024894686978171904,-0.006498878260594212,-0.015923817604885038,0.10785792714972572],[-0.12401361397962263,-0.020466022470277005,-0.0001959580891077475,-0.16183440233357121],[-0.034415318083840005,0.1194398492513959,-0.077276839837532,0.19482823661681092],[-0.0832157560523734,0.01847467804031694,0.022273153536464793,0.021287622225290233],[0.0467270554886376,0.11219838736102818,0.17209532099926708,-0.1838847136015224],[-0.02273140645162029,0.05037684280017773,-0.01214201338887953,0.17254830909761343],[0.15415267379510425,0.07231870786862941,0.11102571946231425,0.10550684019325689],[-0.07105813964050887,-0.04493067287068347,0.07353881588149834,-0.08856923328984294],[0.08147451327036748,-0.018313394421707724,-0.05025370942825228,0.255112370142971],[0.08062451673336679,0.08856652594229293,0.009355508753862877,0.16909600237406822],[0.011166770184774903,-0.009392019496865899,-0.12408830287169324,0.07480747448028453],[0.01655219350834322,0.08322769140686202,0.08398891860079075,-0.14781631219715424],[0.07972831591818592,-0.04549295610007701,0.019457103956757982,-0.16354424573970675],[-0.07555966419220324,-0.004036939276940013,0.12572661699984217,-0.10212215063079008],[0.03804047480592381,0.056129135445364006,0.043899105322839374,0.05792661010444491],[-0.09819287962230916,0.03372069317715863,0.13997858154273074,-0.15444266424012504],[0.04281788153687343,-0.04437676539154557,0.015051662048691378,-0.1369968489678746],[-0.0442034872876895,0.04145375711716998,-0.06629055148368496,0.1326048182869766],[-0.00009511984443727108,0.10247474880034946,0.02273271411835589,0.14954789986230047],[0.025385133485980156,-0.06987087819553785,-0.08669716626661916,-0.17163734530814492],[0.0064408300801148425,0.07063015880139747,-0.07044514538871512,0.01263113021502823],[-0.08437838259618832,0.0647838132342599,-0.03490703667297173,0.013831564476325841],[0.03620707386520976,0.05428501677524028,-0.16215510205047254,0.04543723756776654],[-0.034200608404104486,0.07164738985981321,0.029068059471662012,0.09919544693170958],[-0.11016781272412293,-0.1104223081378124,0.049757092873416175,-0.08295733508239513],[-0.07861027844617714,0.028107369589687792,-0.019680343412162838,-0.14345785044004236],[0.08950502750015991,0.06341067132126776,0.11710703698629461,-0.13538627624883914],[0.1133224119788459,-0.03761051029235654,0.10467230859688048,-0.03707274602230718],[0.04924293062840564,0.12385163961001594,-0.059829218101963025,0.22588962586743816],[-0.0175936945487795,-0.004013742569529019,-0.04666808552606387,0.01769115192475227],[-0.002274153399827087,-0.048730061673389405,-0.00034464242332892263,0.02105184080708707],[-0.007913506958718003,-0.057523014135275406,-0.07977381831951885,0.1421865898754623],[0.10089490010664248,-0.02775504294582067,-0.07499455872381836,-0.04368160840392628],[0.13933713798609482,0.010831272298545004,0.007740186215010308,-0.11420659188638053],[0.10152403122056124,-0.1271247845565882,0.045484715422204135,-0.13976795422066796],[0.07446658485473895,-0.010703984663371654,-0.16380029487122236,0.14441156013139242],[0.02042813222809309,-0.0213601484943924,0.018916939065523785,0.08207156121083525],[-0.12565322106598514,0.08720433362309221,-0.009376166982907838,0.02977647167810513],[0.11731418588544425,0.05617765090103145,0.030833529060098452,0.14544305774002209],[0.017920588088735527,0.002259286790521775,0.08464149017236539,-0.12030556655313765],[-0.15681926989085873,-0.11223122605067418,0.02386566438053553,-0.07431796657119392],[0.013754711013124876,0.08484921501745465,0.01361331635560706,-0.04871860869711795],[-0.01382273190428673,-0.12903597621498505,0.06805975627851092,0.13438103929520245],[-0.044841219171291406,0.04829890518599053,-0.06961687354629041,0.03280642538143608]],"loraB":[[-0.22787098623393273,0.11532552251256044,-0.23476133719043152,0.0019141078367257976,0.022499987289071897,-0.14571561852785617,0.09146365757358253,-0.05847426354197631,-0.011256750787878056,0.015008356100084391,-0.01658354724611916,-0.030745148281100098,0.03011714818553837,0.11982787447236097,0.05352373326862839,0.14623715432395265,0.03868375598239327,0.061163185301509625,-0.06869999702662667,0.02452196682562998,0.06093848300980417,-0.057836681339464874,-0.07898719549006179,-0.1409357311528161,0.004633054004368835,0.1725789892403941,-0.013878915652263618,0.10051435902385056,0.00436309393683554,0.011612692890178373,0.04546799801243553,-0.007332435083817319,0.016988945428879076,-0.053323958110199014,0.015353929930506476,0.05555234287255784,-0.06325159428371621,-0.03842600978419669,-0.03494090385448437,0.02814496901423665,0.03066467021617769,-0.07066968835142545,-0.04270862636575866,-0.00365781064115102,0.006452775930614637,0.06443384896520934,-0.0013311703342789272,-0.0275080543243441,0.07133337271100007,-0.05929803369666924,0.061289859675361956,-0.062828290624846,0.10897287041001309,-0.08467137058462224,0.011688394069029995,0.10210840688683685,0.03467626185351506,-0.09101080088530719,-0.12518159901140774,0.0975326040855704,0.0480106903304876,-0.012942255505449382,0.049959380538143194,0.04468692421822517,-0.07388995746277131,0.005659039182321809,-0.06835073710365212,0.068714787275295,0.1127134422523397,0.11910962361806608,-0.1533123589236559,0.04722090612906109,0.05321529298748476,-0.10616528735730288,-0.004687660323284793,0.002439402589581049,0.05825271809792747,0.015128564897247664,-0.021344070313808722,-0.01834309493763473,-0.04154498901499051,-0.0365908953707997,-0.0015066915954356404,-0.004572086583738929,0.01387878343213115,0.020058242634428455,0.08226688287609604,0.06092142073408545,-0.05818516385529638,0.08294754085709055,-0.11461312362563186,0.061612871858302026,-0.0536444421772586,-0.07216482837243296,0.03552574796361316,-0.0802876362367387,-0.08844059261561206,0.007112991205206222,-0.03515613411347241,0.09375526176495545,-0.060094509057132234,0.030330727231695425,0.012954481228172146,-0.024764452222746713,-0.036670030640509936,0.040045639570302875,-0.006539738963966556,0.027269456470504303,0.06064543738671671,0.025496315520616274,-0.08172618249849399,-0.051539385173077046,-0.04035576675039769,0.027923404561202143,-0.01054121836209828,0.038821660468154905,-0.09562500024732265,-0.07137641202968052,-0.10564039959610882,-0.037787132782238414,-0.019026251194292215,0.11412476855876796,-0.09545539004719016,-0.06580596175436362,0.06796606881715433,0.02399950442246447,0.04403752411399329,0.06785838447740364],[-0.10982411881418983,0.01758266677148226,-0.3223448655183005,0.016144537679791578,0.11298557308216697,-0.0564010677165289,-0.04035609524977531,0.027870855614492117,-0.09051640287297476,0.07575714523354304,0.005034149730178809,0.015814008092772624,0.039000977643968676,0.01958577935727001,-0.0037036237261957594,-0.00452287804989033,0.1129549289713258,-0.054513621935475286,0.02397687839743361,-0.12263461114718903,0.06578291744660729,0.12189150815785696,0.05570189859689913,-0.0006379659905151645,-0.07984695611813909,-0.02399718576365371,-0.11464114246262842,0.029331295652115563,-0.07046993685340956,-0.040939425428785974,-0.024970101382800532,-0.11358862554230767,-0.1016395017121159,0.016404292446426116,-0.11265329801376155,-0.004419442716595502,-0.07512598916837296,-0.058768249873121355,-0.002276957331042905,0.1291307932094129,-0.10058885066076145,0.07356737040686874,-0.014844052161453227,-0.012308857721735716,-0.11245789410317839,-0.07340036754977802,0.11486075798984376,-0.012284671777477647,-0.04922081300743429,-0.01744666918927161,-0.07165413925143929,-0.03139975031520416,0.008500780637716697,0.01911013141873178,0.14422777474621573,-0.024957221921206422,0.036782100585676575,-0.03735753081849648,0.10155839022755114,-0.05311342200107603,0.12752663230321878,-0.047695599655548655,-0.0413666169499905,0.006547621558262176,0.006034179646410672,-0.06719445656623896,0.011005365368117843,-0.04883933540842451,0.0076322293227406,0.07114819113611269,0.03155384875683483,-0.06411935757852075,-0.12689758019937744,-0.06398438998115417,-0.07207051755154405,0.09747251204022134,0.0940869900736668,0.08919470773092757,-0.08835012052000968,-0.005164553067368198,-0.006318853628108742,0.02329868029038361,0.06152085162717282,0.10812900601982575,-0.0482770133889086,0.005260051526632506,-0.07907301329423672,-0.058749920828853865,-0.10432442047245823,0.05708639365644952,-0.05197573580375842,0.034451672955700216,0.06668376346389861,-0.029748506746066546,-0.051520281465170535,-0.10676022635573942,0.05948494557378276,-0.004398950470301778,-0.09649416898161965,-0.046822110495394774,0.008277038031270298,-0.02180002862424724,-0.05453526930431184,0.022516442542443855,-0.0359013238925444,-0.010978608790212178,-0.02513613999939509,-0.10922040675236515,0.06320536644281025,-0.040596068628086325,-0.011018130928296262,0.06387453053716174,-0.059613065879989144,0.004929963846826206,0.016121202473426677,0.104598972257661,0.028490409318851474,-0.020393164964225507,0.0792124346680285,0.03454760931967932,0.05554846122494054,-0.06256448762150534,-0.03218538232631441,-0.01356254638492969,0.1286168609123536,-0.007414932847326684,0.1244895404019991,-0.003800362207517353],[0.16122161911134528,0.0004715619106320243,0.2665847300288013,-0.11713247249428813,0.1538784415651372,0.24196502740149442,0.09088887595998406,-0.09045515794964876,0.12933495994569416,-0.10686857121828697,0.111212891227752,-0.007819214035179328,0.07357415436460446,0.06162624986319579,-0.07334617865795448,0.015847550442770794,0.06383107902260093,-0.04984721761033436,0.023491175657631445,-0.03084934231462038,-0.023382419740631183,-0.06751293527833761,0.026734088969236392,0.062465590895397875,0.07086431877056987,-0.00038680724981104595,0.00026332133971951907,-0.060380604648888704,-0.0880738847388112,-0.05330990329906605,-0.11019940607816926,-0.022653722590393204,-0.06764148103765645,-0.08365463023440804,-0.027323660483783672,-0.1118832305214494,0.10804570977664024,-0.011960784720113034,-0.05652453739054246,-0.015241318459250168,-0.040602575529032806,-0.03575689522881063,0.07629861646903627,-0.043505366126723496,-0.04173577151514864,-0.09777135908305129,-0.00836848883620835,-0.11981947926397368,0.0015842924452627158,-0.03277235085244294,0.05752973060052072,0.07165104989842734,0.1171162553589312,0.01343699620226027,0.007336647300204442,0.025242895783156857,-0.1112894926099376,-0.09854803505877445,-0.025188855496680873,0.09403885275118301,-0.03835296554415151,0.07821873566849073,0.061558701219201824,-0.10208893089503633,-0.025262985047846336,0.07005868312613801,0.05641591051455143,-0.026175320678570604,0.021050409451703743,0.0706132898983906,0.02182345722614333,-0.08165398727574348,-0.019788494393942885,-0.014168487804918218,-0.0540786575635312,0.06509378444030668,-0.10208910393743634,0.01137659780478766,-0.09374878089192946,0.03653214724231835,0.0650947221961689,0.11071175699034101,-0.04798190092367516,0.07575113094706995,0.03395953238667903,0.09230389164023155,-0.023193906135719238,-0.04448712878502978,-0.08454275021956939,-0.03271251261694857,-0.09723453952000721,-0.014322425928795979,-0.027556708032714202,-0.05716548689387569,0.08157108266787051,-0.016867777039281197,0.08468055154102927,-0.07852339009833503,-0.018106372441567355,-0.06539184462158987,0.03160665842245965,0.011095051133665988,-0.09465771316322676,0.06150254799782863,0.08349101315421117,0.020215102617053858,0.10277954675236807,-0.012963519882565295,-0.0254056901722784,0.022669956208551483,-0.06825225965200382,-0.0650339700122366,0.02649150602670073,0.10397444743834895,-0.017971114096717467,0.09106871667949448,0.062345164614700174,0.004963759093898917,0.011684903776906884,0.10669922231371912,-0.03642309591790679,0.007864075490723146,-0.028606750403280853,-0.10448074991834379,-0.017194907940534594,-0.0018205678749309167,-0.08526859732789942,0.07568574901150787],[-0.5956616877150166,-0.17264300654154113,-0.5633867099092127,0.04163320689722959,-0.6754568691629942,-0.34329546694278307,0.03406149475542533,-0.07749724603373807,-0.053674469329938745,0.007352623431773013,0.03210674567447575,-0.02694023500796352,0.019420712649489944,-0.057860351571159194,-0.020651247308811554,-0.011396505145399489,-0.03707110540861156,-0.07650676886695267,0.07494518340203767,-0.049448881993741825,0.045381263478435865,0.032094655049878185,0.014389118334717269,-0.058386900603295044,0.06104555599187712,-0.01663311090289055,0.03170581662615907,-0.057783992718720395,0.04060375460170471,-0.11850662593502778,0.01498682307996013,0.0828486381033501,-0.03144862332380991,-0.04960109687290661,-0.05821367099869197,-0.022440521271948285,0.0017565745317468522,0.05960206986134793,-0.08412762232209972,-0.030380273569769776,0.010781652942302038,0.05532608319443773,0.019449363347050424,-0.10762524542904951,0.016132767821071772,-0.0061905036498243644,-0.04394345282119507,-0.005206834547377189,-0.06902780153903747,-0.07059791087479292,-0.0766462707741302,-0.049627003091245715,0.029977774516825983,0.0030558789316238004,-0.00788265858173503,-0.022773590674814423,-0.028851404293415112,0.007733510609695822,-0.0359712582045676,0.060569315263787275,-0.0718204891991668,0.0790131339373902,0.008502098273995264,-0.02636550737633261,-0.023303536844909423,0.023030354493853517,0.10574632130285386,-0.02454303591852887,-0.00406814921109154,-0.012164674072055855,-0.03073069491346278,0.022378969443862154,0.028943844288443224,-0.019734496474541424,-0.00663837260356291,-0.03593204607565353,0.01667802398566899,-0.05188958816851558,0.00822327867689036,0.05836411453231001,0.013570736572113396,0.02700293690635821,-0.005126998806471433,0.007276050749806798,-0.00023351931224933653,0.024207151682550318,-0.05577199137734333,0.02584960928481281,0.04070862561199469,-0.045084708807485586,-0.02398580432568991,0.01586100988652624,-0.08851410193321364,-0.007865706986057036,0.04755854738944886,0.05425718870075348,-0.007279753041044623,-0.031445984493107815,-0.0431892697326334,0.03710263695969871,0.05598632801198353,0.06489254929502056,-0.005394110985693822,0.09233171247262141,0.029567991591016092,-0.03459659935896411,0.059480664091644174,-0.07580243332912244,0.0001929328710537458,0.12169278389760302,0.08835938153420657,-0.016572992858293535,-0.08584410452581512,0.040736014113754396,0.004046201451922599,-0.06053421450266607,0.007875030671929567,0.11765351708086981,0.0026285755127164615,0.00833209012571345,-0.09148719815304539,-0.053269090144414666,-0.08245073689676029,-0.02421986545949241,-0.05710031465580218,-0.0039870912667457955,-0.03197728336488263,0.0201852900693978]],"scaling":2},"frozen":false}
node-2.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"config":{"rank":4,"alpha":8,"dropout":0.1,"targetModules":["room_adapt"]},"inputDim":128,"outputDim":128,"weights":{"loraA":[[-0.08388680783509128,-0.1081364217291249,0.09935642944024278,0.07357978122074477],[-0.1297709670966282,-0.09967318448476566,-0.02855292867581203,0.03612469693326858],[0.2417272621887801,0.05354299590712526,-0.02940115232208436,-0.02273956421164066],[-0.00451902688605669,0.09858436563736747,-0.18351059267301578,-0.08178600482296823],[-0.022944307098096854,-0.08237292350519172,-0.15940473380466333,-0.11158441584118876],[0.03224774599519593,0.015517591966479515,0.038764805660746145,-0.023274192403460122],[0.08910069287661508,0.0029085749089213684,0.012093899129256258,-0.001273698459881669],[-0.09505375644577728,-0.09988506980993914,-0.05632108183038139,0.12490907184435246],[0.04515433829322549,0.030098642086667852,0.041703919543101584,0.041359098390713604],[-0.1424139338131886,0.02533433488992811,-0.07224441696384551,0.008551278249249901],[0.06922609634156397,-0.04458571495936307,0.10267036822676885,-0.09329809501396079],[0.03442014374848958,-0.07400327968302663,0.03885116461311809,-0.038562134504183804],[0.012152098658856351,-0.0007691475544791894,0.06317935579562921,-0.10003675432882071],[0.05979865949675387,-0.13981355161447365,-0.004963704320144003,-0.0903772806299033],[-0.03145844326547685,-0.10191960174202981,-0.026195622681644874,0.0689422757599911],[0.014369616464137588,-0.030932365107940122,-0.04195008867315355,-0.11113563165936563],[-0.04499281454126879,0.024938023847174896,-0.0436689184390011,-0.0844840447773251],[0.04754556699193707,-0.00636391350875621,-0.14993306636570733,0.0357619727750172],[-0.07982686380583814,-0.048200858078206066,0.16022110454610505,0.11634898961450159],[0.026366207164357766,0.020689984877441624,0.017842417435783044,0.17171115491564998],[-0.014479893088859738,0.2705680691657611,-0.1684530007261116,-0.165582040858112],[-0.1070355667174646,-0.011660542990697987,0.048415644857991345,-0.04723373456420603],[-0.13126087037202244,-0.08760107326280052,0.17904977466544383,0.05575848441711219],[-0.04888264262892896,-0.1675405536235889,0.16501226244271747,0.10411653071011259],[0.099786721286411,0.07041029853203021,0.05611132788280711,-0.018780749811377676],[-0.020895408566257302,-0.027981605967582333,-0.14894615138149817,-0.026605629262803805],[0.03333861688073314,-0.053785820915275305,0.018009574573896313,0.08349929131819891],[-0.06479936540616071,0.04863994867094764,-0.16290958092043187,-0.11749135965640961],[0.017267343848088198,-0.06622481369450857,-0.02948730514619118,0.01025649131940406],[-0.07878322280886796,-0.2350595733916173,-0.00044450027350036793,0.07390639707133609],[0.05869564238245435,0.018338819142786504,-0.1121277577807482,0.008010101383089906],[0.04846000948464378,0.036062451211069366,0.038411004446135856,0.10332225380532915],[0.03557428368951227,0.03368053478167152,-0.11297287734442704,0.06596704322407645],[-0.1222293777112171,-0.027332810044588023,0.0004163863501325011,0.1460264538703492],[0.15035659990847594,-0.004555083114160081,-0.028496446052547565,0.0650344160903005],[-0.02526176233405606,0.0015033511982216802,-0.0631672760128054,0.0951735136168216],[0.08546356760796193,-0.08397647663830526,0.1590575343658063,0.08546805415542197],[0.05480096173903255,-0.0801456418072932,0.09802610184996988,0.09551065085552837],[-0.0840262389672914,-0.132640998059367,-0.009845759388176651,0.05401588045648348],[-0.07560270081392113,-0.07481258167623765,-0.011247729232345297,-0.10117764746545867],[0.08185226485766756,0.04881518229555772,-0.07912413699199392,0.10370824145215998],[-0.08768863304827315,0.0607060756033073,0.060403300074084065,-0.07664747313613268],[0.08900535434784793,0.06198146149512325,0.04770631682708138,-0.11422273978547368],[0.08254182455274331,-0.14828552244324616,0.007300870060043267,0.08404133608002813],[0.15811202101877256,0.08964178984934201,-0.10543645840101101,0.0022689649058191385],[0.018804809279912647,0.027921316236099575,-0.17153729275948038,0.028177483401394303],[-0.04739753873694731,-0.05340973904324034,0.025034520291033324,0.03256098065850128],[-0.10874183743029071,0.07299194440456114,-0.1085719509097234,0.031985273776132965],[-0.003977924807175116,-0.09833075398320443,-0.05788657234442103,-0.026598787782925005],[-0.06666888803196667,-0.17085774706258236,0.01422217121457316,0.1941082302506059],[0.10021558120774003,0.0026058116001503717,0.010715480663367223,-0.030913525454780724],[0.04754613775525369,0.093836754542541,0.03826012988156525,0.04145854775339931],[-0.03935278168377217,-0.024793783576802213,0.06485095545696723,-0.10581879820310355],[0.04134891495347003,0.08055359692436652,0.013828278277321165,-0.03883011467697865],[-0.09320347357281894,-0.11741579238518783,0.05354633438681224,-0.12132753943058812],[0.05618206160693398,-0.17581555337381768,0.011838349081224492,-0.014337608318339544],[-0.026790526521455114,-0.03313088576974795,-0.07519013856267455,0.002437864440420295],[-0.12058858934412313,0.14409203108235272,0.03574074271803846,0.09082085033833678],[-0.14495606532596533,-0.0657447497313487,0.17594734466053158,0.0697324510903515],[0.08240045730759735,0.05232677128287875,-0.027676702106868383,-0.1263679404647053],[-0.16036523400570088,-0.016891285738804006,-0.015244747670608077,-0.022585609357686248],[0.04179515094827206,0.1498634390018947,-0.047032506302435786,-0.04081798595782551],[-0.05150167869658462,-0.040760108736036305,0.02557417386449082,0.05933666945483069],[0.03712095375584916,-0.0957069399694874,-0.07412951225079452,0.020374827716122916],[-0.10645737604813846,-0.0112125110253235,0.013960628676668925,0.07397120423161044],[0.0059524826452311405,-0.04733440856875188,0.15634545424775215,0.12897374964962474],[0.054344340081075575,0.1021549068165307,0.07811518902316861,-0.12496189036681606],[0.028017978931632315,0.06893395712211221,-0.11007204574859478,-0.05732295440838265],[-0.03260552490347911,0.013028322883630547,-0.09180368318216162,-0.08198203371729959],[0.029833132293032694,0.010068100186300421,-0.057639228283264614,-0.1462362228290452],[0.029123882635756444,-0.04746723422653915,0.08015017538108272,0.10327501347231532],[0.012415518593748363,0.06344665190912153,-0.05806174987571948,0.0074360792431999315],[0.09342152151563103,0.17792985589781374,-0.0760263329217996,0.007117616100731856],[0.05460021442784531,-0.061386026999409905,0.0882058612359109,0.11029538404947813],[-0.03712777978505587,0.11218847788294216,-0.01646411670353815,0.13743668305134832],[-0.09754743124385634,-0.12056006646056024,0.1517968586220331,-0.02275690715646135],[-0.13796513310368178,0.03271404897247082,-0.051999968366886154,0.01309062120013334],[-0.055946842494286705,0.020297606790195623,-0.08992783773197874,-0.1335605110529293],[0.03824017670011511,0.019831546323144746,-0.04261497359955391,0.17080954095312564],[0.06380246848956464,-0.009696497837282207,0.08440020699777644,0.00851573130478085],[0.0798304973221313,0.0805612610276424,0.016159649808961275,-0.030207042107155066],[0.0940765741991815,-0.037085480918509675,0.11933456154406467,-0.06693162152539699],[-0.12315401208857024,-0.01923007302606185,-0.05153420319584245,-0.04686761113873059],[-0.02466990835790124,-0.06190779187294453,0.13165276629748224,-0.0999925114677476],[-0.05922833192616053,-0.09110268687647606,0.08868973533599443,0.01012215249239133],[0.07903196819430697,0.06049371836028566,-0.023392571161105533,-0.07456397829090632],[0.033233317118568285,-0.039311193227917554,-0.12294602289524158,0.016681498857716803],[0.0010860521059024297,-0.004741954055002326,-0.10521506406728771,-0.05155146714917186],[0.12135409518255089,0.16847745499252467,-0.06961730673974319,0.07677640751535095],[-0.022426403873394233,0.03488269878234446,-0.06330303442209045,-0.08291351885653621],[-0.07597322728186141,-0.06459164860320232,0.0109334253268833,0.21178819899171578],[-0.03533993763928793,0.0065168065235222524,-0.05138692845004638,-0.11104274545885771],[-0.153161538658241,-0.1416948815698612,0.1326317916935944,0.1208852936584902],[-0.023942867737723687,-0.000993460225058727,0.051462767240945236,0.06900543077616349],[-0.033515682797399526,-0.0942321555894926,0.05964761800214055,0.03201480208392475],[0.08373737452838037,0.20053528408649623,-0.018137520912738427,0.03447130762690216],[0.0649630404129832,0.16804421437344877,-0.00865753479124001,-0.13637473311771905],[-0.03488316756195231,-0.09378180113475056,-0.04889999854047768,0.06625874301700829],[-0.0003236045534760443,0.023233418142533272,0.05039712158709895,0.0669285609648757],[-0.03812606016882061,0.07756902348339961,-0.06578813554787931,-0.016206848567370872],[0.08903345641404117,0.13878736593959268,-0.027172312122508906,-0.10985725360549344],[-0.04378950499272721,0.11998187700037734,0.0775503495805809,0.07745178641542566],[-0.012848016797949648,-0.07391528120500498,0.029169244037526954,0.18147124358878464],[0.025001306819631773,0.10262177416822624,0.017500686125216453,-0.10245254752311968],[0.03216099845469013,0.061338741283772695,0.08435052274829966,-0.024649974912626254],[0.0009551320356251923,-0.135093518293596,0.0027067180188598268,0.00820539526761872],[0.011651552956254009,0.03816748190391262,0.08162840442110818,-0.050235423524971894],[0.15915065100387019,-0.07983423982156246,-0.09277543735989892,0.0696291812252809],[-0.07526786238229762,-0.012112709981158482,-0.07139261122417837,-0.06200584445782502],[0.09003772567531533,0.10286807417242162,-0.024295698853276818,-0.09714869740908183],[0.08640785284649581,0.04344403008019797,0.015239502757112366,0.05762055687539592],[-0.07111940641619395,0.023969362408984354,-0.019255896335028395,-0.0036358448673227553],[0.04369815143828165,-0.10949899331375958,0.061019043022492545,0.10201983921099866],[0.04744703009571804,0.04856240557976804,0.06881422775140304,-0.07371373581469408],[-0.12496862632059656,0.17125186744021906,0.052320274780596865,0.05982430515708972],[-0.11022634171326139,-0.16450660890571406,0.13756027193930134,-0.03938112323468455],[-0.05548402115424234,0.06542012056031755,0.15613866032381546,-0.023162332115865644],[-0.03228827351860073,0.101304128843583,0.09862508529385676,0.07404972160660625],[-0.011399660641401103,0.14014171912146445,-0.04649932654207598,-0.05844140423356841],[-0.03044707993629234,-0.14990537358255815,0.21190868286586217,0.018004290803560356],[-0.05360918232806284,-0.06126235986841665,-0.033866649679985,0.05955510047296418],[0.046404424153769004,0.08002209313812125,-0.15846438155367468,-0.10616823047917723],[-0.019490041903761884,-0.12683526839756715,0.005154476366643357,0.15996937587793472],[-0.04130525857922565,0.05532088872987282,0.040247767351422596,0.1068862338700301],[-0.02942580713344489,0.057557229755037326,-0.10788200188290563,-0.15338318034262863],[0.10423766919099385,0.10823811734366001,-0.05507369470457548,-0.032852709354966585],[-0.15542098267079119,-0.11550391668012251,-0.04113408811447277,-0.05968551704129099],[0.10409552648498918,-0.12738914455150513,0.007609129360197464,-0.01536366473920701]],"loraB":[[0.19100894796903528,0.07845162212140419,-0.04256715659109078,0.04114513615701411,0.31429654404569174,0.06643542874897723,-0.050767992377526085,0.053702353352321534,-0.044624951866577306,0.13388079177919854,-0.05453611655550718,-0.010430044258172106,-0.014069836357414697,-0.028310016714388587,-0.008730703684274173,-0.007841082719336749,0.06046403209952343,-0.015945807281763192,0.03449182443055705,-0.03167014604497682,0.08070737926729679,0.1016269906778054,0.06750453439843435,-0.0008015436841089424,-0.09031443247940972,-0.0353229353092491,-0.076646738764269,0.06829451994976353,-0.056583173890483056,-0.026068515345077384,-0.016148120967577746,-0.10634019840975037,-0.04009048515742173,0.07523496044161088,-0.07997059299667703,0.03899110423188903,-0.11722794162431263,-0.054678628373358504,0.0427925721246569,0.057660788999962694,-0.07393749406472634,0.06630228203578505,-0.0703632488038324,-0.02563348665506213,-0.08544938736718484,-0.024996860555365298,0.07920362066602378,0.06525749691230631,-0.04441919939575682,0.029796154334438222,-0.05895455454783482,-0.02245152604923806,-0.02905817110741237,0.007412169213354949,0.07522304694702915,-0.06970202841663534,0.03886918458758656,0.09325454411353785,0.11805691424364231,-0.10836696332742048,0.13701463133782293,-0.09201037866338842,-0.04380443145970837,-0.0099953941618757,0.07552594294605222,-0.06952978805559078,-0.04931208278616121,-0.031879118852986665,-0.007262403552022573,0.020105259840070052,0.05197972350304866,-0.0083030520408096,-0.08777775366410911,-0.04681220450750544,0.04450309215210883,0.06404833205627583,0.13316056849273175,0.04081776712609698,-0.028689666746307213,-0.03587182224971205,-0.020187871104929332,-0.042081617367690956,0.10587097237090738,0.05701818227346346,-0.07074188317408878,-0.06271516724675226,-0.04282917487030531,-0.038264926084488955,-0.03678030527416493,0.061067828891606876,0.017534856824254312,0.002561716411191967,0.12429999080946226,0.023597659477527205,-0.08096596235114809,-0.04272003551218392,0.007425653071986625,0.00035150753220179043,-0.026619533062738218,-0.022832525831592617,-0.04049958772266375,0.021549281325148502,-0.007337834859209393,-0.018195024620194518,-0.07201184588992532,-0.040724682440540116,-0.05990094736461533,-0.10960264417681718,0.07535697049997712,-0.07323408964732636,-0.041730844093565755,0.09806104030365001,-0.05226811107361857,-0.04107818059671545,0.11964426424192161,0.038427614797380334,0.058276752724520195,-0.012283542779753423,0.06911115435711349,-0.04985320109692108,0.09030820803712233,-0.02824902456426183,0.006859234702241461,0.05457584306335672,0.11495856109762777,-0.026660405145394566,0.1213436167091843,-0.10141524225516846],[0.2801395238469827,0.05185540614625642,0.3044083329504696,-0.052028806199182515,0.4442660146058056,0.16582119634831746,-0.08296618997429264,0.10580317042279558,-0.03234443082091154,-0.07245947100910252,0.010460164086012441,0.07773229669134434,0.009418383233086752,0.10543723300732036,0.055371239042346206,-0.0067098844680343155,0.0525988317557389,0.040858702626193066,-0.08690430585165898,-0.03452548016446144,-0.093848629506148,0.012030711339448387,-0.02283369445662803,0.06369547165515119,-0.07614803732080672,0.006590989469733498,-0.06773131738128181,0.00993514769532268,-0.017718362802679376,0.13720471638070222,0.009652621810170613,-0.08638297478503396,-0.017051537155378493,0.029956899639322812,0.05220635059983352,0.002759536131025441,0.0366774751578081,-0.039232567409006776,0.061346643241476845,0.10192633830049663,-0.010187566206060688,-0.04365925589343478,0.026228588541266237,0.15077560613543112,-0.04077805829029807,-0.01137716891277439,0.08137801278912074,-0.054716634348980386,0.05585219856257687,0.055122157795413566,0.04388913619217107,0.031128544735585437,-0.04898309499552953,0.015206098441605458,0.07493024814747604,0.07212080381679056,0.07262601872765535,-0.11194999268034048,0.04812822779820275,-0.04789321798188401,0.0614230436370795,-0.0645125788747375,-0.01910519890775222,0.08531724693288337,-0.03188132182026957,-0.01910150960455477,-0.05140330898361121,0.004137479427671141,-0.013159504968302553,0.022315422051093468,0.03192214227146925,-0.055637065836683305,-0.07967420555906017,0.04200167734248374,-0.11409766666685892,0.03590336885184325,-0.056157170823474586,0.08524762729994945,-0.027871882658800758,-0.01441920505639404,-0.0038112006762417985,0.006452743839417423,-0.04556868878559045,0.012081109405243996,0.03832484409963919,0.012380950311520526,0.02829556253682895,-0.03608906116069637,-0.06329603620769866,0.035297787195174714,0.01732098485326259,0.01613032691561439,0.0618565098915998,-0.03477502429271113,-0.026245014842867273,-0.1180258028865681,0.04374286784339297,0.08435829642495452,-0.0167637901560472,-0.05985723188786062,-0.010247299849391113,-0.13898871465761176,-0.017349664233363017,-0.07254832906367265,-0.025595625583030128,0.09359023215525737,-0.06537089875009658,0.09976945618826641,-0.048301724095208054,-0.11917848337767907,-0.01977344329123508,-0.003773771726775184,0.11057455849803502,-0.0259935663192358,-0.12926635934165423,0.0940872094304283,-0.04251049146418049,-0.13510213871122978,-0.005735528076631665,0.06404642592619773,0.055653642731485174,-0.025528038560153128,0.08657732314957342,0.0048637161357372805,0.057889028227917645,0.012961057836701486,0.05461510383780566,0.06467212634968975],[-0.26165281003408286,0.06221612563132249,-0.2631811385939794,0.08782848670155657,-0.11772543222719765,-0.2675667424763836,0.009388957483990934,0.02281014222940258,-0.06451007407027294,0.06161140206014062,-0.08976170506100371,-0.028815816115298324,-0.027552553602173555,0.037588297953749204,0.08599256892282058,0.08372429352153093,-0.021903875651202772,0.09579866833872883,-0.08370150710887304,0.06773232804388812,0.05692996580222587,-0.02464913928692528,-0.09927947134665906,-0.13843710693103506,-0.02465322311487174,0.13304842249840754,0.011311056018259885,0.11379389231739957,0.06519820902045508,0.06680088722301866,0.11435641730077303,0.024931908416630257,0.08071077357734117,0.002374963255753873,0.05241051955190812,0.11600382022214278,-0.10283486746149806,-0.01774672548620201,0.024604424409141002,0.010889413627070924,0.05876947270898327,-0.03699310013736281,-0.07414233631027559,0.0450772806697968,0.060407378097481146,0.11896155175317466,-0.012545390856775793,0.0656691788160913,0.07779552728993365,-0.024718378488531034,0.014871944485914829,-0.08003487541894386,-0.010727608307056857,-0.07259845355142781,-0.019371475004307512,0.04513617520771543,0.08661984739440075,-0.008274271164445426,-0.10137604660952715,0.013394163364890528,0.03704950913513372,-0.054032346717101574,-0.01996945954261241,0.10853460072083425,-0.04940618127570187,-0.038534804030023746,-0.09230414761484056,0.07637696620347903,0.06752617952137166,0.019831648977596737,-0.13108743457376254,0.08226406895849542,0.08076218473770261,-0.04934128098726969,0.035367270105072124,-0.061903256298280133,0.07242483420729078,-0.005330168420853395,0.061262601831074834,-0.047411964120449686,-0.07370218516077785,-0.09597487797520389,0.011100187721234764,-0.07844522106474786,-0.022965248034680533,-0.03806803480284363,0.08162148430782389,0.08929751236520878,0.027563785329474885,0.07525110252897485,-0.015657677720105047,0.050365215160609295,-0.030622556779640635,-0.014761761246610352,-0.03993578929030858,-0.03194395099221452,-0.1185488265511613,0.051253737317995575,-0.0024783644734804535,0.1166783629237361,-0.056763233255294594,0.00574872083137243,0.08553236984035649,-0.07206897450663093,-0.07691722782321565,0.007952948632406295,-0.0653276628678898,0.06278907903309824,0.041220584763253014,0.008185443270584052,-0.023524566826894463,-0.0023746252949000597,-0.0308638785436628,-0.052670558681345694,-0.011167928733796956,-0.04156391479151779,-0.12308999958543608,-0.06648276019409537,-0.0873153452101025,-0.10106072344089181,0.011869040315966101,0.09117099388383375,-0.04001360536453003,0.016804463471948895,0.042034501927562716,0.03660717887665719,0.06073070405997564,0.0072808971338375415],[-0.31078279138086917,0.010926784103360105,-0.38193025702646155,-0.020942431934102664,-0.08416815823561151,-0.10823455603020564,0.07221792560827137,-0.08222287878316283,-0.036768875160311534,0.00009724183968726965,0.04728204133407052,-0.012251162571091784,0.08333223241151314,0.07870619876621052,-0.008212438536624242,0.07381801340354092,0.10777281401395025,-0.04686837159169395,-0.002367354828825069,-0.1002532317980848,0.07790110785965279,0.027309625511010936,-0.018171889146727484,-0.07319519782143653,0.009532836173207984,0.07324675142742879,-0.06505717299703086,0.022453186128763215,-0.05113244510011685,-0.07420118628171181,-0.023801196399846326,-0.03385442169102362,-0.09018914079032418,-0.08888895912290817,-0.08988275952091102,-0.027888921251927584,-0.028519934684015723,-0.037684960505290487,-0.07523224007211483,0.07756941405974906,-0.054784995175661086,0.024548742888163486,0.02782230173844307,-0.0534794892622319,-0.05621145309344925,-0.05056879693872841,0.044175193555084195,-0.08176749576851988,-0.010772369231841161,-0.095577950641518,-0.01394889137305893,-0.053882199222224716,0.11273208857294885,-0.030442065985840695,0.0948526668951155,0.04553809617566418,-0.014029481336274312,-0.1327305955803546,-0.04354881373420554,0.09257121643205803,0.04927591850256987,0.034542444099883815,0.027984460797549855,-0.0104699907935939,-0.0742291594805391,-0.004077168325262662,0.04146046893343607,-0.0009067010232774914,0.06439611521308777,0.13201932452105417,-0.07583108360236072,-0.038277623211219344,-0.04042737932541096,-0.10086418926276743,-0.09247948176488997,0.05938219854745549,0.03689968049333272,0.05172614275161842,-0.09568932168403692,0.018059351652189488,-0.003785975741851866,0.05887538308786149,0.0012467559730370914,0.08509185063068916,0.0032280280892604003,0.08074421419235954,-0.03014722052363649,-0.006250139239699415,-0.11219573961781318,0.05003045080796754,-0.14926823712252488,0.06319384641547778,-0.05637956842399434,-0.09129082725070932,0.030539074305155768,-0.09863178627139747,0.02048480942411997,-0.05395446124041598,-0.10876681500881327,0.013080899138481962,0.02910939270780682,0.024119070712459216,-0.06397190790691949,0.05796582302632676,0.011450397952100925,0.006377832608005655,0.04759662773663773,-0.076739746632555,0.05226194230205828,0.05883728486181689,-0.03378795571839688,-0.020307324539956224,-0.06829685150088649,0.07513059468803732,-0.04158504105190288,0.09671074377075574,-0.02781287700925507,-0.0091712934177907,-0.010519521710630201,0.04951534425992542,-0.03733038556300227,0.008109433101047562,-0.12057922309982737,-0.10632422474293593,0.0761211490596665,0.012844954904159938,0.05175542091697021,0.09526008448864211]],"scaling":2},"frozen":false}
presence-head.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"weights":[0.16249253823755372,0.45526789144896596,0.12492953953422031,0.12261533974612185,0.39506264299330335,0.40040055734786767,0.45385438887054513,-0.46760599791922863,0.14165166328785878,0.6595475450126798,-0.328829224694709,-0.1763501348401555,0.1370635484019669,-0.10399425033058449,0.15195725676676675,0.22494451767332602,0.4235436010254722,0.36777007709136006,-0.295829945253463,-0.09205757813281747,0.5759911826833596,-0.039703013471043325,-0.285989548682573,-0.061452064870798316,0.2361729128805553,0.35985688021473283,-0.23573872113189792,0.5426851990022185,-0.42774302018111404,-0.15055840372866028,-0.11009772671939423,-0.4355229341067481,-0.24755997939786753,-0.22248865374154062,-0.22440192782440702,0.16079164785548217,-0.6026309828311394,-0.5144482204361387,-0.2308412781655133,0.2895125032585462,-0.41096132978389305,-0.02784207248329446,-0.31010629168233306,0.07998730871728246,-0.21341600965555674,-0.3374293510463456,0.0895061467108961,0.06935740106747343,0.2131692986380514,-0.32786264456004555,-0.11753236417264894,-0.23322920420757107,0.13790380877261713,-0.001655160395528332,0.24186879351716717,0.328894788835841,-0.07567646571357342,-0.8285976091719194,-0.3729216310490358,0.1367754729029241,0.34331826483231215,-0.025713764062409557,-0.04533802646289459,-0.1489829908553463,-0.40004316172556303,-0.0648813816885913,-0.2570626831855534,0.6567823661990988,0.07720698562815619,0.2915927700389038,-0.2411563644207094,-0.17076130443795617,-0.13487331806814276,-0.464838137237158,-0.23532032738674666,0.22262374158908735,-0.12840610201780517,0.31183334832207105,-0.29689932294964333,-0.4481328561978342,-0.351203311221857,0.14017320791338334,0.5809086878678772,0.4482880792870596,-0.10031471361255336,0.3420284571340416,-0.22888668347613209,-0.24028044168701285,-0.6838471528050107,-0.07291747533963898,-0.6144847813284295,-0.044058097432284976,-0.28242836116999137,-0.21522574901366298,-0.17297900913432385,-0.24814649209801834,-0.12109579297771635,-0.21178247049866103,0.07246663293885482,0.5195147032549458,0.17736208175964657,0.33135044793452473,-0.3964883987067539,-0.15622306777907938,0.05074950967684649,0.1305203189577412,0.21180396037876906,-0.018415628289803514,0.5241963627799814,0.14416368688435366,-0.732629144428684,0.020654334880740154,-0.21481938517383078,0.37333313640800697,-0.0021573197204178673,0.4787482122298732,-0.4784721366360613,-0.24938715574830828,0.07357346724407804,-0.10561585018790567,0.532425931470989,0.501788501949149,-0.735444916399551,-0.3322375887562235,0.189116342521778,-0.16394476136049216,0.14180820512292372,0.2517807690872189],"bias":8.188347903432906}
training-metrics.json ADDED
@@ -0,0 +1,162 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "timestamp": "2026-04-03T13:59:51.684Z",
3
+ "totalDurationMs": 719674,
4
+ "data": {
5
+ "files": [
6
+ "overnight-1775217646.csi.jsonl"
7
+ ],
8
+ "totalFeatures": 60630,
9
+ "totalVitals": 6063,
10
+ "totalRawCsi": 132815,
11
+ "nodes": [
12
+ 2,
13
+ 1
14
+ ]
15
+ },
16
+ "contrastive": {
17
+ "triplets": 610615,
18
+ "temporal": 574608,
19
+ "crossNode": 35807,
20
+ "hardNegatives": 4281,
21
+ "initialLoss": 0.13517337199511226,
22
+ "finalLoss": 0.06543377335206552,
23
+ "improvement": 51.59270469746694,
24
+ "durationMs": 12396,
25
+ "lossHistory": [
26
+ {
27
+ "epoch": 1,
28
+ "loss": 0.13517249387333863
29
+ },
30
+ {
31
+ "epoch": 2,
32
+ "loss": 0.13517372120302518
33
+ },
34
+ {
35
+ "epoch": 3,
36
+ "loss": 0.13517242431674364
37
+ },
38
+ {
39
+ "epoch": 4,
40
+ "loss": 0.13517363238961252
41
+ },
42
+ {
43
+ "epoch": 5,
44
+ "loss": 0.13517360470273543
45
+ },
46
+ {
47
+ "epoch": 6,
48
+ "loss": 0.13517317208904908
49
+ },
50
+ {
51
+ "epoch": 7,
52
+ "loss": 0.13517325534936073
53
+ },
54
+ {
55
+ "epoch": 8,
56
+ "loss": 0.1351735170740564
57
+ },
58
+ {
59
+ "epoch": 9,
60
+ "loss": 0.13517326084057218
61
+ },
62
+ {
63
+ "epoch": 10,
64
+ "loss": 0.13517247811462849
65
+ },
66
+ {
67
+ "epoch": 11,
68
+ "loss": 0.13517391330821046
69
+ },
70
+ {
71
+ "epoch": 12,
72
+ "loss": 0.13517263478054217
73
+ },
74
+ {
75
+ "epoch": 13,
76
+ "loss": 0.13517311152747669
77
+ },
78
+ {
79
+ "epoch": 14,
80
+ "loss": 0.1351731664032846
81
+ },
82
+ {
83
+ "epoch": 15,
84
+ "loss": 0.13517440896107477
85
+ },
86
+ {
87
+ "epoch": 16,
88
+ "loss": 0.13517229082040794
89
+ },
90
+ {
91
+ "epoch": 17,
92
+ "loss": 0.1351714953647903
93
+ },
94
+ {
95
+ "epoch": 18,
96
+ "loss": 0.1351734771570791
97
+ },
98
+ {
99
+ "epoch": 19,
100
+ "loss": 0.13517448957188427
101
+ },
102
+ {
103
+ "epoch": 20,
104
+ "loss": 0.13517310018820136
105
+ }
106
+ ]
107
+ },
108
+ "taskHeads": {
109
+ "samples": 60630,
110
+ "finalLoss": 0.026100552486452076
111
+ },
112
+ "lora": {
113
+ "adapters": [
114
+ "node-2",
115
+ "node-1"
116
+ ],
117
+ "totalParameters": 2048
118
+ },
119
+ "quantization": {
120
+ "q2": {
121
+ "compressionRatio": 16,
122
+ "rmse": 0.1268553520164218,
123
+ "sizeKB": 4
124
+ },
125
+ "q4": {
126
+ "compressionRatio": 8,
127
+ "rmse": 0.032087730426657655,
128
+ "sizeKB": 8
129
+ },
130
+ "q8": {
131
+ "compressionRatio": 4,
132
+ "rmse": 0.0027767646652348487,
133
+ "sizeKB": 16
134
+ }
135
+ },
136
+ "ewc": {
137
+ "tasksLearned": 4,
138
+ "fisherComputed": true,
139
+ "protectionStrength": 2000,
140
+ "forgettingRate": 0.3296799539643607
141
+ },
142
+ "config": {
143
+ "dataGlob": "data/recordings/overnight-1775217646.csi.jsonl",
144
+ "outputDir": "models/csi-ruvllm",
145
+ "benchmark": false,
146
+ "epochs": 20,
147
+ "batchSize": 32,
148
+ "loraRank": 4,
149
+ "quantizeBits": 4,
150
+ "verbose": false,
151
+ "margin": 0.3,
152
+ "temperature": 0.07,
153
+ "hardNegativeRatio": 0.7,
154
+ "learningRate": 0.001,
155
+ "positiveWindowSec": 1,
156
+ "negativeWindowSec": 10,
157
+ "augmentMultiplier": 10,
158
+ "inputDim": 8,
159
+ "hiddenDim": 64,
160
+ "embeddingDim": 128
161
+ }
162
+ }
wiflow-v1/MODEL_CARD.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # WiFlow v1 — WiFi CSI Pose Estimation Model
2
+
3
+ Camera-supervised WiFlow pose model trained on real ESP32 CSI + MediaPipe ground truth.
4
+
5
+ ## Metrics
6
+ - **PCK@20: 92.9%** (17 COCO keypoints)
7
+ - Eval loss: 0.082
8
+ - Bone constraint loss: 0.008
9
+ - Parameters: 186,946 (974 KB)
10
+
11
+ ## Architecture
12
+ - TCN: 2 dilated causal conv blocks (k=3, d=[1,2])
13
+ - Input: 35 subcarriers x 20 time steps (ruvector-solver reduced from 70)
14
+ - Output: 17 COCO keypoints [x, y] in [0, 1]
15
+ - Scale: lite (189K params)
16
+
17
+ ## Training
18
+ - 345 paired samples (5 min capture)
19
+ - ESP32-S3 CSI: 7,000 frames at 23fps
20
+ - Mac camera: 6,470 frames at 22fps via MediaPipe PoseLandmarker
21
+ - 50 epochs (33 supervised + 17 refinement)
22
+ - ruvector optimizations: O6 subcarrier selection, O7 attention, O8 Stoer-Wagner min-cut, O9 multi-SPSA
23
+
24
+ ## Usage
25
+ ```javascript
26
+ const model = JSON.parse(fs.readFileSync('wiflow-v1.json'));
27
+ // Load into WiFlowSupervisedModel and call forward(csiInput)
28
+ ```
29
+
30
+ ## License
31
+ Apache-2.0
wiflow-v1/baseline-report.json ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "model": "baseline-proxy",
3
+ "n_samples": 265,
4
+ "pck_10": 0.1176,
5
+ "pck_20": 0.3529,
6
+ "pck_50": 0.9412,
7
+ "mpjpe": 0.06646,
8
+ "per_joint_pck20": {
9
+ "nose": 0,
10
+ "l_eye": 0,
11
+ "r_eye": 0,
12
+ "l_ear": 1,
13
+ "r_ear": 1,
14
+ "l_shoulder": 0,
15
+ "r_shoulder": 0,
16
+ "l_elbow": 0,
17
+ "r_elbow": 1,
18
+ "l_wrist": 0,
19
+ "r_wrist": 0,
20
+ "l_hip": 0,
21
+ "r_hip": 0,
22
+ "l_knee": 1,
23
+ "r_knee": 1,
24
+ "l_ankle": 1,
25
+ "r_ankle": 0
26
+ },
27
+ "per_joint_mpjpe": {
28
+ "nose": 0.08266,
29
+ "l_eye": 0.1101,
30
+ "r_eye": 0.10876,
31
+ "l_ear": 0.02158,
32
+ "r_ear": 0.03685,
33
+ "l_shoulder": 0.07424,
34
+ "r_shoulder": 0.05226,
35
+ "l_elbow": 0.09256,
36
+ "r_elbow": 0.03015,
37
+ "l_wrist": 0.15304,
38
+ "r_wrist": 0.06643,
39
+ "l_hip": 0.05513,
40
+ "r_hip": 0.05096,
41
+ "l_knee": 0.02456,
42
+ "r_knee": 0.03984,
43
+ "l_ankle": 0.04859,
44
+ "r_ankle": 0.0822
45
+ },
46
+ "conf_weighted_pck20": 0.3529,
47
+ "conf_weighted_mpjpe": 0.06646,
48
+ "inference_latency_ms": 0.03,
49
+ "timestamp": "2026-04-06T19:05:33.118Z"
50
+ }
wiflow-v1/training-log.json ADDED
@@ -0,0 +1,445 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "config": {
3
+ "dataPath": "data/paired/real-paired-clamp.jsonl",
4
+ "outputDir": "models/wiflow-real",
5
+ "totalEpochs": 50,
6
+ "batchSize": 32,
7
+ "lr": 0.00005,
8
+ "skipContrastive": true,
9
+ "evalSplit": 0.2,
10
+ "verbose": false,
11
+ "contrastiveRatio": 0.16666666666666666,
12
+ "supervisedRatio": 0.6666666666666666,
13
+ "refinementRatio": 0.16666666666666666,
14
+ "curriculumStages": [
15
+ 0.9,
16
+ 0.7,
17
+ 0.5,
18
+ 0
19
+ ],
20
+ "timeSteps": 20,
21
+ "numKeypoints": 17,
22
+ "momentum": 0.9,
23
+ "boneWeight": 0.3,
24
+ "temporalWeight": 0.1,
25
+ "inputDim": 35,
26
+ "contrastiveEpochs": 0,
27
+ "supervisedEpochs": 33,
28
+ "refinementEpochs": 17
29
+ },
30
+ "phases": [
31
+ {
32
+ "phase": "supervised",
33
+ "epochs": [
34
+ {
35
+ "epoch": 8,
36
+ "stage": 2,
37
+ "confThreshold": 0.7,
38
+ "loss": 0.1202345175039164,
39
+ "evalLoss": 0.1202650439646902,
40
+ "pck20": 0.8542199488491047,
41
+ "lr": 0.00004309335095262676,
42
+ "trainSamples": 276
43
+ },
44
+ {
45
+ "epoch": 9,
46
+ "stage": 2,
47
+ "confThreshold": 0.7,
48
+ "loss": 0.12202338882917359,
49
+ "evalLoss": 0.12768733107391242,
50
+ "pck20": 0.6990622335890878,
51
+ "lr": 0.00004137151834863213,
52
+ "trainSamples": 276
53
+ },
54
+ {
55
+ "epoch": 10,
56
+ "stage": 2,
57
+ "confThreshold": 0.7,
58
+ "loss": 0.12825024591293,
59
+ "evalLoss": 0.1270527974255793,
60
+ "pck20": 0.7263427109974423,
61
+ "lr": 0.000039501422739279956,
62
+ "trainSamples": 276
63
+ },
64
+ {
65
+ "epoch": 11,
66
+ "stage": 2,
67
+ "confThreshold": 0.7,
68
+ "loss": 0.12936392720518736,
69
+ "evalLoss": 0.13037437100569574,
70
+ "pck20": 0.757885763000853,
71
+ "lr": 0.000037500000000000003,
72
+ "trainSamples": 276
73
+ },
74
+ {
75
+ "epoch": 12,
76
+ "stage": 2,
77
+ "confThreshold": 0.7,
78
+ "loss": 0.12725472830309995,
79
+ "evalLoss": 0.12384917381806493,
80
+ "pck20": 0.7374254049445861,
81
+ "lr": 0.000035385375325047166,
82
+ "trainSamples": 276
83
+ },
84
+ {
85
+ "epoch": 13,
86
+ "stage": 2,
87
+ "confThreshold": 0.7,
88
+ "loss": 0.12385725997187584,
89
+ "evalLoss": 0.12461516379265465,
90
+ "pck20": 0.7433930093776641,
91
+ "lr": 0.000033176699082935545,
92
+ "trainSamples": 276
93
+ },
94
+ {
95
+ "epoch": 14,
96
+ "stage": 2,
97
+ "confThreshold": 0.7,
98
+ "loss": 0.121912843072227,
99
+ "evalLoss": 0.11932654898819652,
100
+ "pck20": 0.7706734867860185,
101
+ "lr": 0.000030893973387735687,
102
+ "trainSamples": 276
103
+ },
104
+ {
105
+ "epoch": 15,
106
+ "stage": 2,
107
+ "confThreshold": 0.7,
108
+ "loss": 0.11553358296530863,
109
+ "evalLoss": 0.11448958151882806,
110
+ "pck20": 0.9036658141517468,
111
+ "lr": 0.000028557870956832132,
112
+ "trainSamples": 276
113
+ },
114
+ {
115
+ "epoch": 16,
116
+ "stage": 3,
117
+ "confThreshold": 0.5,
118
+ "loss": 0.11394043133921662,
119
+ "evalLoss": 0.11232644030163798,
120
+ "pck20": 0.9096334185848243,
121
+ "lr": 0.000026189547895593562,
122
+ "trainSamples": 276
123
+ },
124
+ {
125
+ "epoch": 17,
126
+ "stage": 3,
127
+ "confThreshold": 0.5,
128
+ "loss": 0.10948012598944228,
129
+ "evalLoss": 0.10736237566429192,
130
+ "pck20": 0.9190110826939465,
131
+ "lr": 0.000023810452104406444,
132
+ "trainSamples": 276
133
+ },
134
+ {
135
+ "epoch": 18,
136
+ "stage": 3,
137
+ "confThreshold": 0.5,
138
+ "loss": 0.10622061844175851,
139
+ "evalLoss": 0.10554791605589925,
140
+ "pck20": 0.9224211423699906,
141
+ "lr": 0.000021442129043167874,
142
+ "trainSamples": 276
143
+ },
144
+ {
145
+ "epoch": 19,
146
+ "stage": 3,
147
+ "confThreshold": 0.5,
148
+ "loss": 0.10454447340293044,
149
+ "evalLoss": 0.10382043899664628,
150
+ "pck20": 0.9215686274509797,
151
+ "lr": 0.000019106026612264326,
152
+ "trainSamples": 276
153
+ },
154
+ {
155
+ "epoch": 20,
156
+ "stage": 3,
157
+ "confThreshold": 0.5,
158
+ "loss": 0.10241404779846577,
159
+ "evalLoss": 0.10137100661047628,
160
+ "pck20": 0.9232736572890018,
161
+ "lr": 0.00001682330091706446,
162
+ "trainSamples": 276
163
+ },
164
+ {
165
+ "epoch": 21,
166
+ "stage": 3,
167
+ "confThreshold": 0.5,
168
+ "loss": 0.10052735078244243,
169
+ "evalLoss": 0.10080157734640532,
170
+ "pck20": 0.9232736572890018,
171
+ "lr": 0.000014614624674952837,
172
+ "trainSamples": 276
173
+ },
174
+ {
175
+ "epoch": 22,
176
+ "stage": 3,
177
+ "confThreshold": 0.5,
178
+ "loss": 0.09994398953615607,
179
+ "evalLoss": 0.10015142701439284,
180
+ "pck20": 0.9232736572890018,
181
+ "lr": 0.000012500000000000006,
182
+ "trainSamples": 276
183
+ },
184
+ {
185
+ "epoch": 23,
186
+ "stage": 3,
187
+ "confThreshold": 0.5,
188
+ "loss": 0.09929149190664616,
189
+ "evalLoss": 0.09950004892959943,
190
+ "pck20": 0.9232736572890018,
191
+ "lr": 0.00001049857726072005,
192
+ "trainSamples": 276
193
+ },
194
+ {
195
+ "epoch": 24,
196
+ "stage": 4,
197
+ "confThreshold": 0,
198
+ "loss": 0.09857283315945391,
199
+ "evalLoss": 0.09854543363902651,
200
+ "pck20": 0.9232736572890018,
201
+ "lr": 0.000008628481651367876,
202
+ "trainSamples": 552
203
+ },
204
+ {
205
+ "epoch": 25,
206
+ "stage": 4,
207
+ "confThreshold": 0,
208
+ "loss": 0.09782671456921876,
209
+ "evalLoss": 0.09771453065823558,
210
+ "pck20": 0.9232736572890018,
211
+ "lr": 0.000006906649047373246,
212
+ "trainSamples": 552
213
+ },
214
+ {
215
+ "epoch": 26,
216
+ "stage": 4,
217
+ "confThreshold": 0,
218
+ "loss": 0.09710556690724673,
219
+ "evalLoss": 0.0969643238344358,
220
+ "pck20": 0.9232736572890018,
221
+ "lr": 0.000005348672631430313,
222
+ "trainSamples": 552
223
+ },
224
+ {
225
+ "epoch": 27,
226
+ "stage": 4,
227
+ "confThreshold": 0,
228
+ "loss": 0.09644318116959444,
229
+ "evalLoss": 0.09656814571783083,
230
+ "pck20": 0.9232736572890018,
231
+ "lr": 0.000003968661679220473,
232
+ "trainSamples": 552
233
+ },
234
+ {
235
+ "epoch": 28,
236
+ "stage": 4,
237
+ "confThreshold": 0,
238
+ "loss": 0.09587479137308834,
239
+ "evalLoss": 0.09621587546104406,
240
+ "pck20": 0.9232736572890018,
241
+ "lr": 0.000002779113783626916,
242
+ "trainSamples": 552
243
+ },
244
+ {
245
+ "epoch": 29,
246
+ "stage": 4,
247
+ "confThreshold": 0,
248
+ "loss": 0.095646920219553,
249
+ "evalLoss": 0.09603035061275683,
250
+ "pck20": 0.9232736572890018,
251
+ "lr": 0.000001790801674598186,
252
+ "trainSamples": 552
253
+ },
254
+ {
255
+ "epoch": 30,
256
+ "stage": 4,
257
+ "confThreshold": 0,
258
+ "loss": 0.09563373023370147,
259
+ "evalLoss": 0.09590667483554177,
260
+ "pck20": 0.9232736572890018,
261
+ "lr": 0.0000010126756596375686,
262
+ "trainSamples": 552
263
+ },
264
+ {
265
+ "epoch": 31,
266
+ "stage": 4,
267
+ "confThreshold": 0,
268
+ "loss": 0.09565320996677595,
269
+ "evalLoss": 0.09583995214951894,
270
+ "pck20": 0.9232736572890018,
271
+ "lr": 4.5178256843233513e-7,
272
+ "trainSamples": 552
273
+ },
274
+ {
275
+ "epoch": 32,
276
+ "stage": 4,
277
+ "confThreshold": 0,
278
+ "loss": 0.09559600900155292,
279
+ "evalLoss": 0.09582890515717067,
280
+ "pck20": 0.9232736572890018,
281
+ "lr": 1.1320193567288529e-7,
282
+ "trainSamples": 552
283
+ }
284
+ ]
285
+ },
286
+ {
287
+ "phase": "refinement",
288
+ "epochs": [
289
+ {
290
+ "epoch": 33,
291
+ "loss": 0.09701607626199084,
292
+ "boneLoss": 0.008328167800411033,
293
+ "temporalLoss": 0,
294
+ "evalLoss": 0.09398452057857512,
295
+ "pck20": 0.9224211423699906,
296
+ "lr": 0.000025
297
+ },
298
+ {
299
+ "epoch": 34,
300
+ "loss": 0.09559415324560026,
301
+ "boneLoss": 0.007928355392524818,
302
+ "temporalLoss": 0,
303
+ "evalLoss": 0.09261685967463618,
304
+ "pck20": 0.9232736572890018,
305
+ "lr": 0.000024787163746048776
306
+ },
307
+ {
308
+ "epoch": 35,
309
+ "loss": 0.0937338397275952,
310
+ "boneLoss": 0.007887900375719051,
311
+ "temporalLoss": 0,
312
+ "evalLoss": 0.09073041961606622,
313
+ "pck20": 0.9224211423699906,
314
+ "lr": 0.000024155902867554447
315
+ },
316
+ {
317
+ "epoch": 36,
318
+ "loss": 0.09201024094364278,
319
+ "boneLoss": 0.00787968505949037,
320
+ "temporalLoss": 0,
321
+ "evalLoss": 0.08904968648766556,
322
+ "pck20": 0.9224211423699906,
323
+ "lr": 0.00002312771419662018
324
+ },
325
+ {
326
+ "epoch": 37,
327
+ "loss": 0.0900738158246732,
328
+ "boneLoss": 0.007898852512024901,
329
+ "temporalLoss": 0,
330
+ "evalLoss": 0.08739649689835581,
331
+ "pck20": 0.9232736572890018,
332
+ "lr": 0.00002173761146525824
333
+ },
334
+ {
335
+ "epoch": 38,
336
+ "loss": 0.08872982797507926,
337
+ "boneLoss": 0.008049209921715138,
338
+ "temporalLoss": 0,
339
+ "evalLoss": 0.08634493550993017,
340
+ "pck20": 0.9275362318840571,
341
+ "lr": 0.000020032932954740708
342
+ },
343
+ {
344
+ "epoch": 39,
345
+ "loss": 0.08807447949516382,
346
+ "boneLoss": 0.008001218330457414,
347
+ "temporalLoss": 0,
348
+ "evalLoss": 0.08558730437074917,
349
+ "pck20": 0.9292412617220792,
350
+ "lr": 0.000018071729447206733
351
+ },
352
+ {
353
+ "epoch": 40,
354
+ "loss": 0.08706284437260242,
355
+ "boneLoss": 0.007840473818814284,
356
+ "temporalLoss": 0,
357
+ "evalLoss": 0.08471010713466626,
358
+ "pck20": 0.927536231884057,
359
+ "lr": 0.000015920787375901038
360
+ },
361
+ {
362
+ "epoch": 41,
363
+ "loss": 0.08604835426163508,
364
+ "boneLoss": 0.007663920377313184,
365
+ "temporalLoss": 0,
366
+ "evalLoss": 0.08400298512163402,
367
+ "pck20": 0.927536231884057,
368
+ "lr": 0.000013653354493291276
369
+ },
370
+ {
371
+ "epoch": 42,
372
+ "loss": 0.08560569613850501,
373
+ "boneLoss": 0.007651553561183805,
374
+ "temporalLoss": 0,
375
+ "evalLoss": 0.08322107553620108,
376
+ "pck20": 0.928388746803068,
377
+ "lr": 0.000011346645506708726
378
+ },
379
+ {
380
+ "epoch": 43,
381
+ "loss": 0.08482218876088875,
382
+ "boneLoss": 0.0076320660048834164,
383
+ "temporalLoss": 0,
384
+ "evalLoss": 0.08260210233693983,
385
+ "pck20": 0.9292412617220792,
386
+ "lr": 0.000009079212624098965
387
+ },
388
+ {
389
+ "epoch": 44,
390
+ "loss": 0.08466924374919721,
391
+ "boneLoss": 0.007591246856100821,
392
+ "temporalLoss": 0,
393
+ "evalLoss": 0.08220475184589006,
394
+ "pck20": 0.9292412617220792,
395
+ "lr": 0.000006928270552793279
396
+ },
397
+ {
398
+ "epoch": 45,
399
+ "loss": 0.08372166327234049,
400
+ "boneLoss": 0.007556008480447692,
401
+ "temporalLoss": 0,
402
+ "evalLoss": 0.08194887303484837,
403
+ "pck20": 0.9292412617220792,
404
+ "lr": 0.000004967067045259296
405
+ },
406
+ {
407
+ "epoch": 46,
408
+ "loss": 0.08351445528236756,
409
+ "boneLoss": 0.007548495414354707,
410
+ "temporalLoss": 0,
411
+ "evalLoss": 0.08170149165016606,
412
+ "pck20": 0.9292412617220792,
413
+ "lr": 0.0000032623885347417586
414
+ },
415
+ {
416
+ "epoch": 47,
417
+ "loss": 0.08341810004822017,
418
+ "boneLoss": 0.007546424241410138,
419
+ "temporalLoss": 0,
420
+ "evalLoss": 0.08158904121000707,
421
+ "pck20": 0.9292412617220792,
422
+ "lr": 0.0000018722858033798252
423
+ },
424
+ {
425
+ "epoch": 48,
426
+ "loss": 0.08368925729745821,
427
+ "boneLoss": 0.007544776057062225,
428
+ "temporalLoss": 0,
429
+ "evalLoss": 0.08154689865199782,
430
+ "pck20": 0.9292412617220792,
431
+ "lr": 8.440971324455538e-7
432
+ },
433
+ {
434
+ "epoch": 49,
435
+ "loss": 0.08322168186510166,
436
+ "boneLoss": 0.007544423146452779,
437
+ "temporalLoss": 0,
438
+ "evalLoss": 0.0815356110051266,
439
+ "pck20": 0.9292412617220792,
440
+ "lr": 2.128362539512277e-7
441
+ }
442
+ ]
443
+ }
444
+ ]
445
+ }
wiflow-v1/wiflow-v1.json ADDED
The diff for this file is too large to render. See raw diff