nmk-kun commited on
Commit
0f0eda1
·
verified ·
1 Parent(s): 8733d13

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +31 -1
README.md CHANGED
@@ -1 +1,31 @@
1
- # CWM-Extended adapters (uploading...)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: fair-noncommercial-research
4
+ base_model: facebook/cwm
5
+ tags: [lora, peft, code-world-model, world-model]
6
+ ---
7
+
8
+ # CWM-Extended LoRA adapters
9
+
10
+ Trained LoRA adapters (r=16, attn+MLP) for the **CWM interactive/visual world-model** project
11
+ (code + full REPORT: https://github.com/namak-kun/cwm-extended). Base model: `facebook/cwm`.
12
+
13
+ Each subfolder is a loadable PEFT adapter. Headline ones:
14
+
15
+ | adapter | what it teaches | result |
16
+ |---|---|---|
17
+ | `cwm_gametick_stepover` | one-shot game-tick transition | 0.017 -> 0.692 |
18
+ | `cwm_fdm_idm_r1` / `_r2` | FDM<->IDM self-labeling flywheel | 0.525 -> 0.683 (~= oracle), stable 2 rounds |
19
+ | `cwm_cascade` | UI DOM-cascade step-over | in-dist win (uidom 0.80->1.0); NB negative transfer to real JS |
20
+ | `cwm_fdm_oracle_r1/_r2`, `cwm_fdm_hardoracle` | oracle-label controls | flywheel validation |
21
+ | `cwm_heldapp` | UI minus togglelist (abstraction test) | cross-app 0.44 -> 0.56 |
22
+ | `cwm_oop_expanded`, `cwm_mixed_expanded` | phi-expansion + forgetting fix | 0.02 -> 0.93 |
23
+ | `cwm_arith_*`, `cwm_dagger_*` | arithmetic / DAgger studies | mostly neutral (capability hole) |
24
+
25
+ Load (PEFT):
26
+ ```python
27
+ from peft import PeftModel
28
+ from transformers import AutoModelForCausalLM
29
+ base = AutoModelForCausalLM.from_pretrained("facebook/cwm")
30
+ model = PeftModel.from_pretrained(base, "nmk-kun/cwm-extended-adapters", subfolder="cwm_gametick_stepover")
31
+ ```