Instructions to use nmk-kun/cwm-extended-adapters with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use nmk-kun/cwm-extended-adapters with PEFT:
Task type is invalid.
- Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -1 +1,31 @@
|
|
| 1 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: fair-noncommercial-research
|
| 4 |
+
base_model: facebook/cwm
|
| 5 |
+
tags: [lora, peft, code-world-model, world-model]
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
# CWM-Extended LoRA adapters
|
| 9 |
+
|
| 10 |
+
Trained LoRA adapters (r=16, attn+MLP) for the **CWM interactive/visual world-model** project
|
| 11 |
+
(code + full REPORT: https://github.com/namak-kun/cwm-extended). Base model: `facebook/cwm`.
|
| 12 |
+
|
| 13 |
+
Each subfolder is a loadable PEFT adapter. Headline ones:
|
| 14 |
+
|
| 15 |
+
| adapter | what it teaches | result |
|
| 16 |
+
|---|---|---|
|
| 17 |
+
| `cwm_gametick_stepover` | one-shot game-tick transition | 0.017 -> 0.692 |
|
| 18 |
+
| `cwm_fdm_idm_r1` / `_r2` | FDM<->IDM self-labeling flywheel | 0.525 -> 0.683 (~= oracle), stable 2 rounds |
|
| 19 |
+
| `cwm_cascade` | UI DOM-cascade step-over | in-dist win (uidom 0.80->1.0); NB negative transfer to real JS |
|
| 20 |
+
| `cwm_fdm_oracle_r1/_r2`, `cwm_fdm_hardoracle` | oracle-label controls | flywheel validation |
|
| 21 |
+
| `cwm_heldapp` | UI minus togglelist (abstraction test) | cross-app 0.44 -> 0.56 |
|
| 22 |
+
| `cwm_oop_expanded`, `cwm_mixed_expanded` | phi-expansion + forgetting fix | 0.02 -> 0.93 |
|
| 23 |
+
| `cwm_arith_*`, `cwm_dagger_*` | arithmetic / DAgger studies | mostly neutral (capability hole) |
|
| 24 |
+
|
| 25 |
+
Load (PEFT):
|
| 26 |
+
```python
|
| 27 |
+
from peft import PeftModel
|
| 28 |
+
from transformers import AutoModelForCausalLM
|
| 29 |
+
base = AutoModelForCausalLM.from_pretrained("facebook/cwm")
|
| 30 |
+
model = PeftModel.from_pretrained(base, "nmk-kun/cwm-extended-adapters", subfolder="cwm_gametick_stepover")
|
| 31 |
+
```
|