card: architecture diagrams
Browse files- .gitattributes +2 -0
- README.md +4 -0
- assets/arch.png +3 -0
- assets/how.png +2 -2
- assets/moves.png +3 -0
- assets/results.png +2 -2
- assets/train.png +2 -2
.gitattributes
CHANGED
|
@@ -36,3 +36,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 36 |
assets/how.png filter=lfs diff=lfs merge=lfs -text
|
| 37 |
assets/results.png filter=lfs diff=lfs merge=lfs -text
|
| 38 |
assets/train.png filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
| 36 |
assets/how.png filter=lfs diff=lfs merge=lfs -text
|
| 37 |
assets/results.png filter=lfs diff=lfs merge=lfs -text
|
| 38 |
assets/train.png filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
assets/arch.png filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
assets/moves.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -99,6 +99,10 @@ The checkpoint is a plain `torch.save` dict (`cfg`, `model` state dict, `step`,
|
|
| 99 |
|
| 100 |
## Model
|
| 101 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 102 |
- **Tokens:** 16 tile tokens (tile-exponent + row + column embeddings), 4 action tokens built from each move's afterstate (legality, reward, empties, max tile and corner, monotonicity, smoothness, merges, follow-up rewards), and 1 value token.
|
| 103 |
- **Network:** 8 pre-norm bidirectional transformer blocks, d=384, 12 heads, MLP ratio 4. One logit per action token, with illegal moves masked.
|
| 104 |
- **Action order:** 0=UP, 1=DOWN, 2=LEFT, 3=RIGHT.
|
|
|
|
| 99 |
|
| 100 |
## Model
|
| 101 |
|
| 102 |
+

|
| 103 |
+
|
| 104 |
+

|
| 105 |
+
|
| 106 |
- **Tokens:** 16 tile tokens (tile-exponent + row + column embeddings), 4 action tokens built from each move's afterstate (legality, reward, empties, max tile and corner, monotonicity, smoothness, merges, follow-up rewards), and 1 value token.
|
| 107 |
- **Network:** 8 pre-norm bidirectional transformer blocks, d=384, 12 heads, MLP ratio 4. One logit per action token, with illegal moves masked.
|
| 108 |
- **Action order:** 0=UP, 1=DOWN, 2=LEFT, 3=RIGHT.
|
assets/arch.png
ADDED
|
Git LFS Details
|
assets/how.png
CHANGED
|
Git LFS Details
|
|
Git LFS Details
|
assets/moves.png
ADDED
|
Git LFS Details
|
assets/results.png
CHANGED
|
Git LFS Details
|
|
Git LFS Details
|
assets/train.png
CHANGED
|
Git LFS Details
|
|
Git LFS Details
|