File size: 1,813 Bytes
f354559 a35e5fb f354559 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 | ---
license: apache-2.0
---
# angular-separation-vit — reproduction checkpoints
Final (`_last.pt`) checkpoints backing *"Dos modelos idénticos, dos
podas distintas: la dirección dominante de $W_O$ bajo intervención
libre, suave y dura"* ("Same function, different pruning: the
dominant direction of $W_O$ under free, soft, and hard intervention").
These are verification artifacts for reproducing the paper's tables —
not meant as general-purpose pretrained weights.
Code: <https://github.com/mmunozpl/angular-separation-vit>
CSV results derived from these checkpoints: <https://huggingface.co/datasets/ManuelPla/angular-separation-vit-results>
## Layout
```
vitb_clean/attnA_{base,blanda,dura}_seed{42..46}_last.pt # ancla, n=5
vitl_clean/attnA_{base,blanda,dura}_seed{42..44}_last.pt # n=3
dinov2_clean/attnA_base_seed42_last.pt # frozen, n=1
```
`base` = fine-tuned ViT with no angular regularizer. `blanda` = soft
angular probe (`R_div`, eq. 5). `dura` = hard variant, reprojected to
the spherical code after every optimizer step. DINOv2 is analyzed
frozen (no fine-tuning), hence a single realization.
All backbones derive from `timm` pretrained weights, fine-tuned on
ImageNet-100 for the two supervised columns. Upstream pretraining
license, checked against `timm`'s own `PretrainedCfg` metadata (not
assumed):
| Backbone | Upstream checkpoint | License |
|---|---|---|
| ViT-B/16 | `timm/vit_base_patch16_224.augreg2_in21k_ft_in1k` | Apache-2.0 |
| ViT-L/16 | `timm/vit_large_patch16_224.augreg_in21k_ft_in1k` (Google AugReg) | Apache-2.0 |
| DINOv2-L | `timm/vit_large_patch14_dinov2.lvd142m` (Meta) | Apache-2.0 |
All three are Apache-2.0 at the source, consistent with this
repository's license — no upstream restriction carries over.
## License
Apache-2.0.
|