Attention-head stability reproduction
python reproduce.py is a toy metric-level check of Hungarian head matching,
middle-layer broadening, query-norm correlation, and residual-stream CKA. It is
not a checkpoint-level reproduction. Official code and weights:
https://github.com/karanbali/attention_head_seed_stability and
https://huggingface.co/karanbali/attention_head_seed_stability.
Xet Storage Details
- Size:
- 390 Bytes
- Xet hash:
- f815152ac322879e272c043fd9a32b4e84298a716c216f27d0dc4a663591ef19
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.