coeiico
/

tiny-transformer

PyTorch

Safetensors

transformer

interpretability

from-scratch

Model card Files Files and versions

xet

Community

tiny-transformer / default-seed2 /analysis /figures /figure-data /layers-default-seed2.csv

coeiico

Add every run in its own folder and the model card

4a570eb verified 6 days ago

Raw History Blame Contribute Delete

196 Bytes

layer,loss_rise,token_accuracy_drop
0,10.483049278642284,0.85162353515625
1,0.43556219854508527,0.1031494140625
2,0.09911830493365414,0.03265380859375
3,0.01326776811038144,0.004241943359375

	layer,loss_rise,token_accuracy_drop
	0,10.483049278642284,0.85162353515625
	1,0.43556219854508527,0.1031494140625
	2,0.09911830493365414,0.03265380859375
	3,0.01326776811038144,0.004241943359375