medgemma-circuit-tools / layer29_transcoder_config.json
binesh's picture
Upload layer29_transcoder_config.json with huggingface_hub
2bed0cf verified
Raw
History Blame Contribute Delete
293 Bytes
{
"layer": 29,
"d_model": 2560,
"expansion_factor": 8,
"top_k": 64,
"n_steps": 50000,
"batch_size": 32,
"seq_len": 512,
"lr": 0.0001,
"model_name": "google/medgemma-4b-it",
"dataset": "rexgradient",
"critical_feature": 12139,
"timestamp": "2026-08-17T21:18:24.034959"
}