Neuronpedia Qwen3-4B

#3
by hanshan1988 - opened

Hi Michael,

It this the weights behind the Circuit Tracer's Qwen3-4B (Hanna / Piotrowski PLT) on Neuronpedia? If so would you be kind to share what the model_name and transcoder_name should be for using this below to try getting the attribution graph programmatically from the weights?

from circuit_tracer import ReplacementModel
model = ReplacementModel.from_pretrained(model_name, transcoder_name, dtype=torch.bfloat16)

Thanks

Hi! The model name is Qwen/Qwen3-4B. The transcoder name for all transcoders is the Huggingface repo - here, mwhanna/qwen3-4b-transcoders

Great! Thank you

Sign up or log in to comment