Neuronpedia Qwen3-4B
#3
by hanshan1988 - opened
Hi Michael,
It this the weights behind the Circuit Tracer's Qwen3-4B (Hanna / Piotrowski PLT) on Neuronpedia? If so would you be kind to share what the model_name and transcoder_name should be for using this below to try getting the attribution graph programmatically from the weights?
from circuit_tracer import ReplacementModel
model = ReplacementModel.from_pretrained(model_name, transcoder_name, dtype=torch.bfloat16)
Thanks
Hi! The model name is Qwen/Qwen3-4B. The transcoder name for all transcoders is the Huggingface repo - here, mwhanna/qwen3-4b-transcoders
Great! Thank you