Is there a similar model for CodeGemma 7b IT?
#9
by debadribasak - opened
I want to understand the information captured by layers of codegemma with SAE. Is there a pretrained SAE similar to google/gemma-scope-2b-pt-res for codegemma? If not, can someone guide me on how to train an SAE for code generation and which dataset to use?
Hi we do not have an SAE for that but you can see: https://github.com/decoderesearch/SAELens for general SAE usage and there is a slack link in the README there
ArthurConmyGDM changed discussion status to closed