Instructions to use jbloom/GPT2-Small-SAEs-Reformatted with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- SAELens
How to use jbloom/GPT2-Small-SAEs-Reformatted with SAELens:
# pip install sae-lens from sae_lens import SAE sae, cfg_dict, sparsity = SAE.from_pretrained( release = "RELEASE_ID", # e.g., "gpt2-small-res-jb". See other options in https://github.com/jbloomAus/SAELens/blob/main/sae_lens/pretrained_saes.yaml sae_id = "SAE_ID", # e.g., "blocks.8.hook_resid_pre". Won't always be a hook point ) - Notebooks
- Google Colab
- Kaggle
Update README.md
heya! I'm VB from the open source team at Hugging Face. We recently opened a PR: https://github.com/huggingface/huggingface.js/pull/826 to add SAELens as a supported library, this way people will be able to discover the library better.
Could you please merge the PR whenever you get the time? 🤗
Would love to but that PR is to Huggingface not SAE Lens so it's not a PR I can merge.
I'm interested in making sure the integration works well but don't fully understand what's going on here. Let me know if I can assist!
Hey @jbloom - The above linked PR is now merged, what it does is to add reference to your library for whenever a model repo has library_name: saelens in their README.md.
There's many more things we can do like adding code snippet, download counts, etc: https://huggingface.co/docs/hub/en/models-adding-libraries
This PR: https://huggingface.co/jbloom/GPT2-Small-SAEs-Reformatted/discussions/1/files adds exactly to this repo (since you're the repo owner, only you can merge this)
So the action item would be the merge the PR that we are currently discussing on and next we can think about how to add associated code snippets?
Oh I see! I'll merge. Not used to PR's on HF.