Instructions to use google/gemma-scope-2-1b-it with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- SAELens
How to use google/gemma-scope-2-1b-it with SAELens:
# pip install sae-lens from sae_lens import SAE sae, cfg_dict, sparsity = SAE.from_pretrained( release = "RELEASE_ID", # e.g., "gpt2-small-res-jb". See other options in https://github.com/jbloomAus/SAELens/blob/main/sae_lens/pretrained_saes.yaml sae_id = "SAE_ID", # e.g., "blocks.8.hook_resid_pre". Won't always be a hook point ) - Notebooks
- Google Colab
- Kaggle
Add files using upload-large-folder tool
Browse files- resid_post/layer_22_width_65k_l0_medium/activations.npy +3 -0
- resid_post/layer_22_width_65k_l0_medium/feature_frequencies.npy +3 -0
- resid_post/layer_22_width_65k_l0_medium/n_tokens_per_feature.npy +3 -0
- resid_post/layer_22_width_65k_l0_medium/positions.npy +3 -0
- resid_post/layer_22_width_65k_l0_medium/seq_ids.npy +3 -0
- tokens.npy +3 -0
resid_post/layer_22_width_65k_l0_medium/activations.npy
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f2a558c90a5ec57892bbf13f7fa69b10980bb299ed182b572ae4b38473b42832
|
| 3 |
+
size 262144128
|
resid_post/layer_22_width_65k_l0_medium/feature_frequencies.npy
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e7b718e7624b794c40ad5931e1564991e7ec8a3756716411e856948723b8d766
|
| 3 |
+
size 524416
|
resid_post/layer_22_width_65k_l0_medium/n_tokens_per_feature.npy
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:15d97797414f72e36992e78e372035370ef93501e0ae52d81446c8d05c09f011
|
| 3 |
+
size 524416
|
resid_post/layer_22_width_65k_l0_medium/positions.npy
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:ddd25f358f635f9fd2f82be1a74385b720cc22efae787e3bc809f389e31ce6e1
|
| 3 |
+
size 262144128
|
resid_post/layer_22_width_65k_l0_medium/seq_ids.npy
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:875dd9203d3c7b129338adf0330c5ede526636d1f57cb949f8add324ea83e14e
|
| 3 |
+
size 524288128
|
tokens.npy
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:14e67d4e1f1067f1a212a4deb0ed910fa9e2fde707e637b0ccc831192d695ea0
|
| 3 |
+
size 400015488
|