Update README.md
Browse files
README.md
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
-
#
|
| 2 |
This is a repo containing a bunch of SAEs trained on our [medium-sized tiny stories model](https://huggingface.co/tdooms/ts-medium).
|
| 3 |
This repo uses a simple implementation of Top-K SAEs.
|
| 4 |
|
| 5 |
Note that this is very much a dump and is not recommended for general use.
|
| 6 |
-
Most SAEs were trained on a need-to basis.
|
| 7 |
-
|
|
|
|
| 1 |
+
# TS Medium Scope
|
| 2 |
This is a repo containing a bunch of SAEs trained on our [medium-sized tiny stories model](https://huggingface.co/tdooms/ts-medium).
|
| 3 |
This repo uses a simple implementation of Top-K SAEs.
|
| 4 |
|
| 5 |
Note that this is very much a dump and is not recommended for general use.
|
| 6 |
+
Most SAEs were trained on a need-to basis and have varying parameters.
|
| 7 |
+
All SAEs are trained until convergence (both in terms of MSE and CE error).
|