Create README.md

README.md

@@ -0,0 +1,7 @@
+# TinyStories Scope
+This is a repo containing a bunch of SAEs trained on our [medium-sized tiny stories model](https://huggingface.co/tdooms/ts-medium).
+This repo uses a simple implementation of Top-K SAEs.
+
+Note that this is very much a dump and is not recommended for general use. 
+Most SAEs were trained on a need-to basis. 
+While they are all trained until convergence (MSE not decreasing), they have varying hyperparameters.