tdooms commited on
Commit
2666937
·
verified ·
1 Parent(s): 854e9de

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -1,7 +1,7 @@
1
- # TinyStories Scope
2
  This is a repo containing a bunch of SAEs trained on our [medium-sized tiny stories model](https://huggingface.co/tdooms/ts-medium).
3
  This repo uses a simple implementation of Top-K SAEs.
4
 
5
  Note that this is very much a dump and is not recommended for general use.
6
- Most SAEs were trained on a need-to basis.
7
- While they are all trained until convergence (MSE not decreasing), they have varying hyperparameters.
 
1
+ # TS Medium Scope
2
  This is a repo containing a bunch of SAEs trained on our [medium-sized tiny stories model](https://huggingface.co/tdooms/ts-medium).
3
  This repo uses a simple implementation of Top-K SAEs.
4
 
5
  Note that this is very much a dump and is not recommended for general use.
6
+ Most SAEs were trained on a need-to basis and have varying parameters.
7
+ All SAEs are trained until convergence (both in terms of MSE and CE error).