Spaces:
Sleeping
Sleeping
Vladimir Mikulik
commited on
Commit
·
4d24b96
1
Parent(s):
c0a9b47
Add link to arxiv and bibtex citation.
Browse files
README.md
CHANGED
|
@@ -2,7 +2,9 @@
|
|
| 2 |
|
| 3 |
Tracr is a compiler for converting RASP programs
|
| 4 |
([Weiss et al. 2021](https://arxiv.org/abs/2106.06981))
|
| 5 |
-
into transformer weights.
|
|
|
|
|
|
|
| 6 |
|
| 7 |
Directory structure:
|
| 8 |
|
|
@@ -170,7 +172,7 @@ The flow of compilation execution begins in
|
|
| 170 |
directly to the stages outlined above, so don't be afraid to read the source!
|
| 171 |
|
| 172 |
|
| 173 |
-
|
| 174 |
|
| 175 |
We use [`absltest`](https://abseil.io/docs/python/guides/testing), which is
|
| 176 |
`unittest`-compatible, and is therefore in turn `pytest`-compatible.
|
|
@@ -183,3 +185,16 @@ pip3 install absl-py pytest
|
|
| 183 |
|
| 184 |
Then, in the checkout directory, simply run `pytest`. This should take about 60
|
| 185 |
seconds.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2 |
|
| 3 |
Tracr is a compiler for converting RASP programs
|
| 4 |
([Weiss et al. 2021](https://arxiv.org/abs/2106.06981))
|
| 5 |
+
into transformer weights. Please see our
|
| 6 |
+
[tech report](https://arxiv.org/abs/2301.05062) for a detailed description of
|
| 7 |
+
the compiler.
|
| 8 |
|
| 9 |
Directory structure:
|
| 10 |
|
|
|
|
| 172 |
directly to the stages outlined above, so don't be afraid to read the source!
|
| 173 |
|
| 174 |
|
| 175 |
+
### Running tests
|
| 176 |
|
| 177 |
We use [`absltest`](https://abseil.io/docs/python/guides/testing), which is
|
| 178 |
`unittest`-compatible, and is therefore in turn `pytest`-compatible.
|
|
|
|
| 185 |
|
| 186 |
Then, in the checkout directory, simply run `pytest`. This should take about 60
|
| 187 |
seconds.
|
| 188 |
+
|
| 189 |
+
## Citing Tracr
|
| 190 |
+
|
| 191 |
+
Please use the bibtex for our tech report:
|
| 192 |
+
|
| 193 |
+
```
|
| 194 |
+
@article{lindner2023tracr,
|
| 195 |
+
title = {Tracr: Compiled Transformers as a Laboratory for Interpretability},
|
| 196 |
+
author = {Lindner, David and Kramár, János and Rahtz, Matthew and McGrath, Thomas and Mikulik, Vladimir},
|
| 197 |
+
journal={arXiv preprint arXiv:2301.05062},
|
| 198 |
+
year={2023}
|
| 199 |
+
}
|
| 200 |
+
```
|