Update README.md
Browse files
README.md
CHANGED
|
@@ -12,14 +12,6 @@ Official weights for the Paper [**Scar: Sparse Conditioned Autoencoders for Conc
|
|
| 12 |
|
| 13 |
The code is located in this [Repository](https://github.com/ml-research/SCAR).
|
| 14 |
|
| 15 |
-
# Requirements
|
| 16 |
-
|
| 17 |
-
Set up the environment with [poetry](https://python-poetry.org/):
|
| 18 |
-
|
| 19 |
-
```
|
| 20 |
-
poetry install
|
| 21 |
-
```
|
| 22 |
-
|
| 23 |
# Usage
|
| 24 |
|
| 25 |
Load the model weights from HuggingFace:
|
|
@@ -60,6 +52,12 @@ The example above will decrease toxicity. To increase the toxicity one would set
|
|
| 60 |
|
| 61 |
# Reproduction
|
| 62 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 63 |
The scripts for generating the training data are located in `./create_training_data`.
|
| 64 |
The training script is written for a Determined cluster but should be easily adaptable for other training frameworks. The corresponding script is located here `./llama3_SAE/determined_trails.py`.
|
| 65 |
Some the evaluation functions are located in `./evaluations`.
|
|
|
|
| 12 |
|
| 13 |
The code is located in this [Repository](https://github.com/ml-research/SCAR).
|
| 14 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
# Usage
|
| 16 |
|
| 17 |
Load the model weights from HuggingFace:
|
|
|
|
| 52 |
|
| 53 |
# Reproduction
|
| 54 |
|
| 55 |
+
For reproduction set up the environment with [poetry](https://python-poetry.org/):
|
| 56 |
+
|
| 57 |
+
```
|
| 58 |
+
poetry install
|
| 59 |
+
```
|
| 60 |
+
|
| 61 |
The scripts for generating the training data are located in `./create_training_data`.
|
| 62 |
The training script is written for a Determined cluster but should be easily adaptable for other training frameworks. The corresponding script is located here `./llama3_SAE/determined_trails.py`.
|
| 63 |
Some the evaluation functions are located in `./evaluations`.
|