Kevin Black commited on
Commit ·
fd7caad
1
Parent(s): e061c09
Update README
Browse files
README.md
CHANGED
|
@@ -198,10 +198,7 @@ openpi now provides PyTorch implementations of π₀ and π₀.₅ models alongs
|
|
| 198 |
- EMA (exponential moving average) weights during training
|
| 199 |
|
| 200 |
### Setup
|
| 201 |
-
1. Make sure that you have the latest version of all dependencies installed:
|
| 202 |
-
```bash
|
| 203 |
-
uv sync
|
| 204 |
-
```
|
| 205 |
|
| 206 |
2. Double check that you have transformers 4.53.2 installed: `uv pip show transformers`
|
| 207 |
|
|
@@ -209,9 +206,10 @@ openpi now provides PyTorch implementations of π₀ and π₀.₅ models alongs
|
|
| 209 |
```bash
|
| 210 |
cp -r ./src/openpi/models_pytorch/transformers_replace/* .venv/lib/python3.11/site-packages/transformers/
|
| 211 |
```
|
| 212 |
-
This overwrites several files in the transformers library with necessary model changes.
|
| 213 |
|
| 214 |
-
|
|
|
|
|
|
|
| 215 |
|
| 216 |
### Converting JAX Models to PyTorch
|
| 217 |
|
|
|
|
| 198 |
- EMA (exponential moving average) weights during training
|
| 199 |
|
| 200 |
### Setup
|
| 201 |
+
1. Make sure that you have the latest version of all dependencies installed: `uv sync`
|
|
|
|
|
|
|
|
|
|
| 202 |
|
| 203 |
2. Double check that you have transformers 4.53.2 installed: `uv pip show transformers`
|
| 204 |
|
|
|
|
| 206 |
```bash
|
| 207 |
cp -r ./src/openpi/models_pytorch/transformers_replace/* .venv/lib/python3.11/site-packages/transformers/
|
| 208 |
```
|
|
|
|
| 209 |
|
| 210 |
+
This overwrites several files in the transformers library with necessary model changes: 1) supporting AdaRMS, 2) correctly controlling the precision of activations, and 3) allowing the KV cache to be used without being updated.
|
| 211 |
+
|
| 212 |
+
**WARNING**: With the default uv link mode (hardlink), this will permanently affect the transformers library in your uv cache, meaning the changes will survive reinstallations of transformers and could even propagate to other projects that use transformers. To fully undo this operation, you must run `uv cache clean transformers`.
|
| 213 |
|
| 214 |
### Converting JAX Models to PyTorch
|
| 215 |
|