Update README.md
Browse files
README.md
CHANGED
|
@@ -15,7 +15,7 @@ For more information (including how to compress models yourself), check out http
|
|
| 15 |
|
| 16 |
This is my first time using DF11 to compress a model outside the Flux architecture. The reason why the process for compressing Flux-based models is much easier is because the compression code requires a `pattern_dict` as input, but the original [example code](https://github.com/LeanModels/DFloat11/tree/master/examples/compress_flux1) only provides the correct `pattern_dict` for Flux, which means I have to learn the notation myself and modify it to fit other models. After a long wait, the compressed model seems to work fine on my RTX 4090, but do let me know if you run into any problems.
|
| 17 |
|
| 18 |
-
|
| 19 |
```python
|
| 20 |
pattern_dict={
|
| 21 |
"transformer_blocks\.\d+": (
|
|
|
|
| 15 |
|
| 16 |
This is my first time using DF11 to compress a model outside the Flux architecture. The reason why the process for compressing Flux-based models is much easier is because the compression code requires a `pattern_dict` as input, but the original [example code](https://github.com/LeanModels/DFloat11/tree/master/examples/compress_flux1) only provides the correct `pattern_dict` for Flux, which means I have to learn the notation myself and modify it to fit other models. After a long wait, the compressed model seems to work fine on my RTX 4090, but do let me know if you run into any problems.
|
| 17 |
|
| 18 |
+
This is the `pattern_dict` I used for compression:
|
| 19 |
```python
|
| 20 |
pattern_dict={
|
| 21 |
"transformer_blocks\.\d+": (
|