Update README.md
Browse files
README.md
CHANGED
|
@@ -26,7 +26,7 @@ pip install --pre torchao --index-url https://download.pytorch.org/whl/nightly/c
|
|
| 26 |
```
|
| 27 |
|
| 28 |
## Untie Embedding Weights
|
| 29 |
-
Before quantization, since we need quantize input embedding and unembedding (lm_head) layer which are tied, we first need to untie the model:
|
| 30 |
|
| 31 |
```
|
| 32 |
from transformers import (
|
|
|
|
| 26 |
```
|
| 27 |
|
| 28 |
## Untie Embedding Weights
|
| 29 |
+
Before quantization, since we need quantize input embedding and unembedding (lm_head) layer which are tied, but we want to quantize them separately, we first need to untie the model:
|
| 30 |
|
| 31 |
```
|
| 32 |
from transformers import (
|