Commit
·
2c43558
1
Parent(s):
1d47d08
Add commit used when downloading transformer
Browse files
README.md
CHANGED
|
@@ -32,6 +32,9 @@ python init_custdata_model.py --cust_vocab ./cust-data/vocab.txt --pretrain_mode
|
|
| 32 |
```
|
| 33 |
11. Train
|
| 34 |
To enable M1 GPU support, install the dev version of transformers by running `pip install git+https://github.com/huggingface/transformers`.
|
|
|
|
|
|
|
|
|
|
| 35 |
In Dec 21, 2022, the dev version that's working for me is `transformers-4.26.0.dev0`. Later stable releases may have M1 GPU support built-in so you don't need to install the dev version.
|
| 36 |
If you are running the whole procedure again, remember to reinstall the older transformers version as instructed in step 10. Otherwise, the weights initialized will not be in the correct format and you will see miserable accuracy rate, likely due to breaking changes involving how tokenization is done.
|
| 37 |
```
|
|
|
|
| 32 |
```
|
| 33 |
11. Train
|
| 34 |
To enable M1 GPU support, install the dev version of transformers by running `pip install git+https://github.com/huggingface/transformers`.
|
| 35 |
+
```
|
| 36 |
+
pip install git+https://github.com/huggingface/transformers@3be028bc9d4b2cce9539b940f17052f333284684
|
| 37 |
+
```
|
| 38 |
In Dec 21, 2022, the dev version that's working for me is `transformers-4.26.0.dev0`. Later stable releases may have M1 GPU support built-in so you don't need to install the dev version.
|
| 39 |
If you are running the whole procedure again, remember to reinstall the older transformers version as instructed in step 10. Otherwise, the weights initialized will not be in the correct format and you will see miserable accuracy rate, likely due to breaking changes involving how tokenization is done.
|
| 40 |
```
|