Commit ·
5d32d31
1
Parent(s): 7584d68
Update README.md
Browse files
README.md
CHANGED
|
@@ -6,8 +6,12 @@ This repository is used to debug models, functionalities in transformers, etc...
|
|
| 6 |
|
| 7 |
# 2. Flax Wav2Vec2 Pretraining
|
| 8 |
|
|
|
|
|
|
|
| 9 |
1. **Check PT loss works correctly**
|
| 10 |
|
| 11 |
`./run_pt_fsq_comp.sh` shows that HF PyTorch and Fairseq PT yield equivalent loss. Make sure to use the correct library versions as defined `branches_to_use.txt`.
|
| 12 |
|
| 13 |
-
2. **Check Flax loss works correctly**
|
|
|
|
|
|
|
|
|
| 6 |
|
| 7 |
# 2. Flax Wav2Vec2 Pretraining
|
| 8 |
|
| 9 |
+
Go into the `flax_wav2vec2` folder.
|
| 10 |
+
|
| 11 |
1. **Check PT loss works correctly**
|
| 12 |
|
| 13 |
`./run_pt_fsq_comp.sh` shows that HF PyTorch and Fairseq PT yield equivalent loss. Make sure to use the correct library versions as defined `branches_to_use.txt`.
|
| 14 |
|
| 15 |
+
2. **Check Flax loss works correctly**
|
| 16 |
+
|
| 17 |
+
`./run_flax_fsq_comp.sh` shows that HF PyTorch and HF Flax yield equivalent loss. Make sure to use the correct library versions as defined `branches_to_use.txt`.
|