Hugging Face's logo

patrickvonplaten
/
debug_repo

Model card Files
xet
Community
1
debug_repo / README.md
patrickvonplaten's picture
patrickvonplaten
Update README.md
5d32d31
preview code
|
raw
history blame contribute delete
576 Bytes

This repository is used to debug models, functionalities in transformers, etc...

1. Generation

...

2. Flax Wav2Vec2 Pretraining

Go into the flax_wav2vec2 folder.

  1. Check PT loss works correctly

./run_pt_fsq_comp.sh shows that HF PyTorch and Fairseq PT yield equivalent loss. Make sure to use the correct library versions as defined branches_to_use.txt.

  1. Check Flax loss works correctly

./run_flax_fsq_comp.sh shows that HF PyTorch and HF Flax yield equivalent loss. Make sure to use the correct library versions as defined branches_to_use.txt.