Request for Pretraining Code
#4
by
KuangQuanS
- opened
Dear Dr. Xiang,
Thank you for your exciting work on MUSK! I’m wondering if you could share the pretraining code as I’m currently working with it.
Also, since BEiT3 doesn't provide pretraining code and I can't find any code about BEiT3 pretraining on internet, I'm unsure what to do after training the tokenizer. Any guidance would be greatly appreciated!
Best Regards
Are the pre-trained image weights trained with BEIT2 and then loaded into BEIT3?
KuangQuanS
changed discussion status to
closed