vincent-espitalier/candle-beit

This repo contains the pre-trained weights for the Beit model converted in a format that can be used by candle.

Citing BEiT

As per their GitHub repository:

@misc{bao2022beitbertpretrainingimage,
      title={BEiT: BERT Pre-Training of Image Transformers}, 
      author={Hangbo Bao and Li Dong and Songhao Piao and Furu Wei},
      year={2022},
}