[blip_text_model] num_attention_heads is 8? not 12? [blip_vision_model] eps is 1e-5?
#5
by junnyu - opened
(1) i find https://github.com/salesforce/BLIP/blob/main/configs/med_config.json num_attention_heads is 12, but in this repo num_attention_heads is 8
(2) and blip_vision_model eps shoud be 1e-6, not 1e-5
Hi @junnyu
I think you are right, see related: https://github.com/huggingface/transformers/issues/22625