Salesforce

/

blip2-itm-vit-g

like 3

Follow

Salesforce AI Research 2.28k

Is there some thing wrong with the model?
When I load Salesforce/blip2-itm-vit-g with Blip2ForImageTextRetrieval, it seems weights were not properly loaded.

Some weights of the model checkpoint at /home/pyr/pretrained_models/Salesforce/blip2-itm-vit-g were not used when initializing Blip2ForImageTextRetrieval: ['cls.predictions.bias', 'cls.predictions.decoder.bias', 'cls.predictions.decoder.weight', 'cls.predictions.transform.LayerNorm.bias', 'cls.predictions.transform.LayerNorm.weight', 'cls.predictions.transform.dense.bias', 'cls.predictions.transform.dense.weight', 'qformer.embeddings.LayerNorm.bias', 'qformer.embeddings.LayerNorm.weight', 'qformer.embeddings.position_embeddings.weight', 'qformer.embeddings.word_embeddings.weight', 'temp', 'text_proj.bias', 'text_proj.weight', 'vision_proj.bias', 'vision_proj.weight']