Visual Document Retrieval
ColPali
Safetensors
sentence-transformers
English
vidore
multi-vector
colpali / sentence_bert_config.json
QuentinJG's picture
Integrate with Sentence Transformers via MultiVectorEncoder (#15)
91cafca
Raw
History Blame Contribute Delete
764 Bytes
{
"transformer_task": "feature-extraction",
"modality_config": {
"text": {
"method": "forward",
"method_output_name": "last_hidden_state"
},
"image": {
"method": "forward",
"method_output_name": "last_hidden_state"
},
"message": {
"method": "forward",
"method_output_name": "last_hidden_state",
"format": "structured"
}
},
"module_output_name": "token_embeddings",
"model_kwargs": {
"key_mapping": {
"^model\\.": ""
}
},
"processor_kwargs": {
"model_input_names": [
"input_ids",
"attention_mask",
"token_type_ids"
]
}
}