# MNLP_M3_document_encoder_old

This repository hosts a document encoder model intended for the MNLP M3 project.


## Important Update Regarding Model Compatibility

**Reason for the recent repository update:**

Initially, this repository contained a model that was pushed as a standard Hugging Face `transformers` model. When attempting to load this model using the `sentence-transformers` library, I encountered an error indicating that it was not recognized as a `sentence-transformers` compatible model.

This issue arose because the `sentence-transformers` library expects specific configuration files (such as `modules.json` and `sentence_bert_config.json`) within the model's directory. These files are crucial for defining the model's specific architecture, including how its token embeddings are converted into a single sentence or document embedding (e.g., via mean pooling, CLS token pooling, etc.). Without these configurations, `sentence-transformers` cannot properly interpret the model's structure.

**The intended model for this repository has always been the pre-trained `sentence-transformers/all-MiniLM-L12-v2` model.** The previous upload method inadvertently created a `transformers` model structure that lacked the necessary `sentence-transformers`-specific configurations for direct loading.

**What has been changed:**

To rectify this, I have re-uploaded the **original `sentence-transformers/all-MiniLM-L12-v2` model** directly to a new `MNLP_M3_document_encoder` repository. This was done using the `sentence-transformers` library's `save_to_hub` function, which ensures that all the correct and required `sentence-transformers` configuration files are present.

**Impact of the change:**

Please note that the underlying model weights and architecture **have not changed** from the originally intended `sentence-transformers/all-MiniLM-L12-v2` model. The update purely addresses the repository's internal file structure to ensure proper loading and seamless compatibility with the `sentence-transformers` library.

You can verify the previous model content by checking the commit history of this repository.

I sincerely apologize for this initial oversight and any confusion it may have caused.