init
Browse files
README.md
CHANGED
|
@@ -19256,9 +19256,9 @@ tags:
|
|
| 19256 |
<h1 align="center">KaLM-Embedding</h1>
|
| 19257 |
|
| 19258 |
|
| 19259 |
-
**KaLM-Embedding** is a series of embedding models adapted from auto-regressive LLMs with superior training data
|
| 19260 |
|
| 19261 |
-
KaLM-embedding-multilingual-mini
|
| 19262 |
|
| 19263 |
|
| 19264 |
## 📑 Open-source Plan
|
|
@@ -19273,6 +19273,13 @@ KaLM-embedding-multilingual-mini-v1 is trained from [Qwen/Qwen2-0.5B](https://hu
|
|
| 19273 |
|
| 19274 |
|
| 19275 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19276 |
## Usage
|
| 19277 |
|
| 19278 |
Using this model becomes easy when you have [sentence-transformers](https://www.SBERT.net) installed:
|
|
@@ -19323,4 +19330,8 @@ embeddings = model.encode(
|
|
| 19323 |
show_progress_bar=True
|
| 19324 |
)
|
| 19325 |
print(embeddings)
|
| 19326 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19256 |
<h1 align="center">KaLM-Embedding</h1>
|
| 19257 |
|
| 19258 |
|
| 19259 |
+
**KaLM-Embedding** is a series of embedding models adapted from auto-regressive LLMs with superior training data.
|
| 19260 |
|
| 19261 |
+
KaLM-embedding-multilingual-mini is trained from [Qwen/Qwen2-0.5B](https://huggingface.co/Qwen/Qwen2-0.5B) with massive weakly-supervised pre-training and supervised fine-tuning data.
|
| 19262 |
|
| 19263 |
|
| 19264 |
## 📑 Open-source Plan
|
|
|
|
| 19273 |
|
| 19274 |
|
| 19275 |
|
| 19276 |
+
## Requirements
|
| 19277 |
+
Since we have used the Qwen2 model, we advise you to install `transformers>=4.37.0`, or you might encounter the following error:
|
| 19278 |
+
```
|
| 19279 |
+
KeyError: 'qwen2'
|
| 19280 |
+
```
|
| 19281 |
+
|
| 19282 |
+
|
| 19283 |
## Usage
|
| 19284 |
|
| 19285 |
Using this model becomes easy when you have [sentence-transformers](https://www.SBERT.net) installed:
|
|
|
|
| 19330 |
show_progress_bar=True
|
| 19331 |
)
|
| 19332 |
print(embeddings)
|
| 19333 |
+
```
|
| 19334 |
+
|
| 19335 |
+
|
| 19336 |
+
## Contact
|
| 19337 |
+
If you encounter any issue, feel free to contact us via the email: yanshek.woo@gmail.com
|