|
|
--- |
|
|
tags: |
|
|
- sentence-transformers |
|
|
- sentence-similarity |
|
|
- feature-extraction |
|
|
- telepix |
|
|
pipeline_tag: sentence-similarity |
|
|
library_name: sentence-transformers |
|
|
--- |
|
|
|
|
|
# PIXIE-Rune-M-v1.0 |
|
|
**PIXIE-Rune-M-v1.0** is an encoder-based embedding model trained on Korean and English triplets, developed by [TelePIX Co., Ltd](https://telepix.net/). |
|
|
**PIXIE** stands for Telx**PIX** **I**ntelligent **E**mbedding, representing TelePIXโs high-performance embedding technology. |
|
|
The model is multilingual, specifically optimized for both Korean and English. |
|
|
It demonstrates strong performance on retrieval tasks in both languages, achieving robust results across a wide range of Korean- and English-language benchmarks. |
|
|
This makes it well-suited for real-world applications that require high-quality semantic search in Korean, English, or both. |
|
|
|
|
|
## Model Description |
|
|
- **Model Type:** Sentence Transformer |
|
|
<!-- - **Base model:** [Unknown](https://huggingface.co/unknown) --> |
|
|
- **Maximum Sequence Length:** 8192 tokens |
|
|
- **Output Dimensionality:** 1024 dimensions |
|
|
- **Similarity Function:** Cosine Similarity |
|
|
<!-- - **Training Dataset:** Unknown --> |
|
|
- **Language:** Multilingual โ optimized for high performance in Korean and English |
|
|
- **License:** apache-2.0 |
|
|
|
|
|
### Full Model Architecture |
|
|
|
|
|
``` |
|
|
SentenceTransformer( |
|
|
(0): Transformer({'max_seq_length': 8192, 'do_lower_case': False}) with Transformer model: XLMRobertaModel |
|
|
(1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True}) |
|
|
(2): Normalize() |
|
|
) |
|
|
``` |
|
|
|
|
|
## Usage |
|
|
|
|
|
### Direct Usage (Sentence Transformers) |
|
|
|
|
|
First install the Sentence Transformers library: |
|
|
|
|
|
```bash |
|
|
pip install -U sentence-transformers |
|
|
``` |
|
|
|
|
|
Then you can load this model and run inference. |
|
|
```python |
|
|
from sentence_transformers import SentenceTransformer |
|
|
|
|
|
# Load the model |
|
|
model_name = 'PIXIE-Rune-M-v1.0' |
|
|
model = SentenceTransformer(model_name) |
|
|
|
|
|
# Define the queries and documents |
|
|
queries = [ |
|
|
"ํ
๋ ํฝ์ค๋ ์ด๋ค ์ฐ์
๋ถ์ผ์์ ์์ฑ ๋ฐ์ดํฐ๋ฅผ ํ์ฉํ๋์?", |
|
|
"๊ตญ๋ฐฉ ๋ถ์ผ์ ์ด๋ค ์์ฑ ์๋น์ค๊ฐ ์ ๊ณต๋๋์?", |
|
|
"ํ
๋ ํฝ์ค์ ๊ธฐ์ ์์ค์ ์ด๋ ์ ๋์ธ๊ฐ์?", |
|
|
] |
|
|
documents = [ |
|
|
"ํ
๋ ํฝ์ค๋ ๊ตญ๋ฐฉ, ๋์
, ์์, ํด์ ๋ฑ ๋ค์ํ ๋ถ์ผ์์ ์์ฑ ๋ฐ์ดํฐ๋ฅผ ๋ถ์ํ์ฌ ์๋น์ค๋ฅผ ์ ๊ณตํฉ๋๋ค.", |
|
|
"์ ์ฐฐ ๋ฐ ๊ฐ์ ๋ชฉ์ ์ ์์ฑ ์์์ ํตํด ๊ตญ๋ฐฉ ๊ด๋ จ ์ ๋ฐ ๋ถ์ ์๋น์ค๋ฅผ ์ ๊ณตํฉ๋๋ค.", |
|
|
"TelePIX์ ๊ดํ ํ์ฌ์ฒด ๋ฐ AI ๋ถ์ ๊ธฐ์ ์ Global standard๋ฅผ ์ํํ๋ ์์ค์ผ๋ก ํ๊ฐ๋ฐ๊ณ ์์ต๋๋ค.", |
|
|
"ํ
๋ ํฝ์ค๋ ์ฐ์ฃผ์์ ์์งํ ์ ๋ณด๋ฅผ ๋ถ์ํ์ฌ '์ฐ์ฃผ ๊ฒฝ์ (Space Economy)'๋ผ๋ ์๋ก์ด ๊ฐ์น๋ฅผ ์ฐฝ์ถํ๊ณ ์์ต๋๋ค.", |
|
|
"ํ
๋ ํฝ์ค๋ ์์ฑ ์์ ํ๋๋ถํฐ ๋ถ์, ์๋น์ค ์ ๊ณต๊น์ง ์ ์ฃผ๊ธฐ๋ฅผ ์์ฐ๋ฅด๋ ์๋ฃจ์
์ ์ ๊ณตํฉ๋๋ค.", |
|
|
] |
|
|
|
|
|
# Compute embeddings: use `prompt_name="query"` to encode queries! |
|
|
query_embeddings = model.encode(queries, prompt_name="query") |
|
|
document_embeddings = model.encode(documents) |
|
|
|
|
|
# Compute cosine similarity scores |
|
|
scores = model.similarity(query_embeddings, document_embeddings) |
|
|
|
|
|
# Output the results |
|
|
for query, query_scores in zip(queries, scores): |
|
|
doc_score_pairs = list(zip(documents, query_scores)) |
|
|
doc_score_pairs = sorted(doc_score_pairs, key=lambda x: x[1], reverse=True) |
|
|
print("Query:", query) |
|
|
for document, score in doc_score_pairs: |
|
|
print(score, document) |
|
|
|
|
|
``` |
|
|
|
|
|
### Framework Versions |
|
|
- Python: 3.10.16 |
|
|
- Sentence Transformers: 4.0.1 |
|
|
- Transformers: 4.51.3 |
|
|
- PyTorch: 2.6.0+cu124 |
|
|
- Accelerate: 1.5.2 |
|
|
- Datasets: 2.21.0 |
|
|
- Tokenizers: 0.21.1 |
|
|
|
|
|
|
|
|
## Contact |
|
|
|
|
|
If you have any suggestions or questions about this Model, please reach out to the authors at bmkim@telepix.net. |