Feature Extraction
sentence-transformers
Safetensors
Chinese
bert
meteorology
domain-adaptive
contrastive-learning
retrieval
embedding
text-embeddings-inference
Instructions to use nmcsitian/bge-meteo-zh with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use nmcsitian/bge-meteo-zh with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("nmcsitian/bge-meteo-zh") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Notebooks
- Google Colab
- Kaggle
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -46,61 +46,6 @@ BGE-Meteo-zh 是基于 [BAAI/bge-large-zh-v1.5](https://huggingface.co/BAAI/bge-
|
|
| 46 |
- 混合检索架构中提供 **15.9%** 的不可替代增量(0.609→0.706)
|
| 47 |
- 三项核心结论在第三方公开数据集 AtmosphericQA 上全部得到验证
|
| 48 |
|
| 49 |
-
## 使用方法
|
| 50 |
-
|
| 51 |
-
### 使用 FlagEmbedding
|
| 52 |
-
|
| 53 |
-
```python
|
| 54 |
-
from FlagEmbedding import FlagModel
|
| 55 |
-
|
| 56 |
-
model = FlagModel(
|
| 57 |
-
'nmcsitian/bge-meteo-zh',
|
| 58 |
-
query_instruction_for_retrieval="为这个句子生成表示以用于检索相关文章:"
|
| 59 |
-
)
|
| 60 |
-
|
| 61 |
-
queries = ["切变线对暴雨的影响"]
|
| 62 |
-
passages = ["江淮切变线附近伴随辐合上升运动,促进不稳定能量释放,可引发持续暴雨过程"]
|
| 63 |
-
|
| 64 |
-
q_embeddings = model.encode_queries(queries)
|
| 65 |
-
p_embeddings = model.encode(passages)
|
| 66 |
-
|
| 67 |
-
scores = q_embeddings @ p_embeddings.T
|
| 68 |
-
print(scores)
|
| 69 |
-
```
|
| 70 |
-
|
| 71 |
-
### 使用 Sentence-Transformers
|
| 72 |
-
|
| 73 |
-
```python
|
| 74 |
-
from sentence_transformers import SentenceTransformer
|
| 75 |
-
|
| 76 |
-
model = SentenceTransformer('nmcsitian/bge-meteo-zh')
|
| 77 |
-
|
| 78 |
-
query = "为这个句子生成表示以用于检索相关文章:切变线对暴雨的影响"
|
| 79 |
-
passage = "江淮切变线附近伴随辐合上升运动,促进不稳定能量释放,可引发持续暴雨过程"
|
| 80 |
-
|
| 81 |
-
embeddings = model.encode([query, passage])
|
| 82 |
-
similarity = embeddings[0] @ embeddings[1]
|
| 83 |
-
print(f"相似度: {similarity:.4f}")
|
| 84 |
-
```
|
| 85 |
-
|
| 86 |
-
### 使用 Transformers
|
| 87 |
-
|
| 88 |
-
```python
|
| 89 |
-
from transformers import AutoTokenizer, AutoModel
|
| 90 |
-
import torch
|
| 91 |
-
|
| 92 |
-
tokenizer = AutoTokenizer.from_pretrained('nmcsitian/bge-meteo-zh')
|
| 93 |
-
model = AutoModel.from_pretrained('nmcsitian/bge-meteo-zh')
|
| 94 |
-
|
| 95 |
-
query = "为这个句子生成表示以用于检索相关文章:切变线对暴雨的影响"
|
| 96 |
-
encoded = tokenizer(query, padding=True, truncation=True, return_tensors='pt', max_length=512)
|
| 97 |
-
|
| 98 |
-
with torch.no_grad():
|
| 99 |
-
output = model(**encoded)
|
| 100 |
-
embedding = output[0][:, 0] # CLS token
|
| 101 |
-
embedding = torch.nn.functional.normalize(embedding, p=2, dim=1)
|
| 102 |
-
```
|
| 103 |
-
|
| 104 |
## 训练细节
|
| 105 |
|
| 106 |
### 数据构建
|
|
|
|
| 46 |
- 混合检索架构中提供 **15.9%** 的不可替代增量(0.609→0.706)
|
| 47 |
- 三项核心结论在第三方公开数据集 AtmosphericQA 上全部得到验证
|
| 48 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 49 |
## 训练细节
|
| 50 |
|
| 51 |
### 数据构建
|