nmcsitian commited on
Commit
2ad5db9
·
verified ·
1 Parent(s): 40da8d3

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +0 -55
README.md CHANGED
@@ -46,61 +46,6 @@ BGE-Meteo-zh 是基于 [BAAI/bge-large-zh-v1.5](https://huggingface.co/BAAI/bge-
46
  - 混合检索架构中提供 **15.9%** 的不可替代增量(0.609→0.706)
47
  - 三项核心结论在第三方公开数据集 AtmosphericQA 上全部得到验证
48
 
49
- ## 使用方法
50
-
51
- ### 使用 FlagEmbedding
52
-
53
- ```python
54
- from FlagEmbedding import FlagModel
55
-
56
- model = FlagModel(
57
- 'nmcsitian/bge-meteo-zh',
58
- query_instruction_for_retrieval="为这个句子生成表示以用于检索相关文章:"
59
- )
60
-
61
- queries = ["切变线对暴雨的影响"]
62
- passages = ["江淮切变线附近伴随辐合上升运动,促进不稳定能量释放,可引发持续暴雨过程"]
63
-
64
- q_embeddings = model.encode_queries(queries)
65
- p_embeddings = model.encode(passages)
66
-
67
- scores = q_embeddings @ p_embeddings.T
68
- print(scores)
69
- ```
70
-
71
- ### 使用 Sentence-Transformers
72
-
73
- ```python
74
- from sentence_transformers import SentenceTransformer
75
-
76
- model = SentenceTransformer('nmcsitian/bge-meteo-zh')
77
-
78
- query = "为这个句子生成表示以用于检索相关文章:切变线对暴雨的影响"
79
- passage = "江淮切变线附近伴随辐合上升运动,促进不稳定能量释放,可引发持续暴雨过程"
80
-
81
- embeddings = model.encode([query, passage])
82
- similarity = embeddings[0] @ embeddings[1]
83
- print(f"相似度: {similarity:.4f}")
84
- ```
85
-
86
- ### 使用 Transformers
87
-
88
- ```python
89
- from transformers import AutoTokenizer, AutoModel
90
- import torch
91
-
92
- tokenizer = AutoTokenizer.from_pretrained('nmcsitian/bge-meteo-zh')
93
- model = AutoModel.from_pretrained('nmcsitian/bge-meteo-zh')
94
-
95
- query = "为这个句子生成表示以用于检索相关文章:切变线对暴雨的影响"
96
- encoded = tokenizer(query, padding=True, truncation=True, return_tensors='pt', max_length=512)
97
-
98
- with torch.no_grad():
99
- output = model(**encoded)
100
- embedding = output[0][:, 0] # CLS token
101
- embedding = torch.nn.functional.normalize(embedding, p=2, dim=1)
102
- ```
103
-
104
  ## 训练细节
105
 
106
  ### 数据构建
 
46
  - 混合检索架构中提供 **15.9%** 的不可替代增量(0.609→0.706)
47
  - 三项核心结论在第三方公开数据集 AtmosphericQA 上全部得到验证
48
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
  ## 训练细节
50
 
51
  ### 数据构建