Update README.md

README.md

@@ -1,12 +1,17 @@
----
-tags:
-- pretrain_model
-- transformers
-- TCM 
-- herberta
-license: apache-2.0
-inference: true
----
+---
+tags:
+- pretrain_model
+- transformers
+- TCM
+- herberta
+license: apache-2.0
+inference: true
+language:
+- aa
+base_model:
+- hfl/chinese-roberta-wwm-ext
+library_name: transformers
+---
 ### intrudcution
 Herberta Pretrain model  experimental research model developed by the Angelpro Team, focused on Development of a pre-training model for herbal medicine.Based on the chinese-roberta-wwm-ext-large model, we do the MLM task to complete the pre-training model on the data of 675 ancient books and 32 Chinese medicine textbooks, which we named herberta, where we take the front and back words of herb and Roberta and splice them together. We are committed to make a contribution to the TCM big modeling industry.
 We hope it can be used:
@@ -14,18 +19,6 @@ We hope it can be used:
   - Word Embedding Model for Chinese Medicine Domain Data
   - Support for a wide range of downstream TCM tasks, e.g., classification tasks, labeling tasks, etc.
 
-### model_config
-```json
-{
-  "hidden_size": 1024,
-  "max_position_embeddings": 512,
-  "model_type": "bert",
-  "num_attention_heads": 16,
-  "num_hidden_layers": 24,
-  "torch_dtype": "float32",
-  "vocab_size": 21128
-}
-```
 
 ### requirements
 "transformers_version": "4.45.1"
@@ -35,6 +28,32 @@ pip install herberta
 ###  Quickstart
 
 #### Use Huggingface
+```python
+from transformers import AutoTokenizer, AutoModel
+
+# Replace "XiaoEnn/herberta" with the Hugging Face model repository name
+model_name = "XiaoEnn/herberta"
+
+# Load tokenizer and model
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+model = AutoModel.from_pretrained(model_name)
+
+# Input text
+text = "中医理论是我国传统文化的瑰宝。"
+
+# Tokenize and prepare input
+inputs = tokenizer(text, return_tensors="pt", truncation=True, padding="max_length", max_length=128)
+
+# Get the model's outputs
+with torch.no_grad():
+    outputs = model(**inputs)
+
+# Get the embedding (sentence-level average pooling)
+sentence_embedding = outputs.last_hidden_state.mean(dim=1)
+
+print("Embedding shape:", sentence_embedding.shape)
+print("Embedding vector:", sentence_embedding)
+```
 
 
 #### LocalModel
@@ -72,4 +91,4 @@ If you find our work helpful, feel free to give us a cite.
   institution={Beijing Angopro Technology Co., Ltd.},
   year={2024},
   note={Presented at the 2024 Machine Learning Applications Conference (MLAC)}
-}
+}