Duplicated from xushijie/polyBERT
How to use HAYDERphd/polyBERT with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("HAYDERphd/polyBERT") sentences = [ "[*]CC[*]", "[*]COC[*]", "[*]CC(C)C[*]" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3]
How to use HAYDERphd/polyBERT with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("HAYDERphd/polyBERT") model = AutoModel.from_pretrained("HAYDERphd/polyBERT", device_map="auto")
7bf9ed3
1
2
3
4
5
6
7
8
{ "[CLS]": 265, "[MASK]": 268, "[PAD]": 267, "[SEP]": 266, "[UNK]": 269 }
