Hugging Face's logo

Snowflake
/
snowflake-arctic-embed-l-v2.0

Sentence Similarity
sentence-transformers
ONNX
Safetensors
Transformers.js
xlm-roberta
feature-extraction
mteb
arctic
snowflake-arctic-embed
Eval Results (legacy)
Eval Results
text-embeddings-inference
Model card Files
xet
 Community
22

Is `sentencepiece.bpe.model` missing?

#5
by sealad886 - opened
Discussion
sealad886

Hi there, just wondering if you might be able to upload the BPE model file please?
sealad886

Or is it just an exact copy of the file from BAAI/bge-m3-retromae?
lukemerrick

The tokenizer is indeed unchanged. Is the lack of a copy in this repo creating issues with running the model?
rayzinnz

The tokenizer is indeed unchanged. Is the lack of a copy in this repo creating issues with running the model?

For my own experience the lack of sentencepiece.bpe.model prevents convert_hf_to_gguf.py from working. Getting that file from BAAI/bge-m3-retromae allowed the script to run without error.
OJ-1

Same issue as Rayzinnz.

pxyu
 Snowflake org

@OJ-1 @rayzinnz thanks for flagging the issue! I've added the file from BAAI/bge-m3 to avoid the issue in the future (pr).
pxyu changed discussion status to closed

Sign up or log in to comment