Hugging Face's logo

BAAI
/
bge-code-v1

Sentence Similarity
sentence-transformers
Safetensors
Transformers
Chinese
English
qwen2
feature-extraction
text-embeddings-inference
Model card Files
xet
 Community
6

Unable to load the custom tokenizer

#1
by tomaarsen - opened
Discussion
tomaarsen

Hello!

I'm excited to give this a try, but I ran into issues loading the custom tokenizer using the transformers and sentence_transformers snippets from the README. It seems to be caused by this, which does not point to a HF repository (or this repository itself): https://huggingface.co/BAAI/bge-code-v1/blob/main/tokenizer_config.json#L205

  • Tom Aarsen
hanhainebula
 Beijing Academy of Artificial Intelligence org

Hello, @tomaarsen . Thank you for bringing this issue to our attention! The problem has been fixed.
tomaarsen

Thank you!
tomaarsen changed discussion status to closed

Sign up or log in to comment