How to use claudios/sptcode with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="claudios/sptcode")
# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("claudios/sptcode") model = AutoModel.from_pretrained("claudios/sptcode")
cbcf394
1
2
3
4
5
6
7
8
9
{ "bos_token": "[SOS]", "eos_token": "[EOS]", "mask_token": "[MSK]", "pad_token": "[PAD]", "sep_token": "[SEP]", "unk_token": "[UNK]" }
