origin tokenizer : 42dot/42dot_LLM-PLM-1.3B (42dot/42dot_LLM-PLM-1.3B ์ ํ ํฌ๋์ด์ ์ ํธํ๋ฉ๋๋ค)
new added special tokens = ["$~me$", "$~the_flow_of_thought$", "$~dev$", "$~somebody$"]
replaced special tokens = {
"bos_token":"$~bos$",
"eos_token":"$~eos$",
"pad_token":"$~pad$",
"unk_token":"$~unk$",
}
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support