finalform
/

auto-gpt-oss-120B

Model card Files Files and versions

Metrics Training metrics Community

finalform commited on Feb 7

Commit

de2e7b1

·

verified ·

1 Parent(s): c964bd3

Update tokenizer_config.json

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -11,5 +11,5 @@
   "model_max_length": 1000000000000000019884624838656,
   "model_specific_special_tokens": {},
   "pad_token": "<|return|>",
-  "tokenizer_class": "TokenizersBackend"
 }

   "model_max_length": 1000000000000000019884624838656,
   "model_specific_special_tokens": {},
   "pad_token": "<|return|>",
+  "tokenizer_class": "PreTrainedTokenizerFast"
 }