batteryphil
/

mamba-2.8b-latent

Text Generation

state-space-model

latent-reasoning

reinforcement-learning

mathematical-logic

Model card Files Files and versions

batteryphil commited on Apr 6

Commit

9976ea4

·

verified ·

1 Parent(s): b0f640c

Upload tokenizer

Files changed (1) hide show

tokenizer_config.json +1 -1

tokenizer_config.json CHANGED Viewed

@@ -10,7 +10,7 @@
   ],
   "is_local": false,
   "model_max_length": 1000000000000000019884624838656,
-  "pad_token": "<|endoftext|>",
   "tokenizer_class": "GPTNeoXTokenizer",
   "trim_offsets": true,
   "unk_token": "<|endoftext|>"

   ],
   "is_local": false,
   "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<|padding|>",
   "tokenizer_class": "GPTNeoXTokenizer",
   "trim_offsets": true,
   "unk_token": "<|endoftext|>"