eeg2meg-tokenizer / tokenizer_config.json
gabrycina's picture
Upload tokenizer files
f07bf3a verified
raw
history blame
223 Bytes
{
"model_type": "wavelet",
"tokenizer_class": "WaveletTokenizer",
"auto_map": {
"AutoTokenizer": [
"transformers",
"WaveletTokenizer"
]
},
"vocab_size": 256,
"mu": 255.0,
"verbose": false
}