Transformers
my-fast-tokenizer / processor_config.json
aiwhisperer's picture
Upload FAST tokenizer trained on aiwhisperer/my-dataset-upload-test
cbcc6fc verified
raw
history blame contribute delete
249 Bytes
{
"action_dim": 6,
"auto_map": {
"AutoProcessor": "processing_action_tokenizer.UniversalActionProcessor"
},
"min_token": -32,
"processor_class": "UniversalActionProcessor",
"scale": 10.0,
"time_horizon": 10,
"vocab_size": 1024
}