Q-TensorFormer / checkpoints /tokenizer /tokenizer_config.json
Premchandyadav369
feat: deploy interactive Q-TensorFormer demo with trained weights and Gradio 4 UI
67ded87
Raw History Blame Contribute Delete
300 Bytes
{
"tokenizer_class": "QTensorFormerTokenizer",
"version": "1.0.0",
"vocab_size": 256,
"model_max_length": 64,
"pad_token": "<pad>",
"bos_token": "<bos>",
"eos_token": "<eos>",
"unk_token": "<unk>",
"vocab_sha256": "fc7ee274009d3aad8132b5f4de4c09091055439e22aa6b44196cab3ceb1db01e"
}