add tokenizer 5934fa1
Jason commited on
How to use hkunlp/from_all_T5_base_prefix_spider_with_cell_value2 with Transformers:
# Load model directly
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("hkunlp/from_all_T5_base_prefix_spider_with_cell_value2")
model = AutoModel.from_pretrained("hkunlp/from_all_T5_base_prefix_spider_with_cell_value2", device_map="auto")