Upload tokenizer b62778b verified
Tran Thai commited on
How to use cpt-nemo-24/tom-20k with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("cpt-nemo-24/tom-20k", device_map="auto")