Upload tokenizer 34c65d0 verified
Tran Thai commited on
How to use cpt-nemo-24/tom-de-32k with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("cpt-nemo-24/tom-de-32k", device_map="auto")