Upload tokenizer 7636d6f verified
KyuheeKim commited on
How to use koreankiwi99/colbert_4000 with Transformers:
# Load model directly
from transformers import AutoTokenizer, ColBERT
tokenizer = AutoTokenizer.from_pretrained("koreankiwi99/colbert_4000")
model = ColBERT.from_pretrained("koreankiwi99/colbert_4000", device_map="auto")