Upload tokenizer 18b9272 verified
KyuheeKim commited on
How to use koreankiwi99/colbert_6000 with Transformers:
# Load model directly
from transformers import AutoTokenizer, ColBERT
tokenizer = AutoTokenizer.from_pretrained("koreankiwi99/colbert_6000")
model = ColBERT.from_pretrained("koreankiwi99/colbert_6000", device_map="auto")