How to use Omarrran/Kashmiri_WordPiece_Tokenizer with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Omarrran/Kashmiri_WordPiece_Tokenizer", device_map="auto")
Omarrran commited on 