qikp/finephrase-explanation-1b
Viewer • Updated • 217k • 39
How to use qikp/pika-4 with Transformers:
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("qikp/pika-4", device_map="auto")🎉 You are looking at pika 4, which is using FinePhrase and a more efficient vocabulary size!
pika is a simple and public domain-like tokenizer.
<|endoftext|> (ID 0)pika was trained on a portion of format/explanation-1b-hq from FinePhrase.
Extra special tokens aren't present, you'll have to add them manually if needed.