tokenizer.json · LisaMegaWatts/juliadistill-v2 at main

juliadistill-v2 / tokenizer.json

LisaMegaWatts's picture

Add 4000-vocab BPE tokenizer for inference serving

dd923fa verified 5 days ago

history contribute delete

268 kB

File too large to display, you can check the raw version instead.