CausalFocus BBPE16K Tokenizer

Tokenizer-only repository for CausalFocus-GPTBERT-D256-BBPE16K.

  • family: byte-level BPE
  • vocab size: 16000
  • max sequence length used by release training: 512
  • source corpus: miguelcsx/babylm-corpus-cleaned
Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including miguelcsx/causal-focus-bbpe16k-tokenizer