SamAI-Tokenizer / CITATION.cff
Samai-sa's picture
Publish updated SamAI Tokenizer repository
d1d3fe6 verified
Raw History Blame Contribute Delete
359 Bytes
cff-version: 1.2.0
message: "If you use SamAI-Tokenizer, please cite this repository."
title: "SamAI-Tokenizer: An Arabic-Focused Byte-Level BPE Tokenizer"
type: software
authors:
- family-names: Aljohani
given-names: Yasser
version: 1.0.0
date-released: 2026-09-20
license: Apache-2.0
repository-code: "https://huggingface.co/Samai-sa/SamAI-Tokenizer"