File size: 359 Bytes
ea80f98
d1d3fe6
 
ea80f98
 
 
 
 
 
 
d1d3fe6
1
2
3
4
5
6
7
8
9
10
11
12
cff-version: 1.2.0
message: "If you use SamAI-Tokenizer, please cite this repository."
title: "SamAI-Tokenizer: An Arabic-Focused Byte-Level BPE Tokenizer"
type: software
authors:
  - family-names: Aljohani
    given-names: Yasser
version: 1.0.0
date-released: 2026-09-20
license: Apache-2.0
repository-code: "https://huggingface.co/Samai-sa/SamAI-Tokenizer"