Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

almaghrabima
/
SARF-Tokenizer

Arabic
English
tokenizer
arabic
morphology
benchmark
Model card Files Files and versions
xet
Community
SARF-Tokenizer
22.3 kB
  • 1 contributor
History: 3 commits
almaghrabima's picture
almaghrabima
Update: rank by parity+efficiency, add Falcon-H1-7B
5362025 3 days ago
  • .gitattributes
    1.52 kB
    initial commit 3 days ago
  • README.md
    4.65 kB
    Update: rank by parity+efficiency, add Falcon-H1-7B 3 days ago
  • results.json
    4.11 kB
    Update: rank by parity+efficiency, add Falcon-H1-7B 3 days ago
  • tokenizer_benchmark.py
    12 kB
    Update: rank by parity+efficiency, add Falcon-H1-7B 3 days ago