Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

SRP-base-model-training
/
tokenizer

Model card Files Files and versions
xet
Community

You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

Log in or Sign Up to review the conditions and access this model content.

Gated model
You can list files but not access them

Preview of files found in this repository
  • spm_bpe_tokenizer_50000_new
    Upload folder using huggingface_hub 7 months ago
  • .gitattributes
    2.91 kB
    Upload folder using huggingface_hub 7 months ago
  • README.md
    3.33 kB
    Update README.md 7 months ago
  • english_eval_texts.json
    19.9 MB
    xet
    Upload folder using huggingface_hub 7 months ago
  • inference_gemma.py
    980 Bytes
    Upload folder using huggingface_hub 7 months ago
  • kazakh_eval_texts.json
    43.1 MB
    xet
    Upload folder using huggingface_hub 7 months ago
  • russian_eval_texts.json
    41.1 MB
    xet
    Upload folder using huggingface_hub 7 months ago
  • sentencepeice-bpe-tokenizer.py
    6.17 kB
    Upload folder using huggingface_hub 7 months ago
  • test-tokenizer-gemma-3-1b.py
    12.1 kB
    Upload folder using huggingface_hub 7 months ago
  • test-tokenizer.py
    11.7 kB
    Upload folder using huggingface_hub 7 months ago
  • tokenizer_evaluation.json
    671 Bytes
    Upload folder using huggingface_hub 7 months ago