mon_tokenizer / .gitignore
janakhpon's picture
feat: restructure and upgrade to 32k vocab model (v2)
e909ce1
raw
history blame contribute delete
522 Bytes
# HuggingFace Hub — only model artifact files belong in this repo.
# Developer scripts, virtual environments, and package tooling stay local.
# Python tooling (local only)
__pycache__/
*.py[oc]
.venv/
.env
build/
dist/
wheels/
*.egg-info
# Package management (local only)
pyproject.toml
uv.lock
.python-version
# Developer scripts (local only)
convert_to_hf.py
upload_to_hub.py
sample_usage.py
test_tokenizer.py
# Stale metadata
*.meta.json
# LM config not applicable to standalone tokenizer
generation_config.json