SmolFactory / requirements.txt
Tonic
adds A100 large experiments
5fe83da unverified
raw
history blame
646 Bytes
# Core dependencies
torch>=2.0.0
transformers>=4.53.0
datasets>=2.14.0
accelerate>=0.20.0
trl>=0.7.0
# Hugging Face ecosystem
huggingface-hub>=0.16.0
tokenizers>=0.13.0
# Training and optimization
flash-attn>=2.0.0
xformers>=0.0.20
bitsandbytes>=0.41.0
# Utilities
numpy>=1.24.0
pandas>=2.0.0
scikit-learn>=1.3.0
tqdm>=4.65.0
wandb>=0.15.0
# Optional: for evaluation
lighteval>=0.1.0
evaluate>=0.4.0
# Optional: for deployment
vllm>=0.2.0
sentencepiece>=0.1.99
# Development
pytest>=7.0.0
black>=23.0.0
isort>=5.12.0
# Experiment tracking and monitoring
trackio>=0.1.0
psutil>=5.9.0
# Hugging Face Hub integration
huggingface_hub>=0.16.0