Model Card for Model ID
--- Configuration ---
MODEL_NAME = "HuggingFaceTB/SmolLM-135M" DATASET_NAME = "skrishna/toy-toxicity-dataset" OUTPUT_DIR_BASE = "./results_toxic_finetune" FINE_TUNED_MODEL_DIR = "./fine_tuned_toxic_model"
Hugging Face Hub specific configuration
HF_REPO_ID = "MattBou00/SmolLM-toxic-finetuned"
Training parameters
NUM_TRAIN_EPOCHS = 0.1 PER_DEVICE_TRAIN_BATCH_SIZE = 8 LEARNING_RATE = 2e-5 LOGGING_STEPS = 50 SAVE_STRATEGY = "epoch"
Generation parameters
MAX_NEW_TOKENS_GENERATION = 30 TEMPERATURE_GENERATION = 1.0 NUM_SAMPLES_TO_EVALUATE = 20
- Downloads last month
- 2