---
library_name: transformers
license: other
base_model: SI-Lab/StepCount-7b-SFT-1M-ckpt3450
tags:
- llama-factory
- full
- qwen2.5-vl
- stepcount
- sft
model-index:
- name: StepCount-7B-SFT-1M
  results: []
---

# StepCount-7B-SFT-1M

This model is the final checkpoint (`checkpoint-476`) from continued SFT of
[SI-Lab/StepCount-7b-SFT-1M-ckpt3450](https://huggingface.co/SI-Lab/StepCount-7b-SFT-1M-ckpt3450)
on the `SFT_StepCount_merged_7500_plus_11_50` dataset.

Evaluation during training:

- eval_loss: 0.7951585054397583
- num_input_tokens_seen: 842742656
- global_step: 476

Training setup:

- distributed_type: multi-GPU
- num_devices: 8
- total_train_batch_size: 512
- gradient_accumulation_steps: 8
- learning_rate: 2.7e-6
- lr_scheduler_type: cosine
- training_steps: 476