metadata
language: ko
license: apache-2.0
base_model: unsloth/Llama-3.2-1B-unsloth-bnb-4bit
tags:
- continued-pretraining
- wikipedia
- unsloth
backtesting - v2_baseline
Evaluation Results
| Metric | Value | v4_pure_KR | v5_baseline |
|---|---|---|---|
| Evaluation Loss | 2.0091 | ||
| Perplexity (PPL) | 7.46 | ||
| BPC | 2.8985 |
Experiment Note
- Version: v2_baseline
- Target: Korean Wikipedia Continued Pretraining