| language: ko | |
| license: apache-2.0 | |
| base_model: unsloth/Llama-3.2-1B-unsloth-bnb-4bit | |
| tags: | |
| - continued-pretraining | |
| - wikipedia | |
| - unsloth | |
| # backtesting - v2_baseline | |
| ## Evaluation Results | |
| | Metric | Value | v4_pure_KR | v5_baseline | | |
| | --- | --- | --- | --- | | |
| | **Evaluation Loss** | 2.0091 | | |
| | **Perplexity (PPL)** | 7.46 | | |
| | **BPC** | 2.8985 | | |
| ## Experiment Note | |
| - Version: v2_baseline | |
| - Target: Korean Wikipedia Continued Pretraining |