metadata
language: ko
license: apache-2.0
base_model: unsloth/Llama-3.2-1B-unsloth-bnb-4bit
tags:
- continued-pretraining
- wikipedia
backtesting-base Comparison Table
Evaluation Results
| Metric | v2_baseline |
|---|---|
| Evaluation Loss | 2.0515 |
| Perplexity (PPL) | 7.78 |
| BPC | 2.9597 |
Experiment Details
- Version: v2_baseline
- Method: train dataset 필터링
- Base Model: Llama-3.2-1B (Unsloth 4-bit)