metadata
license: apache-2.0
base_model: HuggingFaceTB/SmolLM3-3B
tags:
- trl
- unsloth
- smollm3
- text-generation-inference
- transformers
library_name: transformers
model_name: Generator3B-V0.2
datasets:
- GODELEV/Golden-Dataset-Beta3
Generator3B-V0.2
This model is a fine-tuned version of HuggingFaceTB/SmolLM3-3B. It was trained using Unsloth and the SFTTrainer on a specialized 'Golden Dataset' for high-quality instruction following.
Model Details
- Developed by: GODELEV
- Model type: Causal Language Model
- Language(s): English
- License: Apache 2.0
- Fine-tuned from model: SmolLM3-3B-Instruct
Training Procedure
The model was trained with maximum speed optimizations including:
- Sequence Packing: Enabled
- 4-bit Quantization: Bitsandbytes
- LoRA Rank: 64
- Optimizers: AdamW 8-bit