SelfHelp-v1-2B / README.md
theprint's picture
Update README.md
4f09183 verified
|
Raw
History Blame Contribute Delete
1.62 kB
metadata
base_model: unsloth/Qwen3.5-2B
datasets:
  - theprint/SelfHelp-ShareGPT
tags:
  - fine-tuned
  - lora
  - sft
  - auto-sft
language:
  - en
library_name: transformers

SelfHelp-v1-2B

A fine-tuned version of unsloth/Qwen3.5-2B trained on theprint SelfHelp ShareGPT data using Auto-SFT — an automated hyperparameter search and supervised fine-tuning pipeline.

The base model was adapted to follow the style and content of the theprint SelfHelp ShareGPT dataset. Expect improved performance on tasks similar to those represented in the training data.

Model Details

Property Value
Base model unsloth/Qwen3.5-2B
Training data theprint/SelfHelp-ShareGPT
Fine-tuning epochs 2
Fine-tuning date 2026-07-20
Fine-tuning method LoRA (merged to full 16-bit)

Training Hyperparameters

LoRA

Parameter Value
r 64
alpha 64
dropout 0.03
target_modules ['q_proj', 'v_proj', 'k_proj', 'o_proj']

Training

Parameter Value
learning_rate 1e-05
batch_size 2
gradient_accumulation_steps 4
warmup_ratio 0.05
max_seq_length 512
quantization none

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model     = AutoModelForCausalLM.from_pretrained("theprint/SelfHelp-v1-2B")
tokenizer = AutoTokenizer.from_pretrained("theprint/SelfHelp-v1-2B")

Generated by Auto-SFT