GameMaster-v1-2B / README.md
theprint's picture
Update README.md
6d788d6 verified
|
Raw
History Blame Contribute Delete
1.58 kB
metadata
base_model: unsloth/Qwen3.5-2B
tags:
  - fine-tuned
  - lora
  - sft
  - auto-sft
language:
  - en
library_name: transformers

GameMaster-v1-2B

A fine-tuned version of unsloth/Qwen3.5-2B trained on GameMastering sharegpt data using Auto-SFT — an automated hyperparameter search and supervised fine-tuning pipeline.

The base model was adapted to follow the style and content of the GameMastering sharegpt dataset. Expect improved performance on tasks similar to those represented in the training data.

Model Details

Property Value
Base model unsloth/Qwen3.5-2B
Training data data/GameMastering-sharegpt.json
Fine-tuning epochs 2
Fine-tuning date 2026-07-19
Fine-tuning method LoRA (merged to full 16-bit)

Training Hyperparameters

LoRA

Parameter Value
r 4
alpha 16
dropout 0.04
target_modules ['q_proj', 'v_proj', 'k_proj', 'o_proj']

Training

Parameter Value
learning_rate 1e-05
batch_size 4
gradient_accumulation_steps 8
warmup_ratio 0.03
max_seq_length 2048
quantization none

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model     = AutoModelForCausalLM.from_pretrained("theprint/Survivor-v1-7B")
tokenizer = AutoTokenizer.from_pretrained("theprint/Survivor-v1-7B")

Generated by Auto-SFT