gemma2b-it-dutch-v1

Model description

Really shitty finetune of gemma-2b-it using BramVanroy/alpaca-cleaned-dutch.

Intended uses & limitations

Its finetuned on gemma-2b-it which is an english model. However because gemma has a large vocab size i thought it to be interessting to see if it could learn dutch.

Training and evaluation data

Trained on BramVanroy/alpaca-cleaned-dutch dataset. Therefore, commercial use of this model is forbidden. The model is intended for research purposes only.

Training procedure

Trained with QLoRA and merged before upload.

Training hyperparameters

idk anymore tbh (i think it has been trained on 400 steps)

Downloads last month
1
Safetensors
Model size
3B params
Tensor type
F16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train cherryboi/gemma2b-it-dutch-v1