Hugging Face's logo

a2ran
/
kor_chatGLM

PEFT
Model card Files
xet
 Community
1
How to use from the
Use from the
PEFT library
from peft import PeftModel
from transformers import AutoModelForCausalLM

base_model = AutoModelForCausalLM.from_pretrained("THUDM/chatglm-6b")
model = PeftModel.from_pretrained(base_model, "a2ran/kor_chatGLM")
  • WIP

Data used : https://raw.githubusercontent.com/Beomi/KoAlpaca/main/alpaca_data.json

training_args = TrainingArguments( "output", fp16 =True, gradient_accumulation_steps=1, per_device_train_batch_size = 1, learning_rate = 1e-4, max_steps=3000, logging_steps=100, remove_unused_columns=False, seed=0, data_seed=0, group_by_length=False, )

Downloads last month
11
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support