metadata
license: apache-2.0
datasets:
- liyucheng/zhihu_rlhf_3k
language:
- zh
base_model:
- lucky2me/Dorami-Chat
Dorami-Chat-LoRA
Dorami-Chat-LoRA is a Low-Rank Adaptation(LoRA) model based on the model lucky2me/Dorami-Chat
Model description
Training data
Training code
How to use
1. Download model from Hugging Face Hub to local
git lfs install
git clone https://huggingface.co/lucky2me/Dorami-Chat-LoRA
2. Use the model downloaded above
from transformers import AutoTokenizer, AutoModelForCausalLM, GenerationConfig
model_path = "The path of the model downloaded above"
tokenizer = AutoTokenizer.from_pretrained(model_path)
model = AutoModelForCausalLM.from_pretrained(model_path)
prompt="fill in any prompt you like."
inputs = tokenizer(prompt, return_tensors="pt")
generation_config = GenerationConfig(max_new_tokens=64, do_sample=True, top_k=2, eos_token_id=model.config.eos_token_id)
outputs = model.generate(**inputs, generation_config=generation_config)
decoded_text = tokenizer.batch_decode(outputs, skip_special_tokens=True)
print(decoded_text)