metadata
license: cc-by-nc-4.0
language:
- ko
library_name: peft
pipeline_tag: text-generation
Raphael21/Raphael21-SOLAR-10.7B
Model Details
Training A100x8 * 1
Base Model Edentns/DataVortexS-10.7B-dpo-v1.11
Implementation Code
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
repo = "Raphael21/Raphael21-SOLAR-10.7B"
model = AutoModelForCausalLM.from_pretrained(
repo,
torch_dtype=torch.float16,
device_map='auto'
)
tokenizer = AutoTokenizer.from_pretrained(repo)