|
|
--- |
|
|
license: cc-by-nc-4.0 |
|
|
language: |
|
|
- ko |
|
|
library_name: peft |
|
|
pipeline_tag: text-generation |
|
|
--- |
|
|
|
|
|
# Raphael21/Raphael21-SOLAR-10.7B |
|
|
|
|
|
## Model Details |
|
|
|
|
|
**Training** |
|
|
A100x8 * 1 |
|
|
|
|
|
**Base Model** |
|
|
[Edentns/DataVortexS-10.7B-dpo-v1.11](https://huggingface.co/Edentns/DataVortexS-10.7B-dpo-v1.11) |
|
|
|
|
|
|
|
|
# Implementation Code |
|
|
```python |
|
|
from transformers import AutoModelForCausalLM, AutoTokenizer |
|
|
import torch |
|
|
|
|
|
repo = "Raphael21/Raphael21-SOLAR-10.7B" |
|
|
model = AutoModelForCausalLM.from_pretrained( |
|
|
repo, |
|
|
torch_dtype=torch.float16, |
|
|
device_map='auto' |
|
|
) |
|
|
tokenizer = AutoTokenizer.from_pretrained(repo) |
|
|
``` |
