| license: apache-2.0 | |
| language: | |
| - en | |
| - ko | |
| library_name: transformers | |
| !! Demo version - using just few data on finetuning | |
| ### info | |
| base model : hwkwon/S-SOLAR-10.7B-v1.4 | |
| data : modified nox sft data | |
| epoch : 1epoch | |
| machine : L40 X 4 (vram 200GB) | |
| ### prompt | |
| ``` | |
| \nInput : {"prompt"} | |
| \nOutput : {"response"} | |
| ``` | |
| ### method | |
| using nox sft data | |
| https://huggingface.co/datasets/davidkim205/kollm-converations | |
| try to enhance the dataset. |