François-PE-Huali 12B

Quantized Versions

Prompting

Model has been tuned with the ChatML formatting. A typical input would look like this:

<|im_start|>user
Hi there!<|im_end|>
<|im_start|>assistant
Nice to meet you!<|im_end|>
<|im_start|>user
Can I ask a question?<|im_end|>
<|im_start|>assistant

System Prompting

I would highly recommend using either Euryale's system prompt or the EVA system prompt with the model.

              https://wandb.ai/new-eden/Rae/artifacts/axolotl-config/config-7d4ecudg/v0/files/axolotl_config_avyx566_.yml
            

Training

The training was done for 1 epoch using 8 x H200s GPUs graciously provided by Kalomaze for the fine-tuning of the model.

Credits

Thank you to Lucy Knada, Ateron, Alicat, Intervitens, Cgato, Kubernetes Bad and the rest of Anthracite.