Prototypes
Collection
Separate Prototype models made to test out something, before being "merged" into the SAXON models • 2 items • Updated • 1
How to use SAXON-AI/SAXON-INCEL with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("deepseek-ai/DeepSeek-R1-Distill-Llama-8B")
model = PeftModel.from_pretrained(base_model, "SAXON-AI/SAXON-INCEL")Configuration Parsing Warning:Invalid JSON for config file config.json
The first version of the SAXON model to be trained on the prototype SAXON dataset.
SAXON-INCEL is a Deepseek R1 model finetuned with the SAXON dataset, due to my small dataset and it's general quality, I named this model SAXON-INCEL incase it did anything weird, it should act normal once I've merged it into a better model like SAXON-0-I.
Base model
deepseek-ai/DeepSeek-R1-Distill-Llama-8B