SHRDFU-7b LoRA

Developed by: maldv
License: cc-by-nc-4.0
Finetuned from model: cgato/Thespis-CurtainCall-7b-v0.3
Methodology: Targeting attention layers with peft to condition; then small full layer tuning; extending intelligence and problem solving w/ crabcanon

As I work on understanding how to layer information in to the model, this dataset proved to be very interesting. It did show that it is very easy to overbake with inadequate sample size; but it sure thinks it is a smart model now.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for maldv/SHRDFU-7b-overbaked-lora

Base model

cgato/Thespis-CurtainCall-7b-v0.3

Finetuned

(2)

this model

maldv
/

SHRDFU-7b-overbaked-lora

SHRDFU-7b LoRA

Model tree for maldv/SHRDFU-7b-overbaked-lora

Dataset used to train maldv/SHRDFU-7b-overbaked-lora