foundation-models/minicpm-v-4.5-schematic-lora

MiniCPM-V-4.5 LoRA (schematic descriptions)

LoRA adapter for openbmb/MiniCPM-V-4_5, fine-tuned on PCB/schematic image descriptions.

Load with PEFT

from transformers import AutoModel, AutoTokenizer, AutoProcessor
from peft import PeftModel

base = AutoModel.from_pretrained("openbmb/MiniCPM-V-4_5", trust_remote_code=True, torch_dtype="bfloat16")
model = PeftModel.from_pretrained(base, "foundation-models/minicpm-v-4.5-schematic-lora")
tokenizer = AutoTokenizer.from_pretrained("foundation-models/minicpm-v-4.5-schematic-lora", trust_remote_code=True)
processor = AutoProcessor.from_pretrained("foundation-models/minicpm-v-4.5-schematic-lora", trust_remote_code=True)