MiniCPM-Llama3-V-2.5-checkpoint

This is a LoRA checkpoint for fine-tuning the MiniCPM-Llama3-V-2.5 model. The checkpoint is contained inside the minicpm folder.

Usage

To use this LoRA with the base model, load the base model and apply the LoRA checkpoint like this:

from peft import PeftModel
from transformers import AutoModel

# Define model type and path to the adapter
model_type = "openbmb/MiniCPM-Llama3-V-2.5"
path_to_adapter = "path_to_lora_checkpoint"

# Load the base pre-trained model
model = AutoModel.from_pretrained(
    model_type,
    trust_remote_code=True
)

# Load the LoRA adapter and move model to GPU
lora_model = PeftModel.from_pretrained(
    model,
    path_to_adapter,
    device_map="auto",
    trust_remote_code=True
).eval().cuda()

# Your code here