OpenCUA: Open Foundations for Computer-Use Agents
Paper • 2508.09123 • Published • 33
How to use ageppert/world-model-7b-lora with PEFT:
from peft import PeftModel
from transformers import AutoModelForCausalLM
base_model = AutoModelForCausalLM.from_pretrained("xlangai/OpenCUA-7B")
model = PeftModel.from_pretrained(base_model, "ageppert/world-model-7b-lora")LoRA adapter fine-tuned on ageppert/world-model-transitions for predicting GUI state transitions in desktop computer-use tasks.
from peft import PeftModel
from transformers import AutoModelForVision2Seq, AutoProcessor
base_model = AutoModelForVision2Seq.from_pretrained("xlangai/OpenCUA-7B", trust_remote_code=True)
model = PeftModel.from_pretrained(base_model, "ageppert/world-model-7b-lora")
processor = AutoProcessor.from_pretrained("ageppert/world-model-7b-lora")
Based on OpenCUA (arXiv:2508.09123).