Initial upload: TrOCR LoRA adapter and Gradio demo e74b0f8
manishw7 commited on
How to use manishw10/devgen-trocr-devanagari-lora with PEFT:
from peft import PeftModel
from transformers import AutoModelForSeq2SeqLM
base_model = AutoModelForSeq2SeqLM.from_pretrained("paudelanil/trocr-devanagari-2")
model = PeftModel.from_pretrained(base_model, "manishw10/devgen-trocr-devanagari-lora")How to use manishw10/devgen-trocr-devanagari-lora with Transformers:
# Use a pipeline as a high-level helper
# Warning: Pipeline type "image-to-text" is no longer supported in transformers v5.
# You must load the model directly (see below) or downgrade to v4.x with:
# 'pip install "transformers<5.0.0'
from transformers import pipeline
pipe = pipeline("image-to-text", model="manishw10/devgen-trocr-devanagari-lora") # Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("manishw10/devgen-trocr-devanagari-lora", dtype="auto")