LightOnOCR-1B-Demo / backends

Commit History

Sync backends: Fix infinite loop and prompt echo
ff2c62c

DocUA commited on

Initial commit: Production-ready OCR with PyTorch and GGUF backends
112b381

DocUA commited on

feat: Manually construct the prompt string instead of using `apply_chat_template` and add a `repetition_penalty` to generation arguments.
db214c6

DocUA commited on

feat: Add repetition penalty to generation parameters and update default PDF scale slider value.
8098242

DocUA commited on

feat: Refactor `model.generate` parameters into `gen_kwargs` and add post-processing to remove the instruction prompt from generated text.
03c4021

DocUA commited on

feat: update ggml kernels, webui components, model templates, and build configurations
eb133b8

DocUA commited on