onescorer-cpu-fork / README.md
gry2004's picture
fix: pin Python 3.10, bump gradio 4.44.1, fix tokenizers wheel, .gitignore pycache
0740b4c
|
Raw
History Blame Contribute Delete
1.7 kB

A newer version of the Gradio SDK is available: 6.20.0

Upgrade
metadata
title: OneAlign Scorer (CPU fork)
emoji: ⚖️
colorFrom: green
colorTo: red
sdk: gradio
sdk_version: 4.44.1
python_version: '3.10'
app_file: app.py
pinned: false
license: mit

OneAlign Scorer — CPU Fork (personal experiment)

This is a fork of teowu/OneScorer — the official Space for Q-Align (ICML 2024).

What this fork changes

  1. Remove broken examples=... — the original Space's example assets are git-LFS pointers that fail to resolve on cold start, causing gradio.Interface(... examples=[...]) to throw PIL.UnidentifiedImageError and the whole Space to crash.
  2. Auto-pick device (CUDA → CPU) so it can attempt to boot on free CPU hardware. Original was hard-coded to cuda:0.
  3. cache_examples=False, show_api=False for stability.

⚠️ Performance warning

The underlying model is q-future/one-align, a ~8B mPLUG-Owl2 LMM.

  • On GPU (1620GB VRAM): ~13 s per image. Works great.
  • On free CPU Space (this fork's hardware): the model may load successfully but a single inference can take many minutes, or hit RAM/timeout limits. This Space is uploaded purely for boot-time troubleshooting and as a stepping stone toward a paid GPU upgrade.

If you need real usage, please either:

  • Run locally on a GPU machine, or
  • Duplicate this Space and upgrade to a GPU runtime (T4-small ≈ $0.40/hour) in Space settings.

Credits

Paper: Wu et al. Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels (ICML 2024). arXiv:2312.17090

Original code: https://github.com/Q-Future/Q-Align Original Space: https://huggingface.co/spaces/teowu/OneScorer