cvpfus
Add missing feature proposals
e163e74
|
Raw
History Blame Contribute Delete
1.77 kB
# Describe Generated Thumbnails
## Why
The generated-article page creates a thumbnail image through the image-generation role, but the UI assigns a generic alt string instead of asking the image descriptor role to describe the actual generated image. That weakens the core accessibility demo because generated visual content should become screen-reader-readable automatically.
## What Changes
- Call `/api/describe-image` after a generated thumbnail is available.
- Send the generated thumbnail URL, prompt, and article topic to the backend.
- Replace the generic thumbnail alt text with MiniCPM-generated or fallback alt text.
- Keep the page responsive if the descriptor endpoint is slow or unavailable.
- Ensure reader-mode narration uses the updated alt text when available.
## Capabilities
- `generated-image-description`: describe generated thumbnails with the configured MiniCPM-V-4.6 image descriptor path.
- `generated-image-fallback-alt`: preserve a useful fallback alt string when live description fails.
- `reader-alt-refresh`: let the reader experience pick up improved generated-image alt text.
## Non-Goals
- Do not change the image-generation API response shape.
- Do not change MiniCPM endpoint configuration.
- Do not block article rendering on image description.
- Do not require live MiniCPM credentials for verification.
## Impact
- `static/generate.js` will request a generated-thumbnail description after rendering the generated article.
- `app.py` already supports optional `image_url`; backend changes should be minimal unless validation gaps are found.
- `scripts/verify.py` will check that generated-image alt text flows through `/api/describe-image`.
- Docs may mention that generated thumbnails are also described for screen readers.