capstone_project / README.md
Irutingabo's picture
Switch to Gradio + ZeroGPU (Docker SDK not available on this account)
b6783b8 verified
|
Raw
History Blame Contribute Delete
1.27 kB
---
title: Umubyeyi Generator API
emoji: 🌿
colorFrom: purple
colorTo: gray
sdk: gradio
sdk_version: 6.5.1
app_file: app.py
pinned: false
short_description: Inference API for Umubyeyi's fine-tuned BLOOMZ generator
---
# Umubyeyi — fine-tuned generator inference API
This Space hosts Umubyeyi's own fine-tuned emotional-support generator
(BLOOMZ-560m, LoRA on real ESConv data) so the deployed Vercel app can call
real generation instead of falling back to retrieval — Vercel's serverless
Python functions cannot bundle PyTorch/Transformers within their 500MB size
limit, but this Space (with a free ZeroGPU allocation) has no such
constraint.
This is not a chat UI for end users, though the page above lets you try it
directly. The programmatic contract is a named Gradio API endpoint:
```
POST {space_url}/call/generate {"data": ["<message>", "en", "[]"]}
-> {"event_id": "..."}
GET {space_url}/call/generate/{event_id} (Gradio's async SSE result stream)
```
The model, LoRA adapter, and prompt format here are identical to
`src/finetuned_generator.py` in the main repository
(https://github.com/IrutingaboRaissa/UMUBYEYI) — this Space exists purely to
run the same weights on infrastructure without Vercel's size limit, not to
run a different model.