File size: 1,269 Bytes
d30984e
b425bec
 
 
 
b6783b8
 
 
b425bec
 
d30984e
b425bec
 
 
 
 
 
 
b6783b8
 
b425bec
b6783b8
 
b425bec
 
b6783b8
 
 
b425bec
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
---
title: Umubyeyi Generator API
emoji: 🌿
colorFrom: purple
colorTo: gray
sdk: gradio
sdk_version: 6.5.1
app_file: app.py
pinned: false
short_description: Inference API for Umubyeyi's fine-tuned BLOOMZ generator
---

# Umubyeyi — fine-tuned generator inference API

This Space hosts Umubyeyi's own fine-tuned emotional-support generator
(BLOOMZ-560m, LoRA on real ESConv data) so the deployed Vercel app can call
real generation instead of falling back to retrieval — Vercel's serverless
Python functions cannot bundle PyTorch/Transformers within their 500MB size
limit, but this Space (with a free ZeroGPU allocation) has no such
constraint.

This is not a chat UI for end users, though the page above lets you try it
directly. The programmatic contract is a named Gradio API endpoint:

```
POST {space_url}/call/generate  {"data": ["<message>", "en", "[]"]}
-> {"event_id": "..."}
GET  {space_url}/call/generate/{event_id}   (Gradio's async SSE result stream)
```

The model, LoRA adapter, and prompt format here are identical to
`src/finetuned_generator.py` in the main repository
(https://github.com/IrutingaboRaissa/UMUBYEYI) — this Space exists purely to
run the same weights on infrastructure without Vercel's size limit, not to
run a different model.