Spaces:
Sleeping
Sleeping
File size: 543 Bytes
26cc93e 5be713f 00bec90 26cc93e 5be713f 00bec90 5be713f 00bec90 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 | ---
title: chatPDB API
emoji: 🧬
colorFrom: green
colorTo: blue
sdk: gradio
app_file: app.py
pinned: false
---
# chatPDB Inference API
ZeroGPU-backed inference endpoint for chatPDB 32B v1 (Q4_K_M GGUF).
Consumed by the Flask PTY app at [chatpdb.mdeller.com](https://chatpdb.mdeller.com).
**Endpoint:** `POST /generate` — returns `text/event-stream` of token chunks.
**Cold start:** first request after idle downloads the ~18.4 GB GGUF and allocates the ZeroGPU
A10G (~60-120 s). This is a portfolio demo; availability is best-effort.
|