orionscottage / docs /modal.md
red
Remove internal docs from public repo and tighten privacy for HF.
6a1b1ba
|
Raw
History Blame Contribute Delete
616 Bytes

A newer version of the Gradio SDK is available: 6.20.0

Upgrade

Modal — LLM polish workers

Deploy three GPU workers (MiniCPM, Aya, Nemotron) for parallel polish on the hosted Space.

.venv/bin/modal deploy modal_llm.py -e main

App name: orions-cottage-llm

HF Space secrets

Secret Value
MODAL_TOKEN_ID From the workspace that ran modal deploy
MODAL_TOKEN_SECRET Pairing secret
MODAL_ENVIRONMENT main
MODAL_APP_NAME orions-cottage-llm

Dashboard: https://modal.com/apps/<workspace>/main/deployed/orions-cottage-llm

First Plan after idle may take 1–2 minutes (cold GPU + model pull).