trenchlesspm / _project /DEPENDENCIES.md
hirokamitai's picture
Switch persistence to HF Bucket trenchlesspm-cache mounted at /data
3d577e8
|
Raw
History Blame Contribute Delete
2.92 kB
# DEPENDENCIES β€” marker
<!-- UPDATE WHEN: an external service/API is added or removed, an account changes hands, billing changes, or credentials rotate -->
External systems this project depends on. If access to any of these is lost,
part or all of the project stops working. This file tells you what to recover.
Runtime library dependencies live in `requirements.txt` β€” don't duplicate them here.
---
## External services
| Service | What it does | Account (email) | Paid with | Monthly cost | Status page |
|---|---|---|---|---|---|
| Hugging Face Spaces | Hosts the Docker container, GPU (A10 small), secrets, autosleep. | localteampartners@gmail.com | card on file at HF | A10 small ~$1.05/hr Γ— ~hours actually parsing (target <$5/mo with 5-min autosleep) | https://status.huggingface.co |
| Hugging Face Buckets | Persistent model cache (`hirokamitai/trenchlesspm-cache`), private, mounted at `/data` on the Space. | localteampartners@gmail.com | card on file at HF | pay-per-byte; ~5 GB of marker weights, pennies per month | https://status.huggingface.co |
| Anthropic API | LLM-enhancement provider for `parse_mode=quality`. Marker calls Claude (Sonnet 4.6) for table/equation/layout cleanup. | localteampartners@gmail.com | card on file at Anthropic | usage-based; ~cents per parse on Sonnet 4.6 | https://status.anthropic.com |
## Domain / DNS
The Space is reachable at its HF-assigned URL (`https://<owner>-<space>.hf.space`).
No custom domain in v1. See [INFRASTRUCTURE.md](INFRASTRUCTURE.md).
## APIs & credentials
| API | Credential type | Where it lives |
|---|---|---|
| Hugging Face Hub | User access token (write) used by `hf` CLI to push to the Space repo. | 1Password > marker > HF_TOKEN |
| Anthropic (Claude) | API key (`ANTHROPIC_API_KEY`) | 1Password > marker > ANTHROPIC_API_KEY; also set as a Space secret |
| The Space itself | Bearer token (`API_TOKEN`) we mint and hand to callers | 1Password > marker > API_TOKEN; also set as a Space secret |
## Single points of failure
- **HF Space down β†’ entire API down.** No fallback, no second region. Acceptable for v1; this is internal tooling.
- **Anthropic down or quota-exhausted β†’ `parse_mode=quality` fails.** `parse_mode=fast` keeps working (no LLM call). Caller can retry in fast mode.
- **HF Bucket detached / unreachable β†’ cold starts re-download ~5 GB of marker weights into ephemeral container disk.** Requests still succeed, just slow for one boot, and the next sleep loses the cache again until the bucket is reattached.
## Account recovery
- All provider accounts use **localteampartners@gmail.com**. Recovery flows through that mailbox.
- HF account: 2FA recovery codes in 1Password (`marker > HF_RECOVERY_CODES`) β€” confirm these exist before relying on this entry.
- Anthropic account: 2FA recovery codes in 1Password (`marker > ANTHROPIC_RECOVERY_CODES`) β€” confirm these exist before relying on this entry.