README.md

metadata

title: zai-openai-proxy
colorFrom: blue
colorTo: indigo
sdk: docker
pinned: false

zai-openai-proxy

FastAPI proxy service exposing:

• GET /
• GET /healthz
• GET /v1/models
• POST /v1/chat/completions
• POST /v1/messages

Deploy Notes (Hugging Face Spaces)

This project uses Dockerfile and runs with sdk: docker. The app reads PORT from environment and defaults to 7860, which is compatible with Hugging Face Spaces.

Optional Space Variables

• LOG_LEVEL (default: INFO)
• HTTP_DEBUG (default: 0)
• ENABLE_THINKING (default: 1)
• TOKEN_MAX_AGE (default: 480)
• POOL_MIN_SIZE (default: 3)
• POOL_MAX_SIZE (default: 9)
• POOL_TARGET_INFLIGHT_PER_ACCOUNT (default: 2)
• POOL_MAINTAIN_INTERVAL (default: 10)
• POOL_SCALE_DOWN_IDLE_ROUNDS (default: 3)
• UPSTREAM_FIRST_EVENT_TIMEOUT (default: 60)
• UPSTREAM_FIRST_EVENT_TIMEOUT_RETRY_MAX (default: 2)