Spaces:

umyunsang
/

govon-runtime

Paused

umyunsang commited on 12 days ago

Commit

741d10d

verified ·

1 Parent(s): 0104403

fix: KV_CACHE_DTYPE=fp8 제거 (A100 80GB 여유 충분) + ninja-build 추가

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -11,7 +11,6 @@ ENV PYTHONUNBUFFERED=1 \
     GPU_UTILIZATION=0.90 \
     MAX_MODEL_LEN=8192 \
     ENFORCE_EAGER=false \
-    KV_CACHE_DTYPE=fp8 \
     ADAPTER_PATHS="civil=umyunsang/govon-civil-adapter,legal=siwo/govon-legal-adapter"
 WORKDIR /app
@@ -19,7 +18,7 @@ WORKDIR /app
 COPY --from=ghcr.io/astral-sh/uv:0.7.12 /uv /bin/uv
 RUN apt-get update && apt-get install -y --no-install-recommends \
-    python3.10 python3.10-dev git gcc \
     && rm -rf /var/lib/apt/lists/*
 COPY requirements.txt .

     GPU_UTILIZATION=0.90 \
     MAX_MODEL_LEN=8192 \
     ENFORCE_EAGER=false \
     ADAPTER_PATHS="civil=umyunsang/govon-civil-adapter,legal=siwo/govon-legal-adapter"
 WORKDIR /app
 COPY --from=ghcr.io/astral-sh/uv:0.7.12 /uv /bin/uv
 RUN apt-get update && apt-get install -y --no-install-recommends \
+    python3.10 python3.10-dev git gcc ninja-build \
     && rm -rf /var/lib/apt/lists/*
 COPY requirements.txt .