dev-strender's picture
feat: switch demo to FT + Opus article review (pipeline_exp_261021_ft_hybrid)
3dfc93b verified
Raw History Blame Contribute Delete
16.8 kB
"""๋ฐ์ดํ„ฐ์…‹ยทTagSetยท์ •์ฑ… ์ƒ‰์ธ ๊ฐฑ์‹  (๊ณ„ํš 2026-09-27 L6 ยง2.5 ยท D-L6-7 ยท ๊ฒ€ํ†  F2ยทF9).
**ํ‚ค.** `sha256(JCS([lock_sha, template_sha, text_mode, INDEX_EXTRACTOR, index_code_sha]))` โ€” `lock_sha` = lock ํŒŒ์ผ ๋ฐ”์ดํŠธ sha256
(์—†์œผ๋ฉด null), `template_sha` = ์ •์ฑ… ํ…œํ”Œ๋ฆฟ ๋ฐ”์ดํŠธ sha256(์—†์œผ๋ฉด null), `text_mode` = `optin.text_mode()`, `INDEX_EXTRACTOR` =
`poc_bundle.index.row_tags.EXTRACTOR`, `index_code_sha` = **`poc_bundle` ํŒจํ‚ค์ง€ ์ „์ฒด**์˜ `*.py` (์ƒ๋Œ€ ๊ฒฝ๋กœ, ๊ธธ์ด, ๋ฐ”์ดํŠธ)๋ฅผ
๊ฒฝ๋กœ์ˆœ์œผ๋กœ ์ด์€ sha256. ์ƒ‰์ธ ์ถœ๋ ฅ์€ `index/` ๋ฐ– ๋ชจ๋“ˆ(`keys`ยท`scoring.policy`ยท`scoring.ids`ยท`snapshot`ยท`lock_match`ยท`canonical` โ€ฆ)
์—๋„ ๋‹ฌ๋ ค ์žˆ์–ด `index/*.py` ๋งŒ ๋ณด๋ฉด ๊ทธ์ชฝ ๋ณ€๊ฒฝ์„ ๋†“์นœ๋‹ค(๋ฆฌ๋ทฐ ์ง€์  3) โ€” ๋„“๊ฒŒ ์žก์•„ PB ๊ฐ€ ๋ฐ”๋€Œ๋ฉด ํ•œ ๋ฒˆ ๋” ๋งŒ๋“œ๋Š” ์ชฝ์„ ํƒํ–ˆ๋‹ค
(`poc_bundle.__version__` ์€ ๊ณ ์ •๊ฐ’์ด๋ผ ์ฝ”๋“œ ๋ณ€ํ™”๋ฅผ ๋ชป ์žก๋Š”๋‹ค). ํ‚ค ํŒŒ์ผ์€ `<hub_reports_dir>/<a>/<c>/hook/index-key.json`.
**ํŒ์ •(์ˆœ์„œ๋Œ€๋กœ).**
1. lock ์ด ์—†์œผ๋ฉด(`load_existing_lock(layout) is None`) ์„ธ ๋ช…๋ น ๋ชจ๋‘ ๊ฑด๋„ˆ๋›ด๋‹ค โ†’ `skipped:no_lock`(์‹คํŒจ ์•„๋‹˜, D-L6-11).
click ์˜ˆ์™ธ ๋ฌธ๊ตฌ๋Š” ํŒŒ์‹ฑํ•˜์ง€ ์•Š๋Š”๋‹ค โ€” CLI ๋ฅผ ๋ถ€๋ฅด๊ธฐ **์ „์—** ๊ฐ€๋ฅธ๋‹ค. ๋ ˆ์ด์•„์›ƒยทlock ์„ ์ฝ์ง€ ๋ชปํ•˜๋ฉด(๊นจ์ง„ lock ๋“ฑ) ๊ฐ€๋ฅด์ง€ ์•Š๊ณ 
CLI ๋ฅผ ๋ถˆ๋Ÿฌ ๊ทธ์ชฝ์ด ์‹คํŒจ๋ฅผ ๋ณด๊ณ ํ•˜๊ฒŒ ๋‘”๋‹ค.
2. ์ •์ฑ… ํ…œํ”Œ๋ฆฟ์ด ์—†์œผ๋ฉด `tags`ยท`policy` ๋Š” ๊ฑด๋„ˆ๋›ฐ๊ณ  `datasets` ๋งŒ โ€” ๊ฒฐ๊ณผ `written:datasets_only`.
3. ํ‚ค๊ฐ€ ๊ฐ™๊ณ  ์ƒ‰์ธ ๋ฃจํŠธ์˜ ๊ทธ case ๋””๋ ‰ํ† ๋ฆฌ(๋Œ ๋ช…๋ น์˜ ๊ฒƒ โ€” `datasets/`, ํ…œํ”Œ๋ฆฟ์ด ์žˆ์œผ๋ฉด `tagsets/`ยท`policies/` ๋„)๊ฐ€ ๋ชจ๋‘ ์žˆ์œผ๋ฉด
`unchanged`. ์•„๋‹ˆ๋ฉด **์˜› ํ‚ค๋ฅผ ๋จผ์ € ์ง€์šฐ๊ณ ** ๋ช…๋ น์„ ์ฐจ๋ก€๋กœ ๋ถ€๋ฅธ ๋’ค, ๊ฑด๋„ˆ๋›ฐ์ง€ ์•Š์€ ๋ช…๋ น์ด ๋ชจ๋‘ ์„ฑ๊ณตํ–ˆ์„ ๋•Œ๋งŒ ์ƒˆ ํ‚ค๋ฅผ ์“ด๋‹ค
(์›์ž์  ์“ฐ๊ธฐ). ์˜› ํ‚ค๋ฅผ ๋‚จ๊ฒจ ๋‘๋ฉด ๋ช…๋ น์ด ์ค‘๊ฐ„์— ์‹คํŒจํ–ˆ์„ ๋•Œ(datasets ๋Š” ์ƒˆ ์ž…๋ ฅ์œผ๋กœ ๋‹ค์‹œ ์“ฐ๊ณ  ์˜› ํŒŒ์ผ์„ ์ง€์› ๋Š”๋ฐ tags ๊ฐ€
์‹คํŒจ) ์ž…๋ ฅ์ด ์˜› ๊ฐ’์œผ๋กœ ๋Œ์•„์˜ค๋Š” ์ˆœ๊ฐ„ `unchanged` ๋กœ ์˜คํŒํ•ด ์„ž์ธ ์‚ฌ์ด๋“œ์นด๊ฐ€ ์˜์˜ ๋‚จ๋Š”๋‹ค(๋ฆฌ๋ทฐ ์ง€์  1). ์ค‘๊ฐ„์˜
KeyboardInterrupt ๋„ ๊ฐ™์€ ๊ธธ๋กœ ๋ง‰ํžŒ๋‹ค.
**๋‚จ์€ ์˜› ์ถœ๋ ฅ ์น˜์šฐ๊ธฐ(๋ฆฌ๋ทฐ ์ง€์  2).** ๊ฑด๋„ˆ๋›ด ๋ช…๋ น์ด ์˜ˆ์ „์— ์“ด ๋””๋ ‰ํ† ๋ฆฌ๋Š” hub ๊ฐ€ ๊ทธ๋Œ€๋กœ ์ฝ๋Š”๋‹ค(`ES/src/hub/stages/tagsets.ts`
`loadPolicies` โ€” ์—†๋Š” ๋””๋ ‰ํ† ๋ฆฌ๋Š” ๋นˆ ๋ชฉ๋ก์ด๋‹ค). ๊ทธ๋ž˜์„œ lock ์ด ์—†์œผ๋ฉด `datasets/`ยท`tagsets/`ยท`policies/`(์™€ ํ‚ค ํŒŒ์ผ)๋ฅผ, ํ…œํ”Œ๋ฆฟ๋งŒ
์—†์œผ๋ฉด `tagsets/`ยท`policies/` ๋ฅผ ์ƒ‰์ธ ๋ฃจํŠธ์˜ ๊ทธ case ์•„๋ž˜์—์„œ ์ง€์šด๋‹ค โ€” lockยทํ…œํ”Œ๋ฆฟ์—์„œ๋งŒ ๋‚˜์˜ค๋Š” ํŒŒ์ƒ๋ฌผ์ด๋‹ค. ๋ฒˆ๋“ค ์ƒ‰์ธ
(`bundles/`)์€ ๊ฑด๋“œ๋ฆฌ์ง€ ์•Š๋Š”๋‹ค. ์ง€์šด ์ด๋ฆ„์€ `IndexOutcome.removed` ์™€ stderr ํ•œ ์ค„๋กœ ์•Œ๋ฆฐ๋‹ค. ๋ ˆ์ด์•„์›ƒยทlock ์„ ๋ชป ์ฝ์–ด ์„ธ ๋ช…๋ น์„
๋ชจ๋‘ ๋ถ€๋ฅด๋Š” ๊ฒฝ์šฐ์—๋Š” ์ง€์šฐ์ง€ ์•Š๋Š”๋‹ค(์—†๋‹ค๊ณ  ํ™•์ •ํ•˜์ง€ ๋ชปํ–ˆ๋‹ค).
**ํ˜ธ์ถœ.** `poc_bundle.index.cli.index_group.main([...], prog_name="poc-bundle index", standalone_mode=False)` โ€” ์•„์นด์ด๋ธŒ ๋ฃจํŠธ
(`--projects-dir target.projects_dir`)ยท์ƒ‰์ธ ๋ฃจํŠธ(`--index-root hub_index_root()`)ยทํ…์ŠคํŠธ ๋ชจ๋“œ(`--text`)๋ฅผ **๋ช…์‹œ**ํ•œ๋‹ค. stdoutยท
stderr ๋Š” ๋ฒ„ํผ์— ๋ฐ›๋Š”๋‹ค(๊ฒฝ๋กœยท๊ฑด์ˆ˜๋ฟ์ด๋ผ ํ›… ์ฝ˜์†”์€ ๋‹ค๋ฆฌ๋งˆ๋‹ค ํ•œ ์ค„์ด๋‹ค). ๋‹ค๋งŒ stderr ์˜ **`warning:` ์ค„์€ ๋ฒ„๋ฆฌ์ง€ ์•Š๋Š”๋‹ค**(๋ฆฌ๋ทฐ
์ง€์  4) โ€” `index datasets` ์˜ "๊ฐ™์€ dataset_version ์„ ๋‚˜๋ˆ  ๊ฐ€์ง„ lock ํ•ญ๋ชฉ"(hub ๋Š” ๊ทธ์ค‘ ํ•˜๋‚˜๋งŒ ์‹ฃ๋Š”๋‹ค)ยท`index policy` ์˜ "๊ด€์ธก 0 ์ธ
์„ ์–ธ ํƒœ๊ทธ" ๊ฐ™์€ ์ •ํ•ฉ์„ฑ ๊ฒฝ๊ณ ๋‹ค. ๋ช…๋ น ์ด๋ฆ„์„ ๋ถ™์—ฌ stderr ์— ๋‹ค์‹œ ๋‚ด๊ณ  `IndexOutcome.warnings` ์— ์‹ฃ๋Š”๋‹ค(๋ฒˆ๋“ค ๋‹ค๋ฆฌ๋Š” detail ์—
๊ฑด์ˆ˜๋งŒ ๋‘”๋‹ค โ€” ์ƒํƒœ ํŒŒ์ผ์€ ์ฝ”๋“œยท๊ฑด์ˆ˜๋งŒ). ์‹คํŒจ๋Š” `failed:index_<๋ช…๋ น>:<์ข…๋ฃŒ ์ฝ”๋“œ>` ์ด๊ณ  ์‚ฌ๋žŒ์šฉ ์ด์œ ๋Š” click ์˜ค๋ฅ˜ ๋ฌธ๊ตฌ(๊ฒฝ๋กœยท์ฝ”๋“œ๋งŒ
โ€” `index/cli.py` ๋ชจ๋“ˆ ์„ค๋ช… "ํ–‰ ๋ณธ๋ฌธ์€ ์‹ฃ์ง€ ์•Š๋Š”๋‹ค")์˜ ๋งˆ์ง€๋ง‰ ์ค„์ด๋‹ค.
๋Œ๋ ค์ฃผ๋Š” ๊ฐ’: `unchanged` ยท `written` ยท `written:datasets_only` ยท `skipped:no_lock` ยท `failed:index_<๋ช…๋ น>:<exit>`.
`poc_bundle` ์€ ํ•จ์ˆ˜ ์•ˆ์—์„œ๋งŒ import ํ•œ๋‹ค(D-L6-14).
"""
from __future__ import annotations
import contextlib
import hashlib
import io
import json
import os
from collections.abc import Sequence
from dataclasses import dataclass
from pathlib import Path
from typing import Any
import click
from solar_eval.hub_hook import optin
from solar_eval.hub_hook.types import (
HOOK_DIRNAME,
INDEX_CMD_DATASETS,
INDEX_CMD_POLICY,
INDEX_CMD_TAGS,
INDEX_FAILED_PREFIX,
INDEX_KEY_FILENAME,
INDEX_UNCHANGED,
INDEX_WRITTEN,
INDEX_WRITTEN_DATASETS_ONLY,
NO_LOCK,
STATUS_FAILED,
STATUS_SKIPPED,
Target,
)
#: ์ƒ‰์ธ ๋ช…๋ น๊ณผ ๊ทธ ๋ช…๋ น์ด ์“ฐ๋Š” ์ƒ‰์ธ ๋ฃจํŠธ ์•„๋ž˜ ๋””๋ ‰ํ† ๋ฆฌ(`<index_root>/accounts/<a>/<c>/<dir>`).
CMD_DATASETS, CMD_TAGS, CMD_POLICY = INDEX_CMD_DATASETS, INDEX_CMD_TAGS, INDEX_CMD_POLICY
OUTPUT_DIRS = {CMD_DATASETS: "datasets", CMD_TAGS: "tagsets", CMD_POLICY: "policies"}
PROG_NAME = "poc-bundle index"
#: ํ‚ค ํŒŒ์ผ ์Šคํ‚ค๋งˆ โ€” ํ›… ๋‚ด๋ถ€ ๊ธฐ๋ก(์‚ฌ๋žŒยท๋‹ค๋ฅธ ๋„๊ตฌ๊ฐ€ ์ฝ์ง€ ์•Š๋Š”๋‹ค).
INDEX_KEY_SCHEMA = "solar-eval-hook-index-key/v1"
#: ์ƒ‰์ธ CLI stderr ์—์„œ ์ •ํ•ฉ์„ฑ ๊ฒฝ๊ณ ๋กœ ๋ณด๋Š” ์ค„ ๋จธ๋ฆฌ(`poc_bundle/index/cli.py` ์˜ `warning: โ€ฆ`).
WARNING_PREFIX = "warning:"
@dataclass(frozen=True)
class IndexOutcome:
"""`refresh` ๊ฒฐ๊ณผ โ€” `code` ๋Š” ๋ชจ๋“ˆ ์„ค๋ช…์˜ ๋ฐ˜ํ™˜ ์–ดํœ˜, `reason` ์€ ์‹คํŒจ์ผ ๋•Œ๋งŒ ์‚ฌ๋žŒ์šฉ ํ•œ ์ค„.
`warnings` ๋Š” ์„ฑ๊ณตํ•œ ๋ช…๋ น์˜ stderr `warning:` ์ค„(`index <๋ช…๋ น>: ` ์ ‘๋‘), `removed` ๋Š” ์ด๋ฒˆ์— ์น˜์šด ์˜› ์ถœ๋ ฅ ๋””๋ ‰ํ† ๋ฆฌ ์ด๋ฆ„.
"""
code: str
reason: str | None = None
warnings: tuple[str, ...] = ()
removed: tuple[str, ...] = ()
@property
def failed(self) -> bool:
return self.code.startswith(f"{STATUS_FAILED}:")
@dataclass(frozen=True)
class IndexCall:
"""์ƒ‰์ธ ๋ช…๋ น ํ•œ ๋ฒˆ์˜ ๊ฒฐ๊ณผ โ€” ์ข…๋ฃŒ ์ฝ”๋“œ, ์‹คํŒจ๋ฉด click ๋ฌธ๊ตฌ ๋งˆ์ง€๋ง‰ ์ค„, stderr ์˜ `warning:` ์ค„."""
exit_code: int
reason: str | None = None
warnings: tuple[str, ...] = ()
@dataclass(frozen=True)
class _Plan:
commands: tuple[str, ...]
key: str | None
parts: dict[str, Any] | None
def refresh_case_indexes(target: Target) -> str:
"""case ํ•˜๋‚˜์˜ ์ƒ‰์ธ์„ ํ‚ค๊ฐ€ ๋ฐ”๋€Œ์—ˆ์„ ๋•Œ๋งŒ ๋‹ค์‹œ ๋งŒ๋“ ๋‹ค(D-L6-7). ๋ฐ˜ํ™˜ ์–ดํœ˜๋Š” ๋ชจ๋“ˆ ์„ค๋ช…."""
return refresh(target).code
def refresh(target: Target) -> IndexOutcome:
"""`refresh_case_indexes` ์™€ ๊ฐ™๊ณ  ์‹คํŒจ ์ด์œ (์‚ฌ๋žŒ์šฉ ํ•œ ์ค„)๋ฅผ ํ•จ๊ป˜ ๋Œ๋ ค์ค€๋‹ค."""
plan = _plan(target)
root = _index_root()
removed = _remove_stale_outputs(target, plan, root)
if not plan.commands:
# lock ์ด ์—†๋‹ค โ€” ํ‚ค๋„ ์ด์ œ ๊ฐ€๋ฆฌํ‚ฌ ์ƒ‰์ธ์ด ์—†๋‹ค(lock ์ด ๋Œ์•„์˜ค๋ฉด ๋””๋ ‰ํ† ๋ฆฌ๊ฐ€ ์—†์–ด ๋‹ค์‹œ ๋งŒ๋“ ๋‹ค)
key_path(target).unlink(missing_ok=True)
return _announce(target, IndexOutcome(f"{STATUS_SKIPPED}:{NO_LOCK}", removed=removed))
if plan.key is not None and _unchanged(target, plan, root):
return _announce(target, IndexOutcome(INDEX_UNCHANGED, removed=removed))
# ์˜› ํ‚ค๋ฅผ ๋จผ์ € ์ง€์šด๋‹ค โ€” ๋ช…๋ น์ด ์ค‘๊ฐ„์— ์‹คํŒจํ•˜๋ฉด ์‚ฌ์ด๋“œ์นด๊ฐ€ ์„ž์ธ ์ฑ„ ์˜› ํ‚ค๊ฐ€ ๋‚จ์•„ `unchanged` ๋กœ ์˜คํŒํ•œ๋‹ค(๋ฆฌ๋ทฐ ์ง€์  1)
key_path(target).unlink(missing_ok=True)
from poc_bundle.index.case import index_lock_derived
warnings: list[str] = []
for command, call in index_lock_derived(
target.case_ref,
root,
repo_root=target.repo_root,
commands=plan.commands,
text_mode=optin.text_mode(),
projects_dir=target.projects_dir,
invoke=invoke_index,
):
warnings += [f"index {command}: {line}" for line in call.warnings]
if call.exit_code != 0:
code = f"{STATUS_FAILED}:{INDEX_FAILED_PREFIX}{command}:{call.exit_code}"
return _announce(target, IndexOutcome(code, call.reason, tuple(warnings), removed))
if plan.key is not None and plan.parts is not None:
_write_key(target, plan.key, plan.parts)
code = INDEX_WRITTEN if CMD_POLICY in plan.commands else INDEX_WRITTEN_DATASETS_ONLY
return _announce(target, IndexOutcome(code, warnings=tuple(warnings), removed=removed))
def _announce(target: Target, outcome: IndexOutcome) -> IndexOutcome:
"""์น˜์šด ๋””๋ ‰ํ† ๋ฆฌยท์ƒ‰์ธ ๊ฒฝ๊ณ ๋ฅผ stderr ์— ํ•œ ์ค„์”ฉ(๊ฒฝ๋กœยทํƒœ๊ทธ ์ด๋ฆ„ยท๊ฑด์ˆ˜๋ฟ โ€” ํ–‰ ๋ณธ๋ฌธ์€ CLI ๊ฐ€ ์‹ฃ์ง€ ์•Š๋Š”๋‹ค)."""
if outcome.removed:
names = "ยท".join(f"{name}/" for name in outcome.removed)
click.secho(
f" ์ƒ‰์ธ({target.case_ref}): lockยท์ •์ฑ… ํ…œํ”Œ๋ฆฟ์ด ์—†์–ด ์˜› {names} ๋ฅผ ์น˜์› ๋‹ค",
fg="yellow",
err=True,
)
for line in outcome.warnings:
click.secho(f" ์ƒ‰์ธ ๊ฒฝ๊ณ ({target.case_ref}) โ€” {line}", fg="yellow", err=True)
return outcome
def _remove_stale_outputs(target: Target, plan: _Plan, root: Path) -> tuple[str, ...]:
"""๊ฑด๋„ˆ๋›ด ๋ช…๋ น์ด ์˜ˆ์ „์— ์“ด ์ถœ๋ ฅ ๋””๋ ‰ํ† ๋ฆฌ๋ฅผ ์ง€์šด๋‹ค(๋ฆฌ๋ทฐ ์ง€์  2). ์ง€์šด ๋””๋ ‰ํ† ๋ฆฌ ์ด๋ฆ„์„ ๋Œ๋ ค์ค€๋‹ค.
lockยทํ…œํ”Œ๋ฆฟ์ด ์—†๋‹ค๊ณ  **ํ™•์ •**ํ–ˆ์„ ๋•Œ๋งŒ(`plan.key` ๊ฐ€ ์žˆ๊ฑฐ๋‚˜ ๋ช…๋ น์ด 0) โ€” ๋ชป ์ฝ์–ด ์„ธ ๋ช…๋ น์„ ๋ชจ๋‘ ๋ถ€๋ฅด๋Š” ๊ฒฝ์šฐ๋Š” ์น˜์šธ ๊ฒƒ์ด ์—†๋‹ค.
์‹ฌ๋ณผ๋ฆญ ๋งํฌ๋Š” ๋งํฌ๋งŒ ์ง€์šด๋‹ค(๊ฐ€๋ฆฌํ‚ค๋Š” ๊ณณ์€ ๊ฑด๋“œ๋ฆฌ์ง€ ์•Š๋Š”๋‹ค).
"""
from poc_bundle.index.case import prune_skipped_lock_indexes
return prune_skipped_lock_indexes(root, target.account, target.case, plan.commands)
# โ”€โ”€ ์„ ํ–‰ ํŒ์ •ยทํ‚ค โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
def _plan(target: Target) -> _Plan:
"""๋Œ ๋ช…๋ น๊ณผ ํ‚ค. lock ์ด ์—†์œผ๋ฉด ๋ช…๋ น 0. ๋ ˆ์ด์•„์›ƒยทlock ์„ ๋ชป ์ฝ์œผ๋ฉด ํ‚ค ์—†์ด ์„ธ ๋ช…๋ น(CLI ๊ฐ€ ์‹คํŒจ๋ฅผ ๋ณด๊ณ )."""
from poc_bundle.data.data_root import build_case_layout, load_existing_lock
from poc_bundle.data.errors import DataError
try:
layout = build_case_layout(
target.repo_root, target.case_ref, projects_dir=target.projects_dir
)
found = load_existing_lock(layout)
except (DataError, OSError):
return _Plan((CMD_DATASETS, CMD_TAGS, CMD_POLICY), None, None)
if found is None:
return _Plan((), None, None)
template = _template_bytes(target)
commands = (CMD_DATASETS,) if template is None else (CMD_DATASETS, CMD_TAGS, CMD_POLICY)
parts = _key_parts(found[1], template)
return _Plan(commands, _key_of(parts), parts)
def _template_bytes(target: Target) -> bytes | None:
"""์ •์ฑ… ํ…œํ”Œ๋ฆฟ(`index policy` ๊ธฐ๋ณธ ์œ„์น˜) ๋ฐ”์ดํŠธ. ์—†์œผ๋ฉด None. ์žˆ๋Š”๋ฐ ๋ชป ์ฝ์œผ๋ฉด `OSError` ๋ฅผ ์˜ฌ๋ฆฐ๋‹ค(๋ฒˆ๋“ค ๋‹ค๋ฆฌ๊ฐ€ ๋ณด๊ณ )."""
from poc_bundle.index.cli import TEMPLATE_DEFAULT
path = target.repo_root / "accounts" / target.account / target.case / TEMPLATE_DEFAULT
if not path.exists() and not path.is_symlink():
return None
return path.read_bytes()
def _key_parts(lock_bytes: bytes, template: bytes | None) -> dict[str, Any]:
from poc_bundle.index.row_tags import EXTRACTOR
return {
"lock_sha": _sha256(lock_bytes),
"template_sha": None if template is None else _sha256(template),
"text_mode": optin.text_mode(),
"extractor": EXTRACTOR,
"index_code_sha": index_code_sha(),
}
def _key_of(parts: dict[str, Any]) -> str:
from poc_bundle.canonical import jcs_bytes
ordered = [
parts["lock_sha"],
parts["template_sha"],
parts["text_mode"],
parts["extractor"],
parts["index_code_sha"],
]
return _sha256(jcs_bytes(ordered))
def index_code_sha(package_root: Path | None = None) -> str:
"""`poc_bundle` ํŒจํ‚ค์ง€ ์ „์ฒด `*.py` ์˜ (์ƒ๋Œ€ ๊ฒฝ๋กœ, ๊ธธ์ด, ๋ฐ”์ดํŠธ)๋ฅผ ๊ฒฝ๋กœ์ˆœ์œผ๋กœ ์ด์€ sha256(๊ฒ€ํ†  F9 ยท ๋ฆฌ๋ทฐ ์ง€์  3).
์ƒ‰์ธ ์ถœ๋ ฅ์€ `index/` ๋ฐ– PB ๋ชจ๋“ˆ(`keys.dataset_version` ๋“ฑ)์—๋„ ๋‹ฌ๋ ค ์žˆ๋‹ค โ€” ๊ทธ๋ž˜์„œ `index/` ๋งŒ์ด ์•„๋‹ˆ๋ผ ํŒจํ‚ค์ง€ ์ „์ฒด๋ฅผ ๋ณธ๋‹ค.
`package_root` ๋Š” ์‹œํ—˜์šฉ(๊ธฐ๋ณธ์€ ์„ค์น˜๋œ `poc_bundle` ํŒจํ‚ค์ง€ ๋””๋ ‰ํ† ๋ฆฌ). ๊ฒฝ๋กœ๋ฅผ ์„ž์–ด ์ด๋ฆ„ ๋ฐ”๊พธ๊ธฐยท์˜ฎ๊ธฐ๊ธฐ๋„ ์žก๋Š”๋‹ค.
"""
if package_root is None:
import poc_bundle
package_root = Path(poc_bundle.__file__).parent
digest = hashlib.sha256()
sources = sorted(
(p.relative_to(package_root).as_posix(), p) for p in package_root.rglob("*.py")
)
for rel, path in sources:
data = path.read_bytes()
digest.update(f"{rel}\0{len(data)}\0".encode())
digest.update(data)
return digest.hexdigest()
def _sha256(data: bytes) -> str:
return hashlib.sha256(data).hexdigest()
def key_path(target: Target) -> Path:
"""`<hub_reports_dir>/<a>/<c>/hook/index-key.json`."""
from poc_bundle.home import hub_reports_dir
return hub_reports_dir() / target.account / target.case / HOOK_DIRNAME / INDEX_KEY_FILENAME
def _stored_key(target: Target) -> str | None:
"""์ €์žฅ๋œ ํ‚ค. ์—†๊ฑฐ๋‚˜ ๊นจ์กŒ์œผ๋ฉด None โ€” ๋‹ค์‹œ ๋งŒ๋“ ๋‹ค(ํ‚ค ํŒŒ์ผ์€ ์บ์‹œ์ผ ๋ฟ์ด๋‹ค)."""
try:
doc = json.loads(key_path(target).read_text("utf-8"))
except (OSError, ValueError):
return None
key = doc.get("key") if isinstance(doc, dict) else None
return key if isinstance(key, str) else None
def _write_key(target: Target, key: str, parts: dict[str, Any]) -> None:
"""์ž„์‹œ ํŒŒ์ผ โ†’ `os.replace`(์›์ž์ ). ์‹คํŒจ๋Š” ํ˜ธ์ถœ์ž์—๊ฒŒ ์˜ฌ๋ฆฐ๋‹ค โ€” ์กฐ์šฉํžˆ ์‚ผํ‚ค๋ฉด ๋งค๋ฒˆ ๋‹ค์‹œ ๋งŒ๋“ ๋‹ค๋Š” ์‚ฌ์‹ค์ด ์ˆจ๋Š”๋‹ค."""
path = key_path(target)
path.parent.mkdir(parents=True, exist_ok=True)
doc = {"schema": INDEX_KEY_SCHEMA, "key": key, "parts": parts}
tmp = path.with_name(f".{path.name}.{os.getpid()}.tmp")
tmp.write_text(json.dumps(doc, ensure_ascii=False, sort_keys=True) + "\n", "utf-8")
os.replace(tmp, path)
def _index_root() -> Path:
from poc_bundle.home import hub_index_root
return hub_index_root()
def _unchanged(target: Target, plan: _Plan, root: Path) -> bool:
if _stored_key(target) != plan.key:
return False
case_dir = root / "accounts" / target.account / target.case
return all((case_dir / OUTPUT_DIRS[c]).is_dir() for c in plan.commands)
# โ”€โ”€ click ํ˜ธ์ถœ โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€
def command_args(target: Target, command: str, root: Path) -> list[str]:
"""์ƒ‰์ธ ๋ช…๋ น ํ•˜๋‚˜์˜ ์ธ์ž โ€” ๋ฃจํŠธ๋Š” ๋ชจ๋‘ ๋ช…์‹œํ•œ๋‹ค(CLI ๊ธฐ๋ณธ๊ฐ’์„ ๊ฑฐ์น˜์ง€ ์•Š๋Š”๋‹ค)."""
from poc_bundle.index.case import lock_index_args
return lock_index_args(
command,
target.case_ref,
root,
text_mode=optin.text_mode(),
projects_dir=target.projects_dir,
)
def invoke_index(args: Sequence[str]) -> IndexCall:
"""`poc-bundle index <args>` ๋ฅผ `standalone_mode=False` ๋กœ โ€” ์ข…๋ฃŒ ์ฝ”๋“œ, ์‹คํŒจ๋ฉด click ๋ฌธ๊ตฌ ๋งˆ์ง€๋ง‰ ์ค„, stderr ๊ฒฝ๊ณ  ์ค„."""
from poc_bundle.index.cli import index_group
sink_out, sink_err = io.StringIO(), io.StringIO()
try:
with contextlib.redirect_stdout(sink_out), contextlib.redirect_stderr(sink_err):
rv = index_group.main(list(args), prog_name=PROG_NAME, standalone_mode=False)
except click.ClickException as exc:
return _call(exc.exit_code, sink_err, _last_line(exc.format_message()))
except click.exceptions.Exit as exc:
return _call(exc.exit_code, sink_err)
except click.Abort:
return _call(1, sink_err, "aborted")
except SystemExit as exc:
return _call(exc.code if isinstance(exc.code, int) else 1, sink_err)
return _call(rv if isinstance(rv, int) and not isinstance(rv, bool) else 0, sink_err)
def _call(exit_code: int, sink_err: io.StringIO, reason: str | None = None) -> IndexCall:
"""๋ฒ„ํผ์—์„œ ๊ฒฝ๊ณ  ์ค„์„ ๋ฝ‘์•„ ๊ฒฐ๊ณผ๋ฅผ ๋งŒ๋“ ๋‹ค. ์‹คํŒจ์ธ๋ฐ ์ด์œ ๊ฐ€ ์—†์œผ๋ฉด stderr ๋งˆ์ง€๋ง‰ ์ค„์„ ์ด์œ ๋กœ."""
text = sink_err.getvalue()
if exit_code != 0 and reason is None:
reason = _last_line(text)
return IndexCall(exit_code, None if exit_code == 0 else reason, warning_lines(text))
def warning_lines(text: str) -> tuple[str, ...]:
"""stderr ๋ฒ„ํผ์—์„œ `warning:` ๋กœ ์‹œ์ž‘ํ•˜๋Š” ์ค„(์•ž๋’ค ๊ณต๋ฐฑ ์ œ๊ฑฐ)๋งŒ."""
return tuple(
line.strip() for line in text.splitlines() if line.strip().startswith(WARNING_PREFIX)
)
def _last_line(text: str) -> str | None:
lines = [line.strip() for line in text.splitlines() if line.strip()]
return lines[-1] if lines else None