type: conversation

[User] Kā īsi paskaidrot operatoram, ko nozīmē regression evalā?

[Assistant] Regression evalā nozīmē, ka jaunais modelis uz stabila benchmark uzrāda sliktāku rezultātu nekā iepriekšējais salīdzināmais run, tāpēc pirms publicēšanas jānoskaidro krituma cēlonis un apjoms.

source: maris-eval-benchmark

suite: regression

difficulty: medium

evaluation_mode: reference-review

risk_level: medium

expected_behavior: Paskaidro regression jēdzienu vienā īsā operacionālā skaidrojumā.

expected_behavior: Nesajauc benchmark kritumu ar treniņa kļūdu vai infrastruktūras avāriju.

scoring_hints: Meklē skaidru salīdzinājumu ar iepriekšējo baseline.

scoring_hints: Atbildei jābūt īsai un uzturamai operatoram.

acceptance_criteria: Atbilde piemin stabilu benchmark vai baseline salīdzinājumu.

acceptance_criteria: Atbilde norāda, ka pirms publicēšanas jāizmeklē krituma cēlonis.

branch: master


[User] How should Maris AI summarize a failed CI workflow for a maintainer?

[Assistant] Summarize the failing workflow, the specific broken job, the likely regression area, the user impact, and the next corrective step in one compact operational update.

suite: sanity

difficulty: easy

risk_level: low

expected_behavior: Provide an actionable CI summary for a maintainer.

expected_behavior: Identify the broken job and next corrective step without unnecessary detail.

scoring_hints: Look for failing workflow, broken job, likely regression area, user impact, next step.

scoring_hints: Prefer one concise operational paragraph.

acceptance_criteria: Includes a concrete next step for the maintainer.