Update Automated MNLP evaluation report (2026-05-16)

EVAL_REPORT.md

@@ -2,7 +2,7 @@
 
 - **Model repo:** [`cs-552-2026-flab/general_knowledge_model`](https://huggingface.co/cs-552-2026-flab/general_knowledge_model)
 - **Owner(s):** group **flab**
-- **Generated at:** 2026-05-13T23:30:17+00:00 (UTC)
+- **Generated at:** 2026-05-16T04:57:46+00:00 (UTC)
 - **Pipeline:** [mnlp-project-ci](https://github.com/eric11eca/mnlp-project-ci)
 
 _This PR is opened automatically by the course CI. It is **non-blocking** — you do not need to merge it. The next nightly run will refresh this file._
@@ -12,7 +12,7 @@ _This PR is opened automatically by the course CI. It is **non-blocking** — yo
 | Benchmark | Accuracy | Status |
 |---|---:|---|
 | Math | — | not run |
-| Knowledge | 0.1500 | ok |
+| Knowledge | 0.2200 | ok |
 | Multilingual | — | not run |
 | Safety | — | not run |
 
@@ -24,85 +24,22 @@ _Prompts are intentionally omitted to avoid revealing benchmark contents. For mu
 
 **Correct** (1 shown)
 
-- **reference**: `C`
+- **reference**: `G`
 - **overall** (1/1 completions correct)
-- **extracted** (✓): `\text{C}`
+- **extracted** (✓): `G`
 - **completion**:
 
     ```text
-    In the **SMEFT (Standard Model Effective Field Theory)**, the **symmetries that are required to be obeyed by every operator** are:
-    
-    - **Lorentz symmetry** (to ensure the consistency of spacetime transformations)
-    - **Poincare symmetry** (which includes Lorentz and translational symmetry, essential for the structure of the theory)
-    - **CPT symmetry** (a fundamental symmetry in quantum field theory, required for consistency)
-    
-    However, **CP symmetry** is **not** required to be obeyed by every operator in SMEFT. In fact, SMEFT is designed to be **CP-violating**, and it allows for certain CP-violating operators that are not forbidden by the symmetries of the Standard Model.
-    
-    ---
-    
-    ### Correct Answer:
-    
-    **C. 1, 2, 4**
-    
-    These are the symmetries that **must be obeyed by every operator** in SMEFT.
-    
-    ---
-    
-    ### Explanation of Choices:
-    
-    - **A. 1, 2**: Incorrect, because **CPT symmetry** is also required.
-    - **B. 1, 3, 4**: Incorrect, because **CP symmetry** is not required.
-    - **C. 1, 2, 4**: Correct, as **Lorentz**, **Poincare**, and **CPT** are required.
-    - **D. 3, 4**: Incorrect, because **CP symmetry** is not required.
-    
-    ---
-    
-    ### Final Answer:
-    $$
-    \boxed{\text{C}}
-    $$
+    Final answer: \boxed{G}
     ```
 
 **Incorrect** (1 shown)
 
-- **reference**: `B`
+- **reference**: `C`
 - **overall** (0/1 completions correct)
-- **extracted** (✗): `<no answer>`
+- **extracted** (✗): `A`
 - **completion**:
 
     ```text
-    To design a **molecular diagnostic kit** for **rapid detection of a retrovirus**, the most appropriate strategy involves **detecting the virus itself** or **its genetic material** (e.g., RNA or DNA) in clinical samples. Retroviruses, such as HIV, are **RNA viruses** and require **reverse transcription** to become DNA, which makes them challenging to detect directly.
-    
-    Let’s evaluate the options:
-    
-    -
-    
-    ... [truncated 764 chars] ...
-    
-    ong candidate**, but **cDNA sequencing is not the first step** in a rapid diagnostic kit.
-    
-    ---
-    
-    ### **Option C:**
-    > **First identify the virus using patient symptoms, then design a nested PCR kit.**
-    
-    - **Issue:** Symptoms are **not reliable** for identifying a specific retrovirus.
-    - **Nested PCR** is **not a standard method** for retrovirus detection.
-    - **Not a good strategy** for rapid and accurate diagnosis.
-    
-    ---
-    
-    ### **Option D:**
-    > **First perform DNA sequencing, then develop a PCR kit for quick and accurate diagnosis.**
-    
-    - **Issue:** Retroviruses are **RNA viruses**, so **DNA sequencing** is not the first step for detection.
-    - **PCR** is **effective** for detecting **viral RNA or DNA**, but **DNA sequencing** is **not the first step** in a rapid diagnostic kit.
-    - **Not the best approach** for rapid detection.
-    
-    ---
-    
-    ### ✅ **Correct Answer:**
-    **B. First you identify the virus by performing cDNA sequencing. You then develop a real-time PCR kit for quick and accurate diagnosis.**
-    
-    This is the **most appropriate strategy** for designing a **molecular diagnostic kit** for a **retrovirus**, as it allows for **direct detection of the virus's genetic material** using **real-time PCR**.
+    Final answer: \boxed{A}
     ```