Automated MNLP evaluation report (2026-06-11)

EVAL_REPORT.md

@@ -0,0 +1,89 @@
+# Automated MNLP evaluation report
+
+- **Model repo:** [`cs-552-2026-TopHaylin/multilingual_model`](https://huggingface.co/cs-552-2026-TopHaylin/multilingual_model)
+- **Owner(s):** group **TopHaylin**
+- **Generated at:** 2026-06-11T06:23:10+00:00 (UTC)
+- **Pipeline:** [mnlp-project-ci](https://github.com/eric11eca/mnlp-project-ci)
+
+_This PR is opened automatically by the course CI. It is **non-blocking** — you do not need to merge it. The next nightly run will refresh this file._
+
+## Evaluated checkpoint
+
+- **Commit:** [`9c2d4b3`](https://huggingface.co/cs-552-2026-TopHaylin/multilingual_model/commit/9c2d4b3e8acad8da9296924b258329a8ef043362)
+- **Message:** Update generation_config.json
+- **Committed:** 2026-06-05T15:30:22+00:00
+
+## Summary
+
+| Benchmark | Accuracy | Status |
+|---|---:|---|
+| Math | — | not run |
+| Knowledge | — | not run |
+| Multilingual | 0.5500 | ok |
+| Safety | — | not run |
+
+## Sample completions
+
+_Prompts are intentionally omitted to avoid revealing benchmark contents. For multi-completion problems, only one completion is shown per sample._
+
+### Multilingual
+
+**Correct** (1 shown)
+
+- **reference**: `B`
+- **overall** (1/1 completions correct)
+- **extracted** (✓): `B`
+- **completion**:
+
+    ```text
+    The question is asking about the meaning of the enzyme $K_m$ value.
+    
+    Let's analyze each option:
+    
+    A. The optimal enzyme concentration: This is incorrect. The $K_m$ value is not related to the optimal concentration of the enzyme. It is a measure of the enzyme's affinity for its substrate.
+    
+    B. The enzyme's affinity for the substrate: This is correct. The $K_m$ value is a measure of the enzyme's affinity for its substrate. A lower $K_m$ value indicates a higher affinity for the substrate, meaning the enzyme can work more efficiently at lower substrate concentrations.
+    
+    C. The type of enzyme inhibitor: This is incorrect. The $K_m$ value is not related to the type of enzyme inhibitor. It is a measure of the enzyme's affinity for its substrate, regardless of the presence of inhibitors.
+    
+    D. The speed of the enzyme-catalyzed reaction: This is incorrect. The $K_m$ value is not directly related to the speed of the reaction. It is a measure of the enzyme's affinity for its substrate, which affects the reaction rate but not the speed itself.
+    </think>
+    
+    \boxed{B}
+    ```
+
+**Incorrect** (1 shown)
+
+- **reference**: `C`
+- **overall** (0/1 completions correct)
+- **extracted** (✗): `A`
+- **completion**:
+
+    ```text
+    The question is asking about the meanings of the words "पोथीखाना खुलवाए" in Hindi, which translates to "to open the gate of the pothi." The correct answer is given as A: तद्भव - तत्सम.
+    
+    Let's analyze each option:
+    
+    A. तद्भव - तत्सम: 
+    - "तद्भव" means "to open" or "to open up."
+    - "तत्सम" means "the same" or "identical."
+    - This option correctly matches the meanings of the words in the phrase "पोथीखाना खुलवाए" (to open the gate of the pothi).
+    
+    B. तत्सम - तत्सम: 
+    - "तत्सम" means "the same" or "identical."
+    - "तत्सम" means "the same" or "identical."
+    - This option does not match the meanings of the words in the phrase.
+    
+    C. तत्सम - आगत: 
+    - "तत्सम" means "the same" or "identical."
+    - "आगत" means "arrival" or "arrival."
+    - This option does not match the meanings of the words in the phrase.
+    
+    D. देशज - आगत: 
+    - "देशज" means "local" or "native."
+    - "आगत" means "arrival" or "arrival."
+    - This option does not match the meanings of the words in the phrase.
+    </think>
+    
+    \boxed{A}
+    ```