--- language: - en - vi - id - th - zh license: apache-2.0 base_model: - Qwen/Qwen3-8B-Base base_model_relation: finetune library_name: transformers pipeline_tag: text-generation --- # Agnes-SeaLLM-8B ### Introduction We introduce Agnes-SeaLLM-8B, a compact Large Language Model (LLM) meticulously optimized for Southeast Asian languages. Despite its efficient footprint, it delivers performance rivaling much larger open-source models, excelling in tasks such as mathematical reasoning, translation, and instruction following. Furthermore, it has been specially tuned to enhance reliability, minimize hallucinations, and provide culturally sensitive, safe responses tailored to the Southeast Asian context.  # π₯ Highlights Compact Efficiency & Rapid Deployment: Significantly smaller than mainstream LLMs, Agnes-SeaLLM-8B enables high-speed inference and low-resource deployment without sacrificing accuracy or multilingual proficiency. It is the ideal choice for edge devices and resource-constrained environments. Top-Tier Performance in its Class: Outperforms comparable open-source models across multi-dimensional benchmarks, including academic examinations, complex instruction following, mathematics, and high-precision translation. Superior Instruction Following: Demonstrates exceptional capability in handling multi-turn dialogues and executing complex, nuanced tasks with high fidelity. Safe, Reliable, and Culturally Aware: Engineered to reduce hallucinations and increase sensitivity to Southeast Asian cultural nuances. This ensures safer interactions while maintaining peak performance in English and Chinese. Balanced Multilingual Mastery: Maintains high-quality, consistent output across a broad linguistic spectrum, overcoming the "seesaw effect" often found in regional models. ### γSeaExam Summary statisticsγ
| Model | avg | M3Exam | MMLU |
|---|---|---|---|
| 75.32 | 77.47 | 74.13 | |
| Llama-sea-Lion-v2-8B-IT | 55.86 | 61.11 | 52.91 |
| Sailor2-20B | 67.50 | 74.15 | 63.77 |
| glm-4-9b-chat | 64.35 | 69.36 | 61.53 |
| Meta-Llama-3-70B | 63.67 | 64.25 | 63.55 |
| Model | avg | M3Exam zh |
M3Exam en |
M3Exam id |
M3Exam vi |
M3Exam th |
|---|---|---|---|---|---|---|
| 76.84 | 83.70 | 93.24 | 72.97 | 70.03 | 64.25 | |
| Llama-sea-Lion-v2-8B-IT | 59.95 | 52.95 | 78.41 | 54.37 | 54.00 | 60.00 |
| Sailor2-20B | 74.96 | 80.90 | 88.94 | 69.68 | 68.65 | 66.65 |
| glm-4-9b-chat | 71.62 | 85.71 | 89.78 | 63.16 | 66.02 | 53.43 |
| Meta-Llama-3-70B | 63.82 | 63.04 | 84.75 | 57.97 | 52.02 | 61.32 |
| Model | avg | MMLU zh |
MMLU en |
MMLU id |
MMLU vi |
MMLU th |
|---|---|---|---|---|---|---|
| 71.29 | 71.40 | 78.60 | 71.54 | 66.84 | 62.70 | |
| Llama-sea-Lion-v2-8B-IT | 55.86 | 49.58 | 61.65 | 54.42 | 47.72 | 51.19 |
| Sailor2-20B | 67.50 | 64.84 | 72.88 | 64.60 | 59.58 | 56.95 |
| glm-4-9b-chat | 63.35 | 64.84 | 72.42 | 60.04 | 60.04 | 50.32 |
| Meta-Llama-3-70B | 58.21 | 63.35 | 60.91 | 72.32 | 62.95 | 62.35 |
| Indonesian Standards | Agnes-SeaLLM-8B | Sailor2-20B | glm-4-9b-chat | Llama-sea-Lion-v2-8B | Meta-Llama-3-8B |
|---|---|---|---|---|---|
| Overall Average | 73.37 | 64.60 | 60.04 | 54.42 | 54.60 |
| abstract_algebra | 64.00 | 48.00 | 34.00 | 28.00 | 32.00 |
| anatomy | 70.00 | 62.00 | 46.00 | 46.00 | 50.00 |
| astronomy | 90.00 | 68.00 | 64.00 | 66.00 | 58.00 |
| business_ethics | 68.00 | 60.00 | 56.00 | 64.00 | 56.00 |
| clinical_knowledge | 84.00 | 66.00 | 68.00 | 64.00 | 66.00 |
| college_biology | 98.00 | 84.00 | 68.00 | 60.00 | 62.00 |
| college_chemistry | 70.00 | 38.00 | 50.00 | 40.00 | 42.00 |
| college_computer_science | 74.00 | 54.00 | 52.00 | 36.00 | 38.00 |
| college_mathematics | 60.00 | 38.00 | 42.00 | 32.00 | 38.00 |
| college_medicine | 86.00 | 66.00 | 74.00 | 68.00 | 64.00 |
| college_physics | 82.00 | 68.00 | 60.00 | 38.00 | 44.00 |
| computer_security | 80.00 | 86.00 | 64.00 | 50.00 | 56.00 |
| conceptual_physics | 84.00 | 68.00 | 72.00 | 44.00 | 46.00 |
| elementary_mathematics | 92.00 | 78.00 | 78.00 | 72.00 | 80.00 |
| high_school_biology | 90.00 | 84.00 | 80.00 | 70.00 | 74.00 |
| high_school_chemistry | 94.00 | 50.00 | 62.00 | 54.00 | 50.00 |
| high_school_mathematics | 86.00 | 44.00 | 64.00 | 44.00 | 54.00 |
| international_law | 68.00 | 80.00 | 84.00 | 78.00 | 74.00 |
| marketing | 90.00 | 82.00 | 70.00 | 78.00 | 68.00 |
| sociology | 80.00 | 68.00 | 66.00 | 70.00 | 64.00 |
| world_religions | 76.00 | 84.00 | 76.00 | 66.00 | 76.00 |
| language / subject | Correct | Total | Accuracy | Percentage |
|---|---|---|---|---|
| chinese | 2176 | 2850 | 76.35% | 12.81% |
| chinese β abstract_algebra | 36 | 50 | 72.00% | 0.22% |
| chinese β anatomy | 31 | 50 | 62.00% | 0.22% |
| chinese β astronomy | 42 | 50 | 84.00% | 0.22% |
| chinese β business_ethics | 36 | 50 | 72.00% | 0.22% |
| chinese β clinical_knowledge | 40 | 50 | 80.00% | 0.22% |
| chinese β college_biology | 46 | 50 | 92.00% | 0.22% |
| chinese β college_chemistry | 37 | 50 | 74.00% | 0.22% |
| chinese β college_computer_science | 40 | 50 | 80.00% | 0.22% |
| chinese β college_mathematics | 34 | 50 | 68.00% | 0.22% |
| chinese β college_medicine | 42 | 50 | 84.00% | 0.22% |
| chinese β college_physics | 46 | 50 | 92.00% | 0.22% |
| chinese β computer_security | 39 | 50 | 78.00% | 0.22% |
| chinese β conceptual_physics | 45 | 50 | 90.00% | 0.22% |
| chinese β econometrics | 34 | 50 | 68.00% | 0.22% |
| chinese β electrical_engineering | 36 | 50 | 72.00% | 0.22% |
| chinese β elementary_mathematics | 48 | 50 | 96.00% | 0.22% |
| chinese β formal_logic | 31 | 50 | 62.00% | 0.22% |
| chinese β global_facts | 26 | 50 | 52.00% | 0.22% |
| chinese β high_school_biology | 46 | 50 | 92.00% | 0.22% |
| chinese β high_school_chemistry | 41 | 50 | 82.00% | 0.22% |
| chinese β high_school_computer_science | 47 | 50 | 94.00% | 0.22% |
| chinese β high_school_european_history | 41 | 50 | 82.00% | 0.22% |
| chinese β high_school_geography | 42 | 50 | 84.00% | 0.22% |
| chinese β high_school_government_and_politics | 42 | 50 | 84.00% | 0.22% |
| chinese β high_school_macroeconomics | 43 | 50 | 86.00% | 0.22% |
| chinese β high_school_mathematics | 41 | 50 | 82.00% | 0.22% |
| chinese β high_school_microeconomics | 43 | 50 | 86.00% | 0.22% |
| chinese β high_school_physics | 40 | 50 | 80.00% | 0.22% |
| chinese β high_school_psychology | 47 | 50 | 94.00% | 0.22% |
| chinese β high_school_statistics | 40 | 50 | 80.00% | 0.22% |
| chinese β high_school_us_history | 36 | 50 | 72.00% | 0.22% |
| chinese β high_school_world_history | 42 | 50 | 84.00% | 0.22% |
| chinese β human_aging | 31 | 50 | 62.00% | 0.22% |
| chinese β human_sexuality | 41 | 50 | 82.00% | 0.22% |
| chinese β international_law | 34 | 50 | 68.00% | 0.22% |
| chinese β jurisprudence | 33 | 50 | 66.00% | 0.22% |
| chinese β logical_fallacies | 37 | 50 | 74.00% | 0.22% |
| chinese β machine_learning | 36 | 50 | 72.00% | 0.22% |
| chinese β management | 40 | 50 | 80.00% | 0.22% |
| chinese β marketing | 44 | 50 | 88.00% | 0.22% |
| chinese β medical_genetics | 41 | 50 | 82.00% | 0.22% |
| chinese β miscellaneous | 35 | 50 | 70.00% | 0.22% |
| chinese β moral_disputes | 34 | 50 | 68.00% | 0.22% |
| chinese β moral_scenarios | 34 | 50 | 68.00% | 0.22% |
| chinese β nutrition | 41 | 50 | 82.00% | 0.22% |
| chinese β philosophy | 25 | 50 | 50.00% | 0.22% |
| chinese β prehistory | 37 | 50 | 74.00% | 0.22% |
| chinese β professional_accounting | 32 | 50 | 64.00% | 0.22% |
| chinese β professional_law | 28 | 50 | 56.00% | 0.22% |
| chinese β professional_medicine | 39 | 50 | 78.00% | 0.22% |
| chinese β professional_psychology | 39 | 50 | 78.00% | 0.22% |
| chinese β public_relations | 34 | 50 | 68.00% | 0.22% |
| chinese β security_studies | 40 | 50 | 80.00% | 0.22% |
| chinese β sociology | 38 | 50 | 76.00% | 0.22% |
| chinese β us_foreign_policy | 43 | 50 | 86.00% | 0.22% |
| chinese β virology | 24 | 50 | 48.00% | 0.22% |
| chinese β world_religions | 36 | 50 | 72.00% | 0.22% |
| english | 2402 | 2850 | 84.28% | 12.81% |
| english β abstract_algebra | 38 | 50 | 76.00% | 0.22% |
| english β anatomy | 40 | 50 | 80.00% | 0.22% |
| english β astronomy | 43 | 50 | 86.00% | 0.22% |
| english β business_ethics | 39 | 50 | 78.00% | 0.22% |
| english β clinical_knowledge | 45 | 50 | 90.00% | 0.22% |
| english β college_biology | 49 | 50 | 98.00% | 0.22% |
| english β college_chemistry | 35 | 50 | 70.00% | 0.22% |
| english β college_computer_science | 43 | 50 | 86.00% | 0.22% |
| english β college_mathematics | 41 | 50 | 82.00% | 0.22% |
| english β college_medicine | 47 | 50 | 94.00% | 0.22% |
| english β college_physics | 43 | 50 | 86.00% | 0.22% |
| english β computer_security | 41 | 50 | 82.00% | 0.22% |
| english β conceptual_physics | 44 | 50 | 88.00% | 0.22% |
| english β econometrics | 44 | 50 | 88.00% | 0.22% |
| english β electrical_engineering | 39 | 50 | 78.00% | 0.22% |
| english β elementary_mathematics | 49 | 50 | 98.00% | 0.22% |
| english β formal_logic | 36 | 50 | 72.00% | 0.22% |
| english β global_facts | 26 | 50 | 52.00% | 0.22% |
| english β high_school_biology | 45 | 50 | 90.00% | 0.22% |
| english β high_school_chemistry | 47 | 50 | 94.00% | 0.22% |
| english β high_school_computer_science | 50 | 50 | 100.00% | 0.22% |
| english β high_school_european_history | 45 | 50 | 90.00% | 0.22% |
| english β high_school_geography | 45 | 50 | 90.00% | 0.22% |
| english β high_school_government_and_politics | 48 | 50 | 96.00% | 0.22% |
| english β high_school_macroeconomics | 42 | 50 | 84.00% | 0.22% |
| english β high_school_mathematics | 40 | 50 | 80.00% | 0.22% |
| english β high_school_microeconomics | 48 | 50 | 96.00% | 0.22% |
| english β high_school_physics | 46 | 50 | 92.00% | 0.22% |
| english β high_school_psychology | 46 | 50 | 92.00% | 0.22% |
| english β high_school_statistics | 41 | 50 | 82.00% | 0.22% |
| english β high_school_us_history | 45 | 50 | 90.00% | 0.22% |
| english β high_school_world_history | 43 | 50 | 86.00% | 0.22% |
| english β human_aging | 38 | 50 | 76.00% | 0.22% |
| english β human_sexuality | 45 | 50 | 90.00% | 0.22% |
| english β international_law | 40 | 50 | 80.00% | 0.22% |
| english β jurisprudence | 44 | 50 | 88.00% | 0.22% |
| english β logical_fallacies | 45 | 50 | 90.00% | 0.22% |
| english β machine_learning | 34 | 50 | 68.00% | 0.22% |
| english β management | 46 | 50 | 92.00% | 0.22% |
| english β marketing | 46 | 50 | 92.00% | 0.22% |
| english β medical_genetics | 46 | 50 | 92.00% | 0.22% |
| english β miscellaneous | 46 | 50 | 92.00% | 0.22% |
| english β moral_disputes | 43 | 50 | 86.00% | 0.22% |
| english β moral_scenarios | 40 | 50 | 80.00% | 0.22% |
| english β nutrition | 44 | 50 | 88.00% | 0.22% |
| english β philosophy | 40 | 50 | 80.00% | 0.22% |
| english β prehistory | 46 | 50 | 92.00% | 0.22% |
| english β professional_accounting | 37 | 50 | 74.00% | 0.22% |
| english β professional_law | 32 | 50 | 64.00% | 0.22% |
| english β professional_medicine | 43 | 50 | 86.00% | 0.22% |
| english β professional_psychology | 40 | 50 | 80.00% | 0.22% |
| english β public_relations | 34 | 50 | 68.00% | 0.22% |
| english β security_studies | 39 | 50 | 78.00% | 0.22% |
| english β sociology | 41 | 50 | 82.00% | 0.22% |
| english β us_foreign_policy | 44 | 50 | 88.00% | 0.22% |
| english β virology | 30 | 50 | 60.00% | 0.22% |
| english β world_religions | 46 | 50 | 92.00% | 0.22% |
| indonesian | 2091 | 2850 | 73.37% | 12.81% |
| indonesian β abstract_algebra | 32 | 50 | 64.00% | 0.22% |
| indonesian β anatomy | 35 | 50 | 70.00% | 0.22% |
| indonesian β astronomy | 45 | 50 | 90.00% | 0.22% |
| indonesian β business_ethics | 34 | 50 | 68.00% | 0.22% |
| indonesian β clinical_knowledge | 42 | 50 | 84.00% | 0.22% |
| indonesian β college_biology | 49 | 50 | 98.00% | 0.22% |
| indonesian β college_chemistry | 35 | 50 | 70.00% | 0.22% |
| indonesian β college_computer_science | 37 | 50 | 74.00% | 0.22% |
| indonesian β college_mathematics | 30 | 50 | 60.00% | 0.22% |
| indonesian β college_medicine | 43 | 50 | 86.00% | 0.22% |
| indonesian β college_physics | 41 | 50 | 82.00% | 0.22% |
| indonesian β computer_security | 40 | 50 | 80.00% | 0.22% |
| indonesian β conceptual_physics | 42 | 50 | 84.00% | 0.22% |
| indonesian β econometrics | 35 | 50 | 70.00% | 0.22% |
| indonesian β electrical_engineering | 32 | 50 | 64.00% | 0.22% |
| indonesian β elementary_mathematics | 46 | 50 | 92.00% | 0.22% |
| indonesian β formal_logic | 31 | 50 | 62.00% | 0.22% |
| indonesian β global_facts | 28 | 50 | 56.00% | 0.22% |
| indonesian β high_school_biology | 45 | 50 | 90.00% | 0.22% |
| indonesian β high_school_chemistry | 47 | 50 | 94.00% | 0.22% |
| indonesian β high_school_computer_science | 45 | 50 | 90.00% | 0.22% |
| indonesian β high_school_european_history | 31 | 50 | 62.00% | 0.22% |
| indonesian β high_school_geography | 42 | 50 | 84.00% | 0.22% |
| indonesian β high_school_government_and_politics | 37 | 50 | 74.00% | 0.22% |
| indonesian β high_school_macroeconomics | 38 | 50 | 76.00% | 0.22% |
| indonesian β high_school_mathematics | 43 | 50 | 86.00% | 0.22% |
| indonesian β high_school_microeconomics | 43 | 50 | 86.00% | 0.22% |
| indonesian β high_school_physics | 42 | 50 | 84.00% | 0.22% |
| indonesian β high_school_psychology | 42 | 50 | 84.00% | 0.22% |
| indonesian β high_school_statistics | 40 | 50 | 80.00% | 0.22% |
| indonesian β high_school_us_history | 38 | 50 | 76.00% | 0.22% |
| indonesian β high_school_world_history | 40 | 50 | 80.00% | 0.22% |
| indonesian β human_aging | 23 | 50 | 46.00% | 0.22% |
| indonesian β human_sexuality | 41 | 50 | 82.00% | 0.22% |
| indonesian β international_law | 34 | 50 | 68.00% | 0.22% |
| indonesian β jurisprudence | 34 | 50 | 68.00% | 0.22% |
| indonesian β logical_fallacies | 30 | 50 | 60.00% | 0.22% |
| indonesian β machine_learning | 32 | 50 | 64.00% | 0.22% |
| indonesian β management | 38 | 50 | 76.00% | 0.22% |
| indonesian β marketing | 45 | 50 | 90.00% | 0.22% |
| indonesian β medical_genetics | 44 | 50 | 88.00% | 0.22% |
| indonesian β miscellaneous | 35 | 50 | 70.00% | 0.22% |
| indonesian β moral_disputes | 40 | 50 | 80.00% | 0.22% |
| indonesian β moral_scenarios | 32 | 50 | 64.00% | 0.22% |
| indonesian β nutrition | 39 | 50 | 78.00% | 0.22% |
| indonesian β philosophy | 27 | 50 | 54.00% | 0.22% |
| indonesian β prehistory | 34 | 50 | 68.00% | 0.22% |
| indonesian β professional_accounting | 23 | 50 | 46.00% | 0.22% |
| indonesian β professional_law | 18 | 50 | 36.00% | 0.22% |
| indonesian β professional_medicine | 36 | 50 | 72.00% | 0.22% |
| indonesian β professional_psychology | 31 | 50 | 62.00% | 0.22% |
| indonesian β public_relations | 31 | 50 | 62.00% | 0.22% |
| indonesian β security_studies | 34 | 50 | 68.00% | 0.22% |
| indonesian β sociology | 40 | 50 | 80.00% | 0.22% |
| indonesian β us_foreign_policy | 34 | 50 | 68.00% | 0.22% |
| indonesian β virology | 28 | 50 | 56.00% | 0.22% |
| indonesian β world_religions | 38 | 50 | 76.00% | 0.22% |
| thai | 1897 | 2850 | 66.56% | 12.81% |
| thai β abstract_algebra | 27 | 50 | 54.00% | 0.22% |
| thai β anatomy | 27 | 50 | 54.00% | 0.22% |
| thai β astronomy | 44 | 50 | 88.00% | 0.22% |
| thai β business_ethics | 36 | 50 | 72.00% | 0.22% |
| thai β clinical_knowledge | 38 | 50 | 76.00% | 0.22% |
| thai β college_biology | 42 | 50 | 84.00% | 0.22% |
| thai β college_chemistry | 28 | 50 | 56.00% | 0.22% |
| thai β college_computer_science | 30 | 50 | 60.00% | 0.22% |
| thai β college_mathematics | 27 | 50 | 54.00% | 0.22% |
| thai β college_medicine | 39 | 50 | 78.00% | 0.22% |
| thai β college_physics | 39 | 50 | 78.00% | 0.22% |
| thai β computer_security | 41 | 50 | 82.00% | 0.22% |
| thai β conceptual_physics | 37 | 50 | 74.00% | 0.22% |
| thai β econometrics | 29 | 50 | 58.00% | 0.22% |
| thai β electrical_engineering | 36 | 50 | 72.00% | 0.22% |
| thai β elementary_mathematics | 49 | 50 | 98.00% | 0.22% |
| thai β formal_logic | 24 | 50 | 48.00% | 0.22% |
| thai β global_facts | 21 | 50 | 42.00% | 0.22% |
| thai β high_school_biology | 38 | 50 | 76.00% | 0.22% |
| thai β high_school_chemistry | 37 | 50 | 74.00% | 0.22% |
| thai β high_school_computer_science | 41 | 50 | 82.00% | 0.22% |
| thai β high_school_european_history | 38 | 50 | 76.00% | 0.22% |
| thai β high_school_geography | 37 | 50 | 74.00% | 0.22% |
| thai β high_school_government_and_politics | 35 | 50 | 70.00% | 0.22% |
| thai β high_school_macroeconomics | 43 | 50 | 86.00% | 0.22% |
| thai β high_school_mathematics | 41 | 50 | 82.00% | 0.22% |
| thai β high_school_microeconomics | 37 | 50 | 74.00% | 0.22% |
| thai β high_school_physics | 38 | 50 | 76.00% | 0.22% |
| thai β high_school_psychology | 34 | 50 | 68.00% | 0.22% |
| thai β high_school_statistics | 34 | 50 | 68.00% | 0.22% |
| thai β high_school_us_history | 33 | 50 | 66.00% | 0.22% |
| thai β high_school_world_history | 38 | 50 | 76.00% | 0.22% |
| thai β human_aging | 25 | 50 | 50.00% | 0.22% |
| thai β human_sexuality | 32 | 50 | 64.00% | 0.22% |
| thai β international_law | 33 | 50 | 66.00% | 0.22% |
| thai β jurisprudence | 28 | 50 | 56.00% | 0.22% |
| thai β logical_fallacies | 30 | 50 | 60.00% | 0.22% |
| thai β machine_learning | 31 | 50 | 62.00% | 0.22% |
| thai β management | 33 | 50 | 66.00% | 0.22% |
| thai β marketing | 36 | 50 | 72.00% | 0.22% |
| thai β medical_genetics | 36 | 50 | 72.00% | 0.22% |
| thai β miscellaneous | 37 | 50 | 74.00% | 0.22% |
| thai β moral_disputes | 29 | 50 | 58.00% | 0.22% |
| thai β moral_scenarios | 34 | 50 | 68.00% | 0.22% |
| thai β nutrition | 40 | 50 | 80.00% | 0.22% |
| thai β philosophy | 29 | 50 | 58.00% | 0.22% |
| thai β prehistory | 30 | 50 | 60.00% | 0.22% |
| thai β professional_accounting | 27 | 50 | 54.00% | 0.22% |
| thai β professional_law | 19 | 50 | 38.00% | 0.22% |
| thai β professional_medicine | 35 | 50 | 70.00% | 0.22% |
| thai β professional_psychology | 26 | 50 | 52.00% | 0.22% |
| thai β public_relations | 26 | 50 | 52.00% | 0.22% |
| thai β security_studies | 28 | 50 | 56.00% | 0.22% |
| thai β sociology | 29 | 50 | 58.00% | 0.22% |
| thai β us_foreign_policy | 30 | 50 | 60.00% | 0.22% |
| thai β virology | 26 | 50 | 52.00% | 0.22% |
| thai β world_religions | 30 | 50 | 60.00% | 0.22% |
| vietnamese | 1997 | 2850 | 70.07% | 12.81% |
| vietnamese β abstract_algebra | 35 | 50 | 70.00% | 0.22% |
| vietnamese β anatomy | 24 | 50 | 48.00% | 0.22% |
| vietnamese β astronomy | 44 | 50 | 88.00% | 0.22% |
| vietnamese β business_ethics | 32 | 50 | 64.00% | 0.22% |
| vietnamese β clinical_knowledge | 40 | 50 | 80.00% | 0.22% |
| vietnamese β college_biology | 44 | 50 | 88.00% | 0.22% |
| vietnamese β college_chemistry | 34 | 50 | 68.00% | 0.22% |
| vietnamese β college_computer_science | 36 | 50 | 72.00% | 0.22% |
| vietnamese β college_mathematics | 31 | 50 | 62.00% | 0.22% |
| vietnamese β college_medicine | 45 | 50 | 90.00% | 0.22% |
| vietnamese β college_physics | 38 | 50 | 76.00% | 0.22% |
| vietnamese β computer_security | 40 | 50 | 80.00% | 0.22% |
| vietnamese β conceptual_physics | 42 | 50 | 84.00% | 0.22% |
| vietnamese β econometrics | 37 | 50 | 74.00% | 0.22% |
| vietnamese β electrical_engineering | 36 | 50 | 72.00% | 0.22% |
| vietnamese β elementary_mathematics | 44 | 50 | 88.00% | 0.22% |
| vietnamese β formal_logic | 29 | 50 | 58.00% | 0.22% |
| vietnamese β global_facts | 24 | 50 | 48.00% | 0.22% |
| vietnamese β high_school_biology | 43 | 50 | 86.00% | 0.22% |
| vietnamese β high_school_chemistry | 44 | 50 | 88.00% | 0.22% |
| vietnamese β high_school_computer_science | 46 | 50 | 92.00% | 0.22% |
| vietnamese β high_school_european_history | 32 | 50 | 64.00% | 0.22% |
| vietnamese β high_school_geography | 38 | 50 | 76.00% | 0.22% |
| vietnamese β high_school_government_and_politics | 36 | 50 | 72.00% | 0.22% |
| vietnamese β high_school_macroeconomics | 43 | 50 | 86.00% | 0.22% |
| vietnamese β high_school_mathematics | 44 | 50 | 88.00% | 0.22% |
| vietnamese β high_school_microeconomics | 43 | 50 | 86.00% | 0.22% |
| vietnamese β high_school_physics | 38 | 50 | 76.00% | 0.22% |
| vietnamese β high_school_psychology | 40 | 50 | 80.00% | 0.22% |
| vietnamese β high_school_statistics | 41 | 50 | 82.00% | 0.22% |
| vietnamese β high_school_us_history | 34 | 50 | 68.00% | 0.22% |
| vietnamese β high_school_world_history | 38 | 50 | 76.00% | 0.22% |
| vietnamese β human_aging | 21 | 50 | 42.00% | 0.22% |
| vietnamese β human_sexuality | 33 | 50 | 66.00% | 0.22% |
| vietnamese β international_law | 31 | 50 | 62.00% | 0.22% |
| vietnamese β jurisprudence | 33 | 50 | 66.00% | 0.22% |
| vietnamese β logical_fallacies | 33 | 50 | 66.00% | 0.22% |
| vietnamese β machine_learning | 27 | 50 | 54.00% | 0.22% |
| vietnamese β management | 38 | 50 | 76.00% | 0.22% |
| vietnamese β marketing | 39 | 50 | 78.00% | 0.22% |
| vietnamese β medical_genetics | 42 | 50 | 84.00% | 0.22% |
| vietnamese β miscellaneous | 31 | 50 | 62.00% | 0.22% |
| vietnamese β moral_disputes | 33 | 50 | 66.00% | 0.22% |
| vietnamese β moral_scenarios | 28 | 50 | 56.00% | 0.22% |
| vietnamese β nutrition | 42 | 50 | 84.00% | 0.22% |
| vietnamese β philosophy | 27 | 50 | 54.00% | 0.22% |
| vietnamese β prehistory | 34 | 50 | 68.00% | 0.22% |
| vietnamese β professional_accounting | 25 | 50 | 50.00% | 0.22% |
| vietnamese β professional_law | 19 | 50 | 38.00% | 0.22% |
| vietnamese β professional_medicine | 34 | 50 | 68.00% | 0.22% |
| vietnamese β professional_psychology | 28 | 50 | 56.00% | 0.22% |
| vietnamese β public_relations | 27 | 50 | 54.00% | 0.22% |
| vietnamese β security_studies | 32 | 50 | 64.00% | 0.22% |
| vietnamese β sociology | 31 | 50 | 62.00% | 0.22% |
| vietnamese β us_foreign_policy | 36 | 50 | 72.00% | 0.22% |
| vietnamese β virology | 24 | 50 | 48.00% | 0.22% |
| vietnamese β world_religions | 34 | 50 | 68.00% | 0.22% |