Update docs.md
Browse files
docs.md
CHANGED
|
@@ -59,6 +59,7 @@
|
|
| 59 |
<!-- Updates -------------------------------------------------------------->
|
| 60 |
<h2>π’ Updates</h2>
|
| 61 |
<ul>
|
|
|
|
| 62 |
<li>ποΈ 2025/12/07: Updated leaderboard with 1 model (99 models in total)! <a href="https://huggingface.co/spaces/YLab-Open/BRIDGE-Medical-Leaderboard/blob/main/models-log.md#%F0%9F%93%85-update-2025-12-07">View the full list of added models</a></li>
|
| 63 |
<li>ποΈ 2025/11/04: Updated leaderboard with 2 models (98 models in total)! <a href="https://huggingface.co/spaces/YLab-Open/BRIDGE-Medical-Leaderboard/blob/main/models-log.md#%F0%9F%93%85-update-2025-11-04">View the full list of added models</a></li>
|
| 64 |
<li>ποΈ 2025/11/01: Updated leaderboard with 3 models (96 models in total)! <a href="https://huggingface.co/spaces/YLab-Open/BRIDGE-Medical-Leaderboard/blob/main/models-log.md#%F0%9F%93%85-update-2025-11-01">View the full list of added models</a></li>
|
|
@@ -71,7 +72,7 @@
|
|
| 71 |
|
| 72 |
<!-- Background ----------------------------------------------------------->
|
| 73 |
<h2>π Background</h2>
|
| 74 |
-
<p>Recent advances in <strong>Large Language Models (LLMs)</strong> have demonstrated transformative potential in <strong>healthcare</strong>, yet concerns remain around their reliability and clinical validity across diverse clinical tasks, specialties, and languages. To support timely and trustworthy evaluation, building upon our <a href="https://ai.nejm.org/doi/full/10.1056/AIra2400012">systematic review</a> of global clinical text resources, we introduce <a href="https://arxiv.org/abs/2504.19467">BRIDGE</a>, <strong>a multilingual benchmark that comprises 87 real-world clinical text tasks spanning nine languages and more than one million samples</strong>. Furthermore, we construct this leaderboard of LLM in clinical text understanding by systematically evaluating <strong>
|
| 75 |
This project is led and maintained by the team of <a href="https://ylab.top/">Prof. Jie Yang</a> and <a href="https://www.drugepi.org/team/joshua-kueiyu-lin">Prof. Kueiyu Joshua Lin</a> at Harvard Medical School and Brigham and Women's Hospital.
|
| 76 |
|
| 77 |
<!-- Dataset illustration ------------------------------------------------->
|
|
@@ -102,7 +103,7 @@ This project is led and maintained by the team of <a href="https://ylab.top/">Pr
|
|
| 102 |
<li><strong>Multilingual Context</strong>: 9 languages: English, Chinese, Spanish, Japanese, German, Russian, French, Norwegian, and Portuguese</li>
|
| 103 |
<li><strong>Diverse Task Types</strong>: 8 task types: Text classification, Semantic similarity, Normalization and coding, Named entity recognition, Natural language inference, Event extraction, Question answering, and Text summarization</li>
|
| 104 |
<li><strong>Broad Clinical Applications</strong>: 14 Clinical specialties, 7 Clinical document types, 20 Clinical applications covering 6 clinical stages of patient care</li>
|
| 105 |
-
<li><strong>Advanced LLMs (
|
| 106 |
<ul>
|
| 107 |
<li><strong>Proprietary models</strong>: GPT-4o, GPT-3.5, Gemini-2.5-Flash, Gemini-2.0-Flash, Gemini-1.5-Pro ...</li>
|
| 108 |
<li><strong>Open-source models</strong>: GPT-oss, Qwen 3/2.5, Llama 3/4, Mistral, Gemma ...</li>
|
|
|
|
| 59 |
<!-- Updates -------------------------------------------------------------->
|
| 60 |
<h2>π’ Updates</h2>
|
| 61 |
<ul>
|
| 62 |
+
<li>ποΈ 2026/01/13: Updated leaderboard with 4 models (103 models in total)! <a href="https://huggingface.co/spaces/YLab-Open/BRIDGE-Medical-Leaderboard/blob/main/models-log.md#%F0%9F%93%85-update-2026-01-13">View the full list of added models</a></li>
|
| 63 |
<li>ποΈ 2025/12/07: Updated leaderboard with 1 model (99 models in total)! <a href="https://huggingface.co/spaces/YLab-Open/BRIDGE-Medical-Leaderboard/blob/main/models-log.md#%F0%9F%93%85-update-2025-12-07">View the full list of added models</a></li>
|
| 64 |
<li>ποΈ 2025/11/04: Updated leaderboard with 2 models (98 models in total)! <a href="https://huggingface.co/spaces/YLab-Open/BRIDGE-Medical-Leaderboard/blob/main/models-log.md#%F0%9F%93%85-update-2025-11-04">View the full list of added models</a></li>
|
| 65 |
<li>ποΈ 2025/11/01: Updated leaderboard with 3 models (96 models in total)! <a href="https://huggingface.co/spaces/YLab-Open/BRIDGE-Medical-Leaderboard/blob/main/models-log.md#%F0%9F%93%85-update-2025-11-01">View the full list of added models</a></li>
|
|
|
|
| 72 |
|
| 73 |
<!-- Background ----------------------------------------------------------->
|
| 74 |
<h2>π Background</h2>
|
| 75 |
+
<p>Recent advances in <strong>Large Language Models (LLMs)</strong> have demonstrated transformative potential in <strong>healthcare</strong>, yet concerns remain around their reliability and clinical validity across diverse clinical tasks, specialties, and languages. To support timely and trustworthy evaluation, building upon our <a href="https://ai.nejm.org/doi/full/10.1056/AIra2400012">systematic review</a> of global clinical text resources, we introduce <a href="https://arxiv.org/abs/2504.19467">BRIDGE</a>, <strong>a multilingual benchmark that comprises 87 real-world clinical text tasks spanning nine languages and more than one million samples</strong>. Furthermore, we construct this leaderboard of LLM in clinical text understanding by systematically evaluating <strong>103 state-of-the-art LLMs</strong> (by 2025/11/04).</p>
|
| 76 |
This project is led and maintained by the team of <a href="https://ylab.top/">Prof. Jie Yang</a> and <a href="https://www.drugepi.org/team/joshua-kueiyu-lin">Prof. Kueiyu Joshua Lin</a> at Harvard Medical School and Brigham and Women's Hospital.
|
| 77 |
|
| 78 |
<!-- Dataset illustration ------------------------------------------------->
|
|
|
|
| 103 |
<li><strong>Multilingual Context</strong>: 9 languages: English, Chinese, Spanish, Japanese, German, Russian, French, Norwegian, and Portuguese</li>
|
| 104 |
<li><strong>Diverse Task Types</strong>: 8 task types: Text classification, Semantic similarity, Normalization and coding, Named entity recognition, Natural language inference, Event extraction, Question answering, and Text summarization</li>
|
| 105 |
<li><strong>Broad Clinical Applications</strong>: 14 Clinical specialties, 7 Clinical document types, 20 Clinical applications covering 6 clinical stages of patient care</li>
|
| 106 |
+
<li><strong>Advanced LLMs (103 models)</strong>:
|
| 107 |
<ul>
|
| 108 |
<li><strong>Proprietary models</strong>: GPT-4o, GPT-3.5, Gemini-2.5-Flash, Gemini-2.0-Flash, Gemini-1.5-Pro ...</li>
|
| 109 |
<li><strong>Open-source models</strong>: GPT-oss, Qwen 3/2.5, Llama 3/4, Mistral, Gemma ...</li>
|